-- Logs begin at Sat 2022-04-02 20:01:18 UTC, end at Sat 2022-04-02 22:19:55 UTC. -- Apr 02 20:34:51.487642 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Apr 02 20:34:51.496908 ncdv-master-1 devstack@keystone.service[97302]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 2 20:34:51 2022] *** Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: nodename: ncdv-master-1 Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: machine: x86_64 Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: clock source: unix Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: pcre jit disabled Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: detected number of CPU cores: 4 Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: current working directory: / Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: detected binary path: /usr/bin/uwsgi-core Apr 02 20:34:51.498942 ncdv-master-1 devstack@keystone.service[97302]: your processes number limit is 47680 Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: your memory page size is 4096 bytes Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: detected max file descriptor number: 2048 Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: lock engine: pthread robust mutexes Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: thunder lock: enabled Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 02 20:34:51.499555 ncdv-master-1 devstack@keystone.service[97302]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 02 20:34:51.552747 ncdv-master-1 devstack@keystone.service[97302]: Python main interpreter initialized at 0x55c3d75e99c0 Apr 02 20:34:51.552747 ncdv-master-1 devstack@keystone.service[97302]: python threads support enabled Apr 02 20:34:51.552747 ncdv-master-1 devstack@keystone.service[97302]: your server socket listen backlog is limited to 100 connections Apr 02 20:34:51.552747 ncdv-master-1 devstack@keystone.service[97302]: your mercy for graceful operations on workers is 90 seconds Apr 02 20:34:51.553140 ncdv-master-1 devstack@keystone.service[97302]: mapped 403077 bytes (393 KB) for 2 cores Apr 02 20:34:51.553205 ncdv-master-1 devstack@keystone.service[97302]: *** Operational MODE: preforking *** Apr 02 20:34:51.553499 ncdv-master-1 devstack@keystone.service[97302]: *** uWSGI is running in multiple interpreter mode *** Apr 02 20:34:51.553499 ncdv-master-1 devstack@keystone.service[97302]: spawned uWSGI master process (pid: 97302) Apr 02 20:34:51.553713 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Apr 02 20:34:51.554331 ncdv-master-1 devstack@keystone.service[97302]: spawned uWSGI worker 1 (pid: 97316, cores: 1) Apr 02 20:34:51.554668 ncdv-master-1 devstack@keystone.service[97302]: spawned uWSGI worker 2 (pid: 97317, cores: 1) Apr 02 20:34:51.554837 ncdv-master-1 devstack@keystone.service[97302]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 02 20:34:57.487101 ncdv-master-1 devstack@keystone.service[97317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:34:57.487101 ncdv-master-1 devstack@keystone.service[97317]: from cryptography.utils import int_from_bytes Apr 02 20:34:57.487792 ncdv-master-1 devstack@keystone.service[97317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:34:57.487792 ncdv-master-1 devstack@keystone.service[97317]: from cryptography.utils import int_from_bytes Apr 02 20:34:57.487896 ncdv-master-1 devstack@keystone.service[97316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:34:57.487896 ncdv-master-1 devstack@keystone.service[97316]: from cryptography.utils import int_from_bytes Apr 02 20:34:57.487896 ncdv-master-1 devstack@keystone.service[97316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:34:57.487896 ncdv-master-1 devstack@keystone.service[97316]: from cryptography.utils import int_from_bytes Apr 02 20:34:57.532435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:34:57.532653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:34:57.532796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:34:57.532890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] command line args: [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:34:57.532977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:34:57.533096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:34:57.533199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] command line args: [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:34:57.533278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ================================================================================ {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:34:57.533428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:34:57.533519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] admin_token = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.533597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ================================================================================ {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:34:57.533735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] config_dir = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.533850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] admin_token = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.533928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] config_source = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] config_dir = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] debug = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] config_source = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] debug = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.534996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_config_append = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.535979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_config_append = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_dir = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_file = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_dir = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.536982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_file = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.537063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.537678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.537767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.537846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.537970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.538937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.539957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.540923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] publish_errors = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] publish_errors = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.541858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] standard_threads = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] standard_threads = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.542940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] use_journal = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] use_json = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] use_journal = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] use_stderr = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] use_json = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] use_syslog = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] use_stderr = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] use_syslog = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.543993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:34:57.544079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.544997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.545938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.546990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.547954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.548928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.549926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.550999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.551929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.552751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.553444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.553531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.553692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.553771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.553925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.554915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.555862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.556945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.557971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.558901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.559998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.560968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.561998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.562933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.563862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.564979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.565915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.566910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.567976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.568857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.external = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.external = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.569987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.password = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] auth.token = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.password = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] auth.token = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.570982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.571930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.572895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.573998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.574993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.575826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.576972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.577985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.578948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.579899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.580844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.581934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.582904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.583942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.584953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.585913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.586986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.587962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.588954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.589146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.589277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.589655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.589850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.589990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.590952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.591937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.592947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.593880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.594978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.595954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.596887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.597862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.602869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.603010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.603200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.604917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.605939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.606952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.607905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] role.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] role.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.608975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.609989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.610113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.611741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.611885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.612931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.613959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.614962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] role.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] role.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.615384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.616742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.616869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.616945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.617876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.618895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.619917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.620989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.621516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.622543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.622677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.622804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.622930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.623798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.624884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.625973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.connection = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.connection = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.626913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.627899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.628928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.629863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:34:57.630617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:34:57.657691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.657937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.658133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.667191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.670820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.671054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.671280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.680311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.695909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.696139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.698739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.698974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.751270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.751459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.800969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.801170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.801301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.801429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.868706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.868916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.869877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.870004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.870132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.870132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.892989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.893936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.894086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.894171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.894295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.894481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.894702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.895045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.895265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.906152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.906387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.919954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97317) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.920832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 02 20:34:57.938356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.938568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 02 20:34:57.938907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.939108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 02 20:34:57.939376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.939636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.939894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.940149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.943213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.943461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 02 20:34:57.943803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.944006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 02 20:34:57.944277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.944563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.944822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.945178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.954634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.954922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.955192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.955916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.957604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.957882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.958146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.958423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.967538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:57.968601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:57.970804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:57.971085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.971367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.971647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.971816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:57.971924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.972925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.973842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.974110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.974380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:57.974671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.000310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.001348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.002036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.002315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.002873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.003150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.007583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.007859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.008136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.008337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.008636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.008913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.015330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.015607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.016031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.016305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.020006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.020403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.020711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.020848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.020979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.021129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.021261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.021387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.022906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.023166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.041470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.041746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.042103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.042378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.046353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.046901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.049942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.050234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.050489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.050778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.055213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.055734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.058762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.059297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.062754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.063912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.064036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.064169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.064296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.064420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.083505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.083673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.083823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.083955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.084163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.084308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.084509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.084650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.092535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.092674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.094238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.094373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.094498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.094622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.097484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.097573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.097759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.097842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.098700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.113585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.113696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.113861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.113946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.114974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.115058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.115259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.115416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.234580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.234806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.237843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.238103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.241173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.241499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.242740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.243739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.244355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.244658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.244940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.246369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.246842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.247158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.252311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.253866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.255224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.257437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.257580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.257860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.258140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.258418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.260622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.260910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.261192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.261512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.267510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.267795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.268070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.270594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.270881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.271156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.276048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97317) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.276359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.276693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.276981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.277248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.277514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.277800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.278062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.278325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.278602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.278868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.279123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.279490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.279753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97317) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.280540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 02 20:34:58.280824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.281102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.281374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.281638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.281904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.282173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.282453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.282720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.282984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.283255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.283514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.283803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.284053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 02 20:34:58.317373 ncdv-master-1 devstack@keystone.service[97317]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c3d75e99c0 pid: 97317 (default app) Apr 02 20:34:58.321305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f4ba-0c04-46c6-bc7d-1078306bab4d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:34:58.321597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f4ba-0c04-46c6-bc7d-1078306bab4d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:34:58.321874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f4ba-0c04-46c6-bc7d-1078306bab4d None None] PATH_INFO: `/v3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:34:58.322514 ncdv-master-1 devstack@keystone.service[97316]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c3d75e99c0 pid: 97316 (default app) Apr 02 20:34:58.326033 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sat Apr 2 20:34:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:06.676596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:06.677141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:06.677141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:06.682675 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:06.687718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:06.688147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:06.688340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:06.718937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG oslo_db.sqlalchemy.engines [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:35:06.906059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG passlib.handlers.bcrypt [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=97317) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 02 20:35:06.906470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG passlib.handlers.bcrypt [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97317) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 02 20:35:06.962146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:06.963750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:07.084693 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 02 20:35:07.119762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:07.153414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:35:07.280321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0281a-7e0e-4bcb-ac3c-95cc194ac87c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:07.284684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:07.285352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:07.285642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:07.285925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:07.294582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:07.344750 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 02 20:35:07.345040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a1474-492e-46c0-a2aa-797ddbdf294f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:07.354819 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Apr 2 20:35:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:35:07.360842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:07.375850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e2238-c38a-469f-ae36-889c8c95b604 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:07.380391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:07.381549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:07.381831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:07.382102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] PATH_INFO: `/v3/projects/fa034640396047d6b05aa8a8842d2e67` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:07.383600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa034640396047d6b05aa8a8842d2e67)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:07.435876 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 02 20:35:07.436217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ad14-61bc-406d-86de-d3724637d201 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:07.440928 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sat Apr 2 20:35:07 2022] GET /identity/v3/projects/fa034640396047d6b05aa8a8842d2e67 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:09.772944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edb00-ea85-4785-b71b-5629c2d46e15 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:09.773439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edb00-ea85-4785-b71b-5629c2d46e15 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:09.773439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8edb00-ea85-4785-b71b-5629c2d46e15 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:09.778103 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:09.784588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:09.785015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:09.785153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:09.804088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:09.805632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:09.813454 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 02 20:35:09.838020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8edb00-ea85-4785-b71b-5629c2d46e15 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:09.850563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8edb00-ea85-4785-b71b-5629c2d46e15 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:09.854712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:09.855337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:09.855619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:09.855889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:09.863344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:09.865134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9df1e-6cec-4a26-ba40-10a33c5e5291 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:09.873720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Apr 2 20:35:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:35:09.878860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:09.887760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ce502-b8d5-4b7b-8cc7-dfcf6ca2bcfa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:09.892100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:09.892994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:09.893283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:09.893563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:09.894948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:09.897349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b6b2-2125-4af6-871a-3166fb69baed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:09.898875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Apr 2 20:35:09 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:12.309476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d972ff-86e9-45ac-92cf-e280e91aacea None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.310000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d972ff-86e9-45ac-92cf-e280e91aacea None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.310103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d972ff-86e9-45ac-92cf-e280e91aacea None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.311816 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:12.318819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.319241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.319381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.336213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:12.337395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:12.355079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127bd5-c1f5-41ec-adbe-fd002363b3a0 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.355371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127bd5-c1f5-41ec-adbe-fd002363b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.355651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127bd5-c1f5-41ec-adbe-fd002363b3a0 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.357408 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:12.363941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.364226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.364554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.405234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG passlib.handlers.bcrypt [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=97316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 02 20:35:12.405657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG passlib.handlers.bcrypt [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 02 20:35:12.414950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:12.438666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.452401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:12.454156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:12.535766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3987d21-b183-43d3-93f9-fdb6978b2b7f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:12.550551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:12.567362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:12.568640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.568932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.569212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.574762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.580722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:12.588299 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:12.589786 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:12.595299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.670097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141fa5-3a06-4dcf-be8b-8ea43453c11d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:12.689690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d02841-2261-49ec-a844-024f2e85ebe7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:12.702343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:12.703223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.703513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.703792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.724873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:12.725548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.725834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.726117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.734256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:12.734256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:12.734256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:12.740341 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:12.745775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.774764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:12.776281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:12.839383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f15e0-c4f2-48c2-8f35-156cf871b798 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:12.868137 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:35:12.871075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:12.871950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:12.872237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:12.872548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:12.873662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.873761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:12.875224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:12.876851 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:12.882494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:12.970406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697b5e-9710-4a47-975c-acb1410c2db1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:12.975524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16711dba-a278-4853-ac59-9baa641dcc1b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:13.009323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:13.010586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:13.010973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:13.011448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:13.016316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:13.017167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:13.017454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:13.017728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:13.019134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:13.021003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:13.028997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:13.031739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:13.031867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:13.033491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:13.053593 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:35:13.054821 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:13.060566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:13.130370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dc9bd-0d34-4c45-8556-dc81361c5a86 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:13.153530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c569-8e3d-49e1-b1eb-ae3a584ba4c6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:13.161181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:13.162380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:13.162666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:13.162946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:13.163762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.domain.id=default, user.id=f64244c630f04a95910fd2ccfc3fa177) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:13.164075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:13.165558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e425b-c30b-4466-bc2f-21bddfe18234 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:13.172189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Apr 2 20:35:13 2022] GET /identity/v3/role_assignments?user.id=f64244c630f04a95910fd2ccfc3fa177&scope.domain.id=default&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:13.186674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:13.187357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:13.187639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:13.187915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:13.188682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:13.188992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:13.190457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e179549-8835-48b0-a50a-dbde1d2a4c17 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:13.209989 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:16.058881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570bc6-f8e6-4cd7-b370-d5a96fa54f05 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.059422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570bc6-f8e6-4cd7-b370-d5a96fa54f05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.059422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53570bc6-f8e6-4cd7-b370-d5a96fa54f05 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.061836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:16.069351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f749-e66a-4351-8a34-fc7e43057156 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.069794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f749-e66a-4351-8a34-fc7e43057156 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.069986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f749-e66a-4351-8a34-fc7e43057156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.093739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1b34f749-e66a-4351-8a34-fc7e43057156 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:16.095040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b34f749-e66a-4351-8a34-fc7e43057156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:16.183068 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:16.217277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53570bc6-f8e6-4cd7-b370-d5a96fa54f05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:16.260389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1588-846b-4e11-99d3-ee773f16148e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.260732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1588-846b-4e11-99d3-ee773f16148e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.260991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1588-846b-4e11-99d3-ee773f16148e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.263072 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:16.269669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fe59c-5531-4068-aaaa-ccfabb04d085 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.269965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fe59c-5531-4068-aaaa-ccfabb04d085 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.270247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fe59c-5531-4068-aaaa-ccfabb04d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.305622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-885fe59c-5531-4068-aaaa-ccfabb04d085 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:16.306874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-885fe59c-5531-4068-aaaa-ccfabb04d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:16.367447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53570bc6-f8e6-4cd7-b370-d5a96fa54f05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:16.425594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:16.426819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b122-e7ec-49cc-8315-4295fd81d4a5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.426819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b122-e7ec-49cc-8315-4295fd81d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.429463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00b122-e7ec-49cc-8315-4295fd81d4a5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.429612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:16.429612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.429612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.429612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.437154 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:16.451461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.451461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.451461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.456125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:16.464413 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:16.466048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 13/27] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:16.467069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:16.478092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:16.479599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:16.566054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:16.567251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:16.606440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8b3e-43c6-48a1-a34d-3a931dd0051c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:16.655222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:16.656053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.656339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.656639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.657388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:16.658793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:16.697282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe00d-de2b-4cfc-9bbc-ac20dfc62efc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:16.745587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:16.746624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.747112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.747591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.748608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:16.749135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:16.750728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:16.777046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:16.778396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:16.809578 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 14/30] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Apr 2 20:35:16 2022] POST /identity/v3/roles => generated 219 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:16.810837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:16.916694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea58e-69b3-430a-9eee-c56d504ca3f8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:16.928360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83aca-9013-412c-ac2d-2bbee5f2f0dc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:16.957437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:16.958407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:16.958693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:16.958971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:16.960635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:16.962251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:16.971545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:16 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:16.972122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.030172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.031004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.031287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.031564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.055495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.057044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.089432 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:35:17.090704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:17.101997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.183772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2271a38-9990-43eb-8401-b8b709d6ec18 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.222075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.222884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.223167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.223444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.229071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.229071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bbea3-ac39-4bac-8b49-b3ccf5fac4cf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.229302 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:17.230739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbba9-8460-4909-afd4-c9b1a7752acc None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.231134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbba9-8460-4909-afd4-c9b1a7752acc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.231522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbba9-8460-4909-afd4-c9b1a7752acc None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.233515 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 17/34] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:17.234641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d69cc-2f99-425e-a7d8-4fb56e1cd883 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.234943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d69cc-2f99-425e-a7d8-4fb56e1cd883 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.235341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d69cc-2f99-425e-a7d8-4fb56e1cd883 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.237281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:17.243915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d69cc-2f99-425e-a7d8-4fb56e1cd883 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.262402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6bd36-b784-417c-80be-956c2f5217b1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.297603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.298274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.298561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.298854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.299562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:17.299870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.301285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41353c1-25c6-4d60-9733-c7172aa5e679 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.313603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:17.314899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78feddc-b97f-4518-b588-3104389136aa None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.315190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78feddc-b97f-4518-b588-3104389136aa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.315466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78feddc-b97f-4518-b588-3104389136aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.333061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b78feddc-b97f-4518-b588-3104389136aa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:17.334204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b78feddc-b97f-4518-b588-3104389136aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:17.352178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d69cc-2f99-425e-a7d8-4fb56e1cd883 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.386240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.387508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.387997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.388525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] PATH_INFO: `/v3/domains/default/users/f64244c630f04a95910fd2ccfc3fa177/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.390771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f64244c630f04a95910fd2ccfc3fa177, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.392467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.401484 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:17.403047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.403290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.403567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.413010 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Apr 2 20:35:17 2022] PUT /identity/v3/domains/default/users/f64244c630f04a95910fd2ccfc3fa177/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:17.414798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.424484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:17.424484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:17.502847 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:17.503953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.579779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea934-32ba-4d57-b4c4-c36a972c887b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.619359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.620309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.620780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.621242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.621703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd8c1f-ad85-4654-b780-83e0e473ddaf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.622374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.623976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.653790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:17.655191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:17.670123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.671837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.672495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.672968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.674155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.676034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a7eb2-5c57-44b7-8565-8ecd6af14934 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.779767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d61b-2d97-407b-a7c4-c1afbd99524f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:17.816036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:17.816767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.817062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.817864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.818642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:17.820061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7907b2-1d36-4a61-a98d-120111d9ad1e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:17.822082 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/roles => generated 223 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:17.851922 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:17.880546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857309c-6c89-4687-88c5-6e0a68b28d42 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.881340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857309c-6c89-4687-88c5-6e0a68b28d42 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.881840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857309c-6c89-4687-88c5-6e0a68b28d42 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.884077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 22/43] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:17.891983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:17.892317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:17.892597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:17.927675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:17.929465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:18.025185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:18.052775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857309c-6c89-4687-88c5-6e0a68b28d42 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:18.173739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857309c-6c89-4687-88c5-6e0a68b28d42 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:18.205513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:18.206295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:18.206580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:18.206854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:18.208358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:18.209954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065da02-736b-420d-ac6a-9529a456abc7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:18.211543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:18.217501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:18.309318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78610f-e435-4a1c-866f-d70932f8579d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:18.340184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:18.340875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:18.341159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:18.341435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:18.342131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:18.343567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5c9e-6c34-4120-bda8-86a6ea884592 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:18.367856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:35:18 2022] POST /identity/v3/projects => generated 312 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:20.019768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3cacf-2442-4271-9884-aa98357b15ed None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.020308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3cacf-2442-4271-9884-aa98357b15ed None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.020436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3cacf-2442-4271-9884-aa98357b15ed None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.022192 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:20.028444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647d425-072c-458e-8171-682633716fc8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.028853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647d425-072c-458e-8171-682633716fc8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.029170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647d425-072c-458e-8171-682633716fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.046218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c647d425-072c-458e-8171-682633716fc8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:20.047407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c647d425-072c-458e-8171-682633716fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:20.110679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:20.135201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3cacf-2442-4271-9884-aa98357b15ed None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.231895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3cacf-2442-4271-9884-aa98357b15ed None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.264165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.264990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.265279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.265561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.276939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:20.283754 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:20.284968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:20.290874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647d425-072c-458e-8171-682633716fc8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.389026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647d425-072c-458e-8171-682633716fc8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.420746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.421977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.423133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.423442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.424195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:20.424530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:20.425920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:20.434580 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:20.440082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.548487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef7b88-38cd-4f10-8097-93fad82693c2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.583562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.584630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.585033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.585538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.587728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:20.589705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259111e-1645-4149-ae44-aa3eedfe52d8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:20.591626 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:20.596996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.708358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8df2e-eb25-4075-8aff-8d8bad00e17e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.721622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732524c-3566-41d2-bf3c-938e7d512593 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.721916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732524c-3566-41d2-bf3c-938e7d512593 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.722196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732524c-3566-41d2-bf3c-938e7d512593 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.724552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 27/52] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:20.730790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.731083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.731364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.746107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.747129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.747420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.747703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.748936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:20.750388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:20.750677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:20.752351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:20.752566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:20.758396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.819975 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:20.843536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:20.854332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b9d7-d5e2-4639-9a1a-8aec17b53cd6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.885763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.886411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.886697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.886977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.887797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.domain.id=default, user.id=f64244c630f04a95910fd2ccfc3fa177) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:20.888114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:20.889579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:20.895099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/role_assignments?user.id=f64244c630f04a95910fd2ccfc3fa177&scope.domain.id=default&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:20.941496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539120-dafb-446a-9503-35b922bfec6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:20.977478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:20.978297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:20.978585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:20.978864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:20.980109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:20.981638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6980a7-25d2-42ba-a4f2-5e84c3b87d1b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:20.983291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:20.989391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:21.090807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3a133-7322-4b4e-a255-7ee0d783d59e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:21.124432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:21.125190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:21.125485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:21.125764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:21.126468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:21.127909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5553a8-6f51-4afc-beb4-2217f5daf729 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:21.152340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Apr 2 20:35:20 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:23.497837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36437-2cd2-4448-ab57-d93202e008f1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:23.498303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36437-2cd2-4448-ab57-d93202e008f1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:23.498384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36437-2cd2-4448-ab57-d93202e008f1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:23.500142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:23.507034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:23.507433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:23.507596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:23.523814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:23.525019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:23.589043 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:23.615067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36437-2cd2-4448-ab57-d93202e008f1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:23.709565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36437-2cd2-4448-ab57-d93202e008f1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:23.743106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:23.743887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:23.744171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:23.744444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:23.745613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:23.747046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657f7b-bfab-45be-af0f-f17a2508a873 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:23.748630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:23.754092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:23.851255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a74d-6b5f-46e9-9f75-f56f337127da None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:23.882672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:23.883333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:23.883620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:23.884022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:23.884642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:23.886097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8ed36-913b-4901-a705-054ad936e6ef None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:23.910517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:23 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:35:27.487043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4362c2-3252-40e0-92a0-dd83f1f70316 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.487578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4362c2-3252-40e0-92a0-dd83f1f70316 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.487578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4362c2-3252-40e0-92a0-dd83f1f70316 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.490431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:27.496984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482af70-42da-45d6-af5c-42582c734118 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.497445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482af70-42da-45d6-af5c-42582c734118 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.497628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482af70-42da-45d6-af5c-42582c734118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.525475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8482af70-42da-45d6-af5c-42582c734118 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:27.526663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8482af70-42da-45d6-af5c-42582c734118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:27.602862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b3eb-e8eb-465a-8446-278c4b38f8cb None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.603189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b3eb-e8eb-465a-8446-278c4b38f8cb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.603421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b3eb-e8eb-465a-8446-278c4b38f8cb None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.605189 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:27.615424 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:27.619974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.620467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.620942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.641488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482af70-42da-45d6-af5c-42582c734118 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:27.646158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:27.647551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:27.751077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482af70-42da-45d6-af5c-42582c734118 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:27.765508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:27.785401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:27.786275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.786567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.786851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.797263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:27.804831 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:27.806062 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:27.807626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:27.811851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:27.921792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c660ba-7e8e-4456-896f-a42023cacdb3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:27.949353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78d118-712e-444f-a8ed-bc67ddcc4cce None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:27.957211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:27.958424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.958719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.959005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.959757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:27.960076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:27.961518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587d66-fdcf-43dc-9c46-f8ebb6f48ab0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:27.969927 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 33/67] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:27.971252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a444-e2b6-4af0-ac99-c4e6a7cdf403 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.971552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a444-e2b6-4af0-ac99-c4e6a7cdf403 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.971839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6a444-e2b6-4af0-ac99-c4e6a7cdf403 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.974413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 34/68] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:27.975426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776150-ac50-48fe-9b89-cfc85ffa0c76 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.975724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776150-ac50-48fe-9b89-cfc85ffa0c76 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.976010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776150-ac50-48fe-9b89-cfc85ffa0c76 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:27.980701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 35/69] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:27.980701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e776150-ac50-48fe-9b89-cfc85ffa0c76 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:27.993605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:27.994687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:27.995125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:27.995578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.007794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:28.014988 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cea63da3-be1f-441c-ba81-b510188bf27b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:28.016223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 35/70] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:28.017464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13eedb-1906-4fcd-8533-6d34912aaedd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.017760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13eedb-1906-4fcd-8533-6d34912aaedd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.018046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13eedb-1906-4fcd-8533-6d34912aaedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.034870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3f13eedb-1906-4fcd-8533-6d34912aaedd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:28.036637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f13eedb-1906-4fcd-8533-6d34912aaedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:28.093386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e776150-ac50-48fe-9b89-cfc85ffa0c76 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.103129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:28.104312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.104651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.104938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.121793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:28.122991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:28.143641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.145123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.145735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.146513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.148372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.150628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.152408 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:27 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.157357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.189074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 37/73] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:28.190219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.266506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae95a2-c154-4f3f-903f-d22779fda8b5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.296750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198472-5c74-48aa-b967-22385d7deb72 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.300117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.300832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.301192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.301486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.302233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:28.302549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.303944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.312118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.312953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.342594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.344321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.344848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.345349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.358580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:28.367700 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:28.369001 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:28.369780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.408438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8602f8f-a835-4624-a628-63ab2d025da1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.440370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.441055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.441347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.441630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.470782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7989-14ba-4dc1-8c8c-44cb13773143 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.508506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.509739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.510510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd3682-4512-4d9b-b2bc-62020ec256e1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.510606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.510809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.511089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.520927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:28.527651 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:28.528850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:28.529605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.605633 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 38/77] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:28.606957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc366-0889-4306-bc8f-7601e6eb54dc None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.607286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc366-0889-4306-bc8f-7601e6eb54dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.607524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc366-0889-4306-bc8f-7601e6eb54dc None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.609367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 39/78] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:28.613277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc366-0889-4306-bc8f-7601e6eb54dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.623155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b43d-4966-4f10-aa97-352ba1c06d36 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.659948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.661073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.661435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.661724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.676955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.678427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.680080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.680868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.711606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc366-0889-4306-bc8f-7601e6eb54dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.743744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.744410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.744728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.745009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.745745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:28.746055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.747431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.755269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.756058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.775933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165e182-3c02-4167-9444-ae494b7820e4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.810118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.810791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.811075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.811377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.812112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:28.812418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.813804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009a70f-c4e8-417c-9787-9c89bec75aa0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.822195 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.822195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.822195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.822195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.840939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:28.842156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:28.862755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faa5b0-9289-4722-82b4-ab6dd771c42c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:28.894477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:28.895910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:28.896198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:28.896512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:28.897709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:28.899159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:28.900869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:28.901632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:28.910180 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:28.910955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.004999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15c8e-9866-4e7a-bdfa-bd64ac4698d9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.005281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e879d-84de-485f-afd4-f9c7ee6d57e8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.036481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.037068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.037354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.037442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.037633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.038228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.038513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.038793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.039976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.041471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.043231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 43/84] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.043882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.103460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.105218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.154734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e715-8fea-40bf-b721-9143e5443e1e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.187242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.188102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.188388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.188699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.189883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.191372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.193231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 44/85] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.193897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.204326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 42/86] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:29.205082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.287748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6fc5-d35a-4dbe-9017-e697cba1b568 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.297168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1e8b-9ad5-4e2b-8997-50bf6d88519a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.318930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.319582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.319870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.320150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.320993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=f64244c630f04a95910fd2ccfc3fa177) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:29.321312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.322745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.328097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.328918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.329200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.329478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.330646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.330813 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/role_assignments?user.id=f64244c630f04a95910fd2ccfc3fa177&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.331590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.332092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.336491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 43/88] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.336491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.448123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a21a94-7a4d-4f3b-a631-49e05fb53c35 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.454146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85d12c-1678-4577-a1db-149388a325b1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.487711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.488382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.488843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.489301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.490643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.491325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.491711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.492000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.558486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.559631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.560005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.561153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.655504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 46/89] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:29.660986 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 44/90] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:29.660986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.661646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.758798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813d592-d15f-4cee-8720-6ba2a2df925c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.761278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271be3-b310-422d-86a9-627ffe7f94a7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.791535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.792640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.792925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.793202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.794040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.794357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.794712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.794997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.795277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.795798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.795978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.797689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.797789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 47/91] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.802990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.818205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 45/92] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:29 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:29.819544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.926700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718733bc-6f78-4b46-a0f4-6b244f194397 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.926894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd8bf-4e94-4dc1-a7d7-3480c6370ff3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:29.963864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.964113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:29.964779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.965062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.965338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] PATH_INFO: `/v3/projects/ec475e586c78458d85baed50708791dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.965960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:29.966461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:29.966629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ec475e586c78458d85baed50708791dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.967093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:29.968234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.968877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:29.970024 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/projects/ec475e586c78458d85baed50708791dc => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.970896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:29.973005 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:29.975697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:29.975810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:30.084705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0009-9df2-4576-86ed-c9d4f7cac4c7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:30.091539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110b44-535a-413b-8215-a78e9dc8e1ad None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:30.127345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:30.128016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:30.128306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:30.128659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:30.129562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:30.129890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:30.131314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:30.132982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:30.133899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:30.133899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:30.134181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:30.135451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=ec475e586c78458d85baed50708791dc, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:30.135781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:30.137567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c866977-7acf-4269-ba52-db48861edccd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:30.138109 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=7fae3e7cc044438ea145a155975c346d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:30.138748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:30.145633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:29 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=ec475e586c78458d85baed50708791dc&role.id=7fae3e7cc044438ea145a155975c346d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:30.268068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c797b68-ee69-4191-b97e-f4e03b6c08cb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:30.309133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:30.309810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:30.310098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:30.310378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:30.311216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:30.311532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:30.313070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac638003-5522-424e-b41a-8724eb824580 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:30.321351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:30 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=274759295627427290199d61ae093512 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:32.303013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a9d1-5c8d-48aa-b943-f71ff44ef95a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:32.303600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a9d1-5c8d-48aa-b943-f71ff44ef95a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:32.303600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a9d1-5c8d-48aa-b943-f71ff44ef95a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:32.305383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:32.312017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:32.312471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:32.312654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:32.337420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:32.338858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:32.419826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 49/99] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:32.462068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a9d1-5c8d-48aa-b943-f71ff44ef95a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:32.591326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a9d1-5c8d-48aa-b943-f71ff44ef95a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:32.630638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:32.631481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:32.631772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:32.632102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:32.642476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:32.649450 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:32.650660 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 51/100] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:32.656481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:32.772132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90510034-03a8-475f-a02c-fc7350baeda0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:32.809606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331207b-3181-40be-b793-f2424984e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:32.810209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331207b-3181-40be-b793-f2424984e36b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:32.810499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331207b-3181-40be-b793-f2424984e36b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:32.810780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331207b-3181-40be-b793-f2424984e36b None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:32.811526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331207b-3181-40be-b793-f2424984e36b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:32.811834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331207b-3181-40be-b793-f2424984e36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:32.813248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331207b-3181-40be-b793-f2424984e36b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:32.822560 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 50/101] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:32.828024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:32.955740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590f64-7ce0-44df-8646-85dd61f34381 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:33.004041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:33.005057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.005270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.005547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.006798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:33.008271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:33.009916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 52/102] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:32 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:33.015432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331207b-3181-40be-b793-f2424984e36b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:33.123762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331207b-3181-40be-b793-f2424984e36b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:33.156837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:33.157705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.157990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.158262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.159465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:33.161019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691a44e-2e11-486a-a2f7-63654bde38c2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:33.162794 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 51/103] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:33 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:33.168440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:33.208642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5df33-e014-4115-9785-69f38e4af370 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.208931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5df33-e014-4115-9785-69f38e4af370 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.209127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5df33-e014-4115-9785-69f38e4af370 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.211117 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 52/104] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:33.217666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.217954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.218239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.244360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:33.245591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:33.303206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e01e2c-31fa-4c77-a7ca-601fa049f2ce None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:33.337368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:33.338544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.338874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.339151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/f64244c630f04a95910fd2ccfc3fa177/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.341233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, user_id=f64244c630f04a95910fd2ccfc3fa177, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:33.342800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:33.359572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 53/105] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:33 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/f64244c630f04a95910fd2ccfc3fa177/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:33.365651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 53/106] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:33.407091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:33.527724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829cbf5-c8ad-424e-abdf-67c3ccd8b403 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:33.563931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:33.564817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.565101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.565379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.576893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:33.584629 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:33.586232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 54/107] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:33.592164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:33.749594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de078fe3-0fb9-4b60-ae42-5c532d3de81b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:33.791619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:33.792227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:33.792550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:33.792834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:33.793591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:33.793902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:33.795303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:33.808910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:33.814424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:33.963367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4158b0-ea10-415b-9250-9eaf023437f8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.007713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.008619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.008904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.009180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.010396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.011975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fdfd5-2bc9-457d-bd4f-589557c28fcc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:34.013922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 55/109] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:33 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:34.019256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.055248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65412-d15a-4847-a9a9-93d1fa6de74c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.055517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65412-d15a-4847-a9a9-93d1fa6de74c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.055739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65412-d15a-4847-a9a9-93d1fa6de74c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.057674 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 56/110] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:34.073033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b7e8-eada-42f9-9eb5-e24f901c4bc0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.073351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b7e8-eada-42f9-9eb5-e24f901c4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.073590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28b7e8-eada-42f9-9eb5-e24f901c4bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.098900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ab28b7e8-eada-42f9-9eb5-e24f901c4bc0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:34.100088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab28b7e8-eada-42f9-9eb5-e24f901c4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:34.165322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da2aa-c5da-4f27-a227-e99adbc38a9d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.171068 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 57/111] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:34.172309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e280-98d4-4db5-b5de-53aded5362ee None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.172560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e280-98d4-4db5-b5de-53aded5362ee None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.172841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e280-98d4-4db5-b5de-53aded5362ee None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.174604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 58/112] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:34.175529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107300-c967-4175-a028-89f3cf0fae5c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.175869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107300-c967-4175-a028-89f3cf0fae5c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.176682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107300-c967-4175-a028-89f3cf0fae5c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.178486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 59/113] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:34.179579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2305f-913f-4195-ae56-1d803f3e0dc0 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.179863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2305f-913f-4195-ae56-1d803f3e0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.180256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2305f-913f-4195-ae56-1d803f3e0dc0 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.186132 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 60/114] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:34.186132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc13ac6-c89e-4976-9e11-ccf715e0a6ea None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.186132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc13ac6-c89e-4976-9e11-ccf715e0a6ea None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.186132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc13ac6-c89e-4976-9e11-ccf715e0a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.206028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0fc13ac6-c89e-4976-9e11-ccf715e0a6ea None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:34.207228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0fc13ac6-c89e-4976-9e11-ccf715e0a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:34.217077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.217948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.218242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.218527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] PATH_INFO: `/v3/projects/ec475e586c78458d85baed50708791dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.219720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] RBAC: Authorizing `identity:get_project(project_id=ec475e586c78458d85baed50708791dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.221206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255c2b-e111-4863-bbd5-1b8541aa7311 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:34.223449 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 55/115] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/projects/ec475e586c78458d85baed50708791dc => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:34.224625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.224920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.225209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.241745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:34.242937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:34.279442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 61/116] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:34.280925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.281303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.281662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.297957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:34.299192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:34.319997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:34.321121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.368650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 62/118] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:34.369480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.419076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd44dd-6b00-406d-858b-ee0ffbd1e396 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.459537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.460342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.460665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.460949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.468101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459857c5-f3d7-4673-bf54-f3d5d470bac4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.471253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:34.478308 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:34.479659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 57/119] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:34.480263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.508343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.509270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.509560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.509844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] PATH_INFO: `/v3/projects/ec475e586c78458d85baed50708791dc/users/b5e0412457d94d2abe9a82b611f09230/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.511837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=ec475e586c78458d85baed50708791dc, user_id=b5e0412457d94d2abe9a82b611f09230, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.513315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:34.527487 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 63/120] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:34 2022] PUT /identity/v3/projects/ec475e586c78458d85baed50708791dc/users/b5e0412457d94d2abe9a82b611f09230/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:34.528369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.589522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29827534-63e0-4d59-a9a9-b94e7420ce32 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.626688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.628080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.629190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.629722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.643858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:34.652407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156fe1c-f52d-4240-a351-44bce16f2d0d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.652615 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:34.653796 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 58/121] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:34.654741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.690678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.692641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.693153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.693635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.705315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:34.713497 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:34.715028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 64/122] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:34.716021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.773591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f54fd-5fbf-4045-98cb-e2ede643150f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.817379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.818404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.818704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.818993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.820574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.822051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:34.824696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:34.825309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.844969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa289e-c0c9-4f96-a825-06f67adcfe6b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.893813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.894509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.895465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.895950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.896720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] RBAC: Adding query filter params (name=reader) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:34.897030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.898417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:34.907199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 65/124] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:34.912477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:34.946056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e679b-571a-4d06-9f3c-6ce2970d9dcf None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:34.991032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:34.992240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:34.992759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:34.993248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:34.994807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:34.995381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:34.997451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.010222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 60/125] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.015077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.037330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b260a-55a1-4efc-bfd2-c96a9985e17f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.072235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.072986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.073273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.073601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.074342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:35.074649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.076036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.084633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 66/126] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.085452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.137957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11908019-1e94-4e4f-b46f-d66ba70ee4a6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.177635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.178291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.178577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.178857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.179856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.181026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.209340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 61/127] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:35:35 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:35.216701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.217906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119a096-e685-4509-9629-5ed2a59c513b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.309513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.310460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.310752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.311030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] PATH_INFO: `/v3/users/bdb8b6e16ff044ab9a4bf98937a41456` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.342247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb8b6e16ff044ab9a4bf98937a41456)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.343757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.349833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 67/128] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/users/bdb8b6e16ff044ab9a4bf98937a41456 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.350734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.428948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9ed9-f6a8-4d7b-9230-97db10e4fab8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.468099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.469371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.469852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.470317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.471750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.473485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.475652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.480735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.489014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693ccb7-4832-4e65-bcd8-161b8f8cd4c3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.524940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.525523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.525809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.526089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.527577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.528912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.530931 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 68/130] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.531715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.585669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019eff-043b-4d9d-bca2-bedeac1596a7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.619906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.620939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.621445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.621932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.631841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9fa2-376c-4340-b681-838e1d1b4b97 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.666706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.667602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.667891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.668167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.669474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.670822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.672518 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 69/131] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.673334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.700349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.702174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.777594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de12f-6d7d-4204-8dc5-f2cd154f2c37 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.802841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:35.803979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.812648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.812912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.813159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.813432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.814615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.816081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.818707 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 70/133] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.823875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.915366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c5ac-8532-4b15-90ef-a68f14138d9e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.933648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28856d8e-2362-4150-90d2-b0c65c4e9c7a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:35.952137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.953407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.953893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.954365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/b5e0412457d94d2abe9a82b611f09230/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.956632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, user_id=b5e0412457d94d2abe9a82b611f09230, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.958841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.979785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:35.980681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:35.980963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:35.981236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:35.982428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:35.983893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:35.984735 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:35 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/b5e0412457d94d2abe9a82b611f09230/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:35.985592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 71/135] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:35.985941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:35.992922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:36.102958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3a87-d45a-4d5a-845c-e5421ae9b106 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:36.120950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93247-786e-42ec-9cd4-c35b0a45377e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:36.147066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:36.147749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:36.148174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:36.148354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:36.149216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=bdb8b6e16ff044ab9a4bf98937a41456) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:36.150012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:36.151771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d1f44-8398-4a76-8af4-1543f4fb2d2b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:36.160080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 72/136] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:35 2022] GET /identity/v3/role_assignments?user.id=bdb8b6e16ff044ab9a4bf98937a41456&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:36.168021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:36.169432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:36.169949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:36.170479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/b5e0412457d94d2abe9a82b611f09230/roles/274759295627427290199d61ae093512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:36.173186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, user_id=b5e0412457d94d2abe9a82b611f09230, role_id=274759295627427290199d61ae093512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:36.175025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67ccf5-ff3c-4c7e-b1a5-8045012541b2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:36.201036 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 65/137] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:35 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/b5e0412457d94d2abe9a82b611f09230/roles/274759295627427290199d61ae093512 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:36.486410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195da1-93d4-4786-9ecb-f646e6fa3f60 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:36.487066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195da1-93d4-4786-9ecb-f646e6fa3f60 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:36.487573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41195da1-93d4-4786-9ecb-f646e6fa3f60 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:36.490143 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 73/138] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:36.497903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:36.498783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:36.499274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:36.521803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:36.523003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:36.604954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 66/139] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:36.647094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41195da1-93d4-4786-9ecb-f646e6fa3f60 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:36.785304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41195da1-93d4-4786-9ecb-f646e6fa3f60 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:36.827127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:36.828285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:36.828809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:36.829279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:36.844061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:36.851419 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:36.852928 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 74/140] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:36.858849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:36.982795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e294f7-c1dd-48f6-b786-2b6a9a4e63f3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:37.017957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:37.018635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.018926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.019205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.020558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:37.020916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:37.022318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:37.030966 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 67/141] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:37.036375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.136015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0877682-70dc-4446-b67f-9929cae529e3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:37.169663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:37.170548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.170830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.171107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] PATH_INFO: `/v3/users/f64244c630f04a95910fd2ccfc3fa177` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.172291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] RBAC: Authorizing `identity:get_user(user_id=f64244c630f04a95910fd2ccfc3fa177)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:37.173789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db0bde-2f32-4665-8bae-f90d9d2dca93 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:37.175560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 75/142] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/users/f64244c630f04a95910fd2ccfc3fa177 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:37.181046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.279353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc20e6-8218-436e-ac74-b7c57164aa8a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:37.312661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:37.313248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.313538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.313821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.385524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:37.387003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:37.445707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8343-729b-4169-9a7b-9e8135e2082a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.446037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8343-729b-4169-9a7b-9e8135e2082a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.446284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8343-729b-4169-9a7b-9e8135e2082a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.448045 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 76/143] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:37.459823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.460117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.460402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.502083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:37.502083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:37.548872 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 68/144] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:37.556255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.642012 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 02 20:35:37.668358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23d34c-6cc7-493d-831d-81e178b561f9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:37.699198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.706776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:37.708204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.708512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.708795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.714736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:37.716224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:37.726279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 69/146] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:37.750464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.837017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598430b-55f0-4cac-8bba-1d41ff3d8ef5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:37.882819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:37.883641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:37.883932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:37.884217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:37.896626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:37.903991 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:37.905522 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 78/147] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:37.912396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:37.972166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c63b82-1869-4488-885c-dc475a85193a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.031345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.032570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.033038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.033897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.035670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=f64244c630f04a95910fd2ccfc3fa177) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:38.036292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.038166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:38.045414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 70/148] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/role_assignments?user.id=f64244c630f04a95910fd2ccfc3fa177&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:38.125056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9195e-e16b-4ed8-a1cb-91618a142fa7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.181577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.182188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.182475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.182755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.183513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:38.183823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.185274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:38.200441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 79/149] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:38.207429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:38.335736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe081-954c-4835-9486-e78234e85140 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.370639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.371872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.372358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.372887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.374295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.375932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:38.378202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 71/150] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:38 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:38.383500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:38.484833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42adb7-7d0d-46fd-bc63-877b1d791c40 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.518703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.519964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.520260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.520564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.592213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.593717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:38.693514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 80/151] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:35:38.699129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:38.802693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f20d-f759-474f-b5f4-7970d40e4ac7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.837040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.838224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.838560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.838844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] PATH_INFO: `/v3/projects/ec475e586c78458d85baed50708791dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.840049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] RBAC: Authorizing `identity:get_project(project_id=ec475e586c78458d85baed50708791dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.841544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698d336-b135-4024-81b1-93545073b7ee None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:38.843530 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 72/152] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:38 2022] GET /identity/v3/projects/ec475e586c78458d85baed50708791dc => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:38.849689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:38.955948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc22eb-5f47-4783-97ab-e7150f602f82 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:38.992120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:38.992825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:38.993180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:38.993401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:38.994231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=ec475e586c78458d85baed50708791dc, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:38.994553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:38.996016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc338ec6-7c8e-4189-b4dd-2520c6ab42ec None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:39.002259 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 81/153] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:38 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=ec475e586c78458d85baed50708791dc&role.id=7fae3e7cc044438ea145a155975c346d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:39.401483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839daca2-7f3b-4bcf-9088-711979f3fc0e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.401986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839daca2-7f3b-4bcf-9088-711979f3fc0e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.402382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839daca2-7f3b-4bcf-9088-711979f3fc0e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.404611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 73/154] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:39.412045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6682-5f80-466e-88da-8a9e5f5811f6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.412580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6682-5f80-466e-88da-8a9e5f5811f6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.413021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6682-5f80-466e-88da-8a9e5f5811f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.433182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a8da6682-5f80-466e-88da-8a9e5f5811f6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:39.434592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8da6682-5f80-466e-88da-8a9e5f5811f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:39.532641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca740-11fb-4b9c-8097-965502c6a354 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.533099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca740-11fb-4b9c-8097-965502c6a354 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.533480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca740-11fb-4b9c-8097-965502c6a354 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.534386 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 82/155] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:39.538843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 74/156] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:39.543737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397e30e-232b-4756-b956-228de186b1e9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.544226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397e30e-232b-4756-b956-228de186b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.544675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397e30e-232b-4756-b956-228de186b1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.563805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2397e30e-232b-4756-b956-228de186b1e9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:39.565235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2397e30e-232b-4756-b956-228de186b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:39.565870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca740-11fb-4b9c-8097-965502c6a354 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:39.640117 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 83/157] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:39.660727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a4f5-db49-4ee2-8acc-2145a516a4d6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.661223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a4f5-db49-4ee2-8acc-2145a516a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.661649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a4f5-db49-4ee2-8acc-2145a516a4d6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.664080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 84/158] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:39.669281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a4f5-db49-4ee2-8acc-2145a516a4d6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:39.697513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca740-11fb-4b9c-8097-965502c6a354 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:39.731651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:39.733153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.733439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.733719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.743597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:39.750720 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-8915ddeb-de99-4177-a845-3d59f67aec12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:39.752149 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 75/159] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:39.754196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.754486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.754769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.776035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:39.777249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:39.777433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a4f5-db49-4ee2-8acc-2145a516a4d6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:39.811563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:39.812358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.812691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.813027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.814275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:39.815975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:39.817603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 85/160] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:39.818160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:39.851246 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 76/161] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:39.852073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:39.921843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e761-13e0-4adc-b63d-c55683907097 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:39.946137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e5dd1-7220-454f-ad96-d3c821d973ac None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:39.955084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:39.955781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.956073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.956351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.957192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] RBAC: Adding query filter params (name=reader) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:39.957459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:39.958964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adcb81-b149-4feb-af30-2b9d5625684c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:39.966999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 86/162] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:39.969786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12786-9ace-4789-b9af-e4e3f17ddd95 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.970079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12786-9ace-4789-b9af-e4e3f17ddd95 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.970389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d12786-9ace-4789-b9af-e4e3f17ddd95 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.972494 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 87/163] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:39.973125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d12786-9ace-4789-b9af-e4e3f17ddd95 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:39.978798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:39.979471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:39.979758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:39.980035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:39.980773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:39.982221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.001787 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 77/164] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:39 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:40.002586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.090589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d12786-9ace-4789-b9af-e4e3f17ddd95 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.107054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe43a-4900-49ee-939b-7c8f07893b50 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.128263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.129668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.129933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.130209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.141331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:40.141795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.142797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.143083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.143358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] PATH_INFO: `/v3/users/bdb8b6e16ff044ab9a4bf98937a41456` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.144695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] RBAC: Authorizing `identity:get_user(user_id=bdb8b6e16ff044ab9a4bf98937a41456)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.146151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95cba3-0a85-4e9d-85c0-c96b8127752c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.152756 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 78/165] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/users/bdb8b6e16ff044ab9a4bf98937a41456 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.152953 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:40.153034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.153034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.153034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.153219 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 88/166] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:40.155708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.169914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:40.171306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:40.243260 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 79/167] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:40.244307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.264767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfbc88-f697-42ca-be5c-d88b71af5c67 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.311163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.312250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.312661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.313037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.314528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.316208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.318344 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 89/168] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.319076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.352684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26c5bb-a119-45b2-874e-c976e1374a68 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.388426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.389381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.389802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.390245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.391126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:40.391665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.393199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.401862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 80/169] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.402890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.446665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06449b-f1ab-4aea-ade2-30e38bcafb4b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.506441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.507178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.507550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.507883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.508592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b4d1-b024-44d2-976f-5915557b3c40 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.518974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:40.527267 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:40.528682 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 90/170] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:40.529590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.544864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.545866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.546212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.546558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/bdb8b6e16ff044ab9a4bf98937a41456/roles/d13d017f3e5f4482ad4603250d31e10d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.548673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, user_id=bdb8b6e16ff044ab9a4bf98937a41456, role_id=d13d017f3e5f4482ad4603250d31e10d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.550201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.570791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 81/171] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:40 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/users/bdb8b6e16ff044ab9a4bf98937a41456/roles/d13d017f3e5f4482ad4603250d31e10d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:40.572268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.637635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8d01d-9c34-4e1b-bf2d-971eb6ae3502 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.678161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.679034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.679317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.679593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.680817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.682323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.684235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 91/172] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.690013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.699788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631d35-99dd-4a3e-ae55-49c20d408bb9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.737341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.738616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.740482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.740482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.740482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:40.740482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.741941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.750976 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 82/173] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.757298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:40.798760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340c9c-774d-429d-b37e-1f3c41731e9c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.833572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.834229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.834509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.834786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.904829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.906337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.915552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f41a6f-a723-4374-b553-f352e4d61de5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:40.971021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:40.971902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:40.972185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:40.973044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] PATH_INFO: `/v3/users/b5e0412457d94d2abe9a82b611f09230` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:40.974272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e0412457d94d2abe9a82b611f09230)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:40.975746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:40.977427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 83/174] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/users/b5e0412457d94d2abe9a82b611f09230 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:40.982951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:41.015930 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 92/175] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:35:41.021336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:41.094566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c50b9-4738-48d9-8559-9c40da1885d7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:41.127823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:41.128997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:41.129310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:41.129584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:41.133672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5852b47-c292-478c-beaa-819e65bb888a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:41.182139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:41.183014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:41.183300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:41.183578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:41.189182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:41.190649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:41.192604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 93/176] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:41 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:41.201735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:41.203254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:41.212977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:41.303666 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 84/177] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:41.309430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:41.418607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2915-bfc9-4039-be66-a03badbfd688 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:41.419477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c4b3-91e5-4b2c-9984-e2da87cab9b7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:41.457730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:41.458643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:41.458927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:41.459197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:41.460401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:41.461871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:41.464423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 85/178] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:41 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:41.470077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:41.500400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:41.501114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:41.501404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:41.501687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:41.502519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:41.502838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:41.504346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc94a4-0e2a-4982-b5f0-e5dcec98f2b9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:41.515822 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 94/179] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:41 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=7fae3e7cc044438ea145a155975c346d => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:41.612075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da250a-9b64-41b4-a836-e9d2c0e28b90 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:41.663543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:41.664612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:41.665146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:41.665622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:41.666676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=b5e0412457d94d2abe9a82b611f09230) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:41.667209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:41.668920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387064f5-0342-4d5d-8632-c8935a67d088 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:41.675747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 86/180] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:41 2022] GET /identity/v3/role_assignments?user.id=b5e0412457d94d2abe9a82b611f09230&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=274759295627427290199d61ae093512 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:43.137862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfa46-0d71-4116-b6fa-8ef206eb0cd5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.138427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfa46-0d71-4116-b6fa-8ef206eb0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.138427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbfa46-0d71-4116-b6fa-8ef206eb0cd5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.140210 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 95/181] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:43.147085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.147546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.147653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.165219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:43.166415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:43.187500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10851d-10e2-4ad3-a9ec-a1ead056c256 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.187837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10851d-10e2-4ad3-a9ec-a1ead056c256 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.188082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10851d-10e2-4ad3-a9ec-a1ead056c256 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.190280 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 96/182] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:43.197449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.197736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.198019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.216257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:43.217504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:43.239128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 87/183] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:43.264971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.289605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 97/184] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:43.313743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.367231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1053f-4db9-4e10-a877-f81de838d472 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.400917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.402032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.402488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.402943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.413792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f33bc3-377d-4afd-a108-db59e6ddf28e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.414273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:43.421750 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:43.423484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 88/185] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:43.429532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.452257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.453116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.453398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.453673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.466991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:43.477006 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:43.478784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 98/186] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:43.483975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.550958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7729579-d7aa-4d80-85d5-d878f9924df2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.585670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.586234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee777c-d05c-4169-a3a3-df9db8165059 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.586342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.586616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.586895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.587900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:43.588212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:43.589719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bf5ef-5ca4-45b4-a590-8321bfe07094 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:43.604046 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 89/187] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:43.605921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138283f-d844-47bd-99c1-6794266ba552 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.606216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138283f-d844-47bd-99c1-6794266ba552 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.606526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138283f-d844-47bd-99c1-6794266ba552 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.612807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 90/188] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:43.612807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138283f-d844-47bd-99c1-6794266ba552 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.625939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.626615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.626902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.627182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.627930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:43.628289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:43.629704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32514a7-1924-4bec-a8cb-cd478871c009 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:43.638756 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 99/189] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:43.642417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.642704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.643632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.660627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:43.661737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:43.710467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138283f-d844-47bd-99c1-6794266ba552 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.724206 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 100/190] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:43.724904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.743434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.744909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.745315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.745609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.764600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:43.766061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d01f-a46e-4b96-ad9e-d18c45a64995 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:43.767772 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 91/191] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:43.769541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673f8-2971-4fd6-8ee3-e4c22587cc42 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.769819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673f8-2971-4fd6-8ee3-e4c22587cc42 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.770092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673f8-2971-4fd6-8ee3-e4c22587cc42 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.771907 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 92/192] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:43.772405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51673f8-2971-4fd6-8ee3-e4c22587cc42 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.823183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeee6a-82b2-46ce-8ac0-48c7d3973fb8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.854965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.855824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.856109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.856385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.857592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:43.859032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:43.865261 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 101/193] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:43.865261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:43.866442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51673f8-2971-4fd6-8ee3-e4c22587cc42 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.903998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:43.905381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.905675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.905957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.916674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:43.923625 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-199a2fcb-ee64-4393-98b2-85e6c71c922b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:43.924852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 93/194] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:43.926567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:43.926854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:43.927140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:43.943527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:43.944739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:43.966257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab58d2-d9ea-4345-b08d-f1b2d9770579 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:43.999512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.000161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.000447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.000762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.008196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:44.013023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.064740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.066828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.105376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0719c43-194b-435c-b79b-2f731daddfca None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.137524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.138165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.138448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.138725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.159044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 102/196] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:44.160389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.203141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.204742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.262095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244b83-d272-426d-9619-d548b86af81e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.295043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.295704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.295979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.296251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.297071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] RBAC: Adding query filter params (name=reader) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:44.297373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.298836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.304051 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 95/197] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:44.304920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.306582 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 103/198] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.307367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.396808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca608-f635-40e7-bd4a-b390e9dfce6d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.399835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8962-32e4-4c89-9a4c-129fec7a0cae None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.428620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.429409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.429700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.429975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.431128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.431241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.431973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.432258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.432563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.432653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.433722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.434175 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 96/199] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.434929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.435153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.437017 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 104/200] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.442423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.537202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5446-08c5-4be8-856d-d41cf3fa4258 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.541996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da4f4-c149-4974-a8e0-1d7ff0796c66 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.569778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.570630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.570904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.571173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.572329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.573804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.574661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.575475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 97/201] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.576202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.580221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.580575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.580869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] PATH_INFO: `/v3/users/bdb8b6e16ff044ab9a4bf98937a41456` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.582111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb8b6e16ff044ab9a4bf98937a41456)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.583547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.585259 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 105/202] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/users/bdb8b6e16ff044ab9a4bf98937a41456 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.586018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.670096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b29140-0a08-49d9-9f44-270b327defce None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.679670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7195df-50b9-4db0-a243-f6e228e42871 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.701919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.702582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.702868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.703147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.703906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.705347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.710165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.710808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.711089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.711360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.712161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=dd6c9fd180784d56afd65ef9d28f33f5) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:44.712736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.714818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.720442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 106/203] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/role_assignments?user.id=dd6c9fd180784d56afd65ef9d28f33f5&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=274759295627427290199d61ae093512 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.721236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.726202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 98/204] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:44 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:44.727065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:44.848924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1259a7-9ac1-456a-9509-526c69f71f1e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.856820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade62ee8-f8ff-4d09-8469-b7e6dcd177a9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:44.894005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.894753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.895043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.895326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.896211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=dd6c9fd180784d56afd65ef9d28f33f5) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:44.896544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.898066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:44.901852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:44.902861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:44.903347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:44.903814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:44.904740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 107/205] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/role_assignments?user.id=dd6c9fd180784d56afd65ef9d28f33f5&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:44.983077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:44.984541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:45.098425 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 99/206] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:45.104033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:45.212015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809c14-26f6-4450-8693-b03e5eae0881 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:45.257155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:45.257958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:45.258245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:45.258524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:45.260577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:45.262042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77b681-1380-43af-a0ec-f00369c83318 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:45.263979 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 108/207] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:45 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:45.270434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:45.372448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ee45-39a4-4a7a-ab39-7f6409116ab5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:45.407985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:45.408997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:45.410039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:45.410506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:45.411525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3, user.id=bdb8b6e16ff044ab9a4bf98937a41456) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:45.412042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:45.413697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e233e-c6a2-433a-a6b3-d55f98a7db8e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:45.419929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 100/208] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:45 2022] GET /identity/v3/role_assignments?user.id=bdb8b6e16ff044ab9a4bf98937a41456&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:47.252287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9ca8-5a4b-4921-95e6-af9bf552ac68 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.252859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9ca8-5a4b-4921-95e6-af9bf552ac68 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.252935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd9ca8-5a4b-4921-95e6-af9bf552ac68 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.254954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 109/209] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:47.261730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27717e-6295-4378-9e3c-10d68de29bea None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.262185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27717e-6295-4378-9e3c-10d68de29bea None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.262357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27717e-6295-4378-9e3c-10d68de29bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.279981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ef27717e-6295-4378-9e3c-10d68de29bea None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:47.281206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ef27717e-6295-4378-9e3c-10d68de29bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:47.349518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 101/210] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:47.373096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9ca8-5a4b-4921-95e6-af9bf552ac68 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.378834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ea67-7a56-4e9e-a3cb-8fdc00daa207 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.379470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ea67-7a56-4e9e-a3cb-8fdc00daa207 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.379949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ea67-7a56-4e9e-a3cb-8fdc00daa207 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.382432 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 102/211] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:47.389146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.389709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.390176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.407069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:47.408530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:47.486092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 103/212] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:47.498048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd9ca8-5a4b-4921-95e6-af9bf552ac68 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:47.511468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.536810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:47.537876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.538168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.538451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.551326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:47.559553 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-817fdcc2-b32a-4e81-ab63-54825da1f8e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:47.560927 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 110/213] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:47.561995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d54d-0c39-4be1-96f3-1c7b50c6526a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.562284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d54d-0c39-4be1-96f3-1c7b50c6526a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.562565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d54d-0c39-4be1-96f3-1c7b50c6526a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.564392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 111/214] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:47.570957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d54d-0c39-4be1-96f3-1c7b50c6526a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.615235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6de4c-f2d1-4a9c-bf15-6bfd6c6c39c4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:47.646695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:47.647476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.647756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.648026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.657601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:47.664955 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-84598302-352d-4908-b9f4-c35eeb94f0b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:47.666137 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 104/215] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:47.667267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.667544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.667822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.672147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d54d-0c39-4be1-96f3-1c7b50c6526a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:47.684653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:47.685821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:47.704429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:47.705119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.705403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.705680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.706459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:47.706763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:47.708124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f558a-f0bb-4613-a2f0-05e430835a06 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:47.715860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 112/216] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:47.717346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c409-1638-47b5-9587-89660c14e880 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.717638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c409-1638-47b5-9587-89660c14e880 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.717919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4c409-1638-47b5-9587-89660c14e880 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.719542 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 113/217] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:47.720332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4c409-1638-47b5-9587-89660c14e880 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.753975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 105/218] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:47.754874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.818504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4c409-1638-47b5-9587-89660c14e880 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:47.846786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef39cd-ecc9-4f64-9e0d-ff03ba4f4249 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:47.850744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:47.851412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.851700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.851980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.852749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:47.853061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:47.854436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4c043-989a-4dfc-a31d-af6c3779eade None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:47.863158 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 114/219] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:47.864318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.864642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.864923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.879598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:47.880476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:47.880774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:47.881068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:47.881849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:47.882314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:47.883018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:47.883747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:47.890181 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 106/220] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:47.890181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.946061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 115/221] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:47.946927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:47.992102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57612e28-f454-4bff-8a36-149d188553f7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.023807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.024633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.024917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.025190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.034851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:48.041175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3af39-3026-4649-ac66-a261eb9be4bb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.041864 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:48.043218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 107/222] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:48.043903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.073835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.074624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.074904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.075176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.076333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.077801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.079395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 116/223] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:47 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.080129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.138118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2577952-4699-4b3c-a27f-1a186943067f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.169613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.170455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.170733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.171002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.171521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bcbe0-c12c-46d0-a074-a3351394c193 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.172260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.173794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.175501 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 108/224] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.176261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.203555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.204340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.204667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.204946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.206104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.208029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.209799 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 117/225] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.210475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.268040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7a31c-84d8-4822-85fd-7bbdc8f91f28 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.299442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.300113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.300396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.300704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.301447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:48.301701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6114b4-2545-4e0c-8347-3bd4e30b47ef None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.302099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.303110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.310826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 109/226] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.311653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.334715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.335500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.335780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.336047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.337234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.338922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.340599 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 118/227] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.341328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.407887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016afea0-83c3-4008-bb79-b13ea954801f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.436109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8a785-f9f1-42af-a7d7-3091f2ac0b2c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.442255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.443190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.443482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.443762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/users/dd6c9fd180784d56afd65ef9d28f33f5/roles/274759295627427290199d61ae093512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.446074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, user_id=dd6c9fd180784d56afd65ef9d28f33f5, role_id=274759295627427290199d61ae093512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.447531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.460488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 110/228] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:48 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/users/dd6c9fd180784d56afd65ef9d28f33f5/roles/274759295627427290199d61ae093512 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:48.461475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.475916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.476641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.476932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.477214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.477944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.479453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.507642 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 119/229] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:48 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:48.508359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.587082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf863a4-de36-40b2-95eb-27e8f4c08ddc None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.626736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66d7d4-259d-4873-89a8-70c8b580a75a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.633342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.634731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.635224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.635699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] PATH_INFO: `/v3/users/e9956cb40cbb421aaeb1742ad492779a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.653069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] RBAC: Authorizing `identity:get_user(user_id=e9956cb40cbb421aaeb1742ad492779a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.654945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.657218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 111/230] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/users/e9956cb40cbb421aaeb1742ad492779a => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:48.669602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:48.672522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.673498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.673840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.674141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/users/dd6c9fd180784d56afd65ef9d28f33f5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.676766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, user_id=dd6c9fd180784d56afd65ef9d28f33f5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.678314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:48.694751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 120/231] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:48 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/users/dd6c9fd180784d56afd65ef9d28f33f5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:48.787695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935decf5-8ed9-4d4e-884d-fa4fd5ce6a5b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:48.826615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:48.827301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:48.827640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:48.827925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:48.903226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:48.904739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:49.011027 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 112/232] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:49.019326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:49.124277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b156170-ef34-440f-a99b-180cad01b759 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:49.163869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:49.165042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:49.165561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:49.166030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:49.167389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:49.169049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af126b-85ca-4ea9-946c-70d6f849c84c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:49.170945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 121/233] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:49 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:49.176846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:49.285427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8cfe0-a8d6-44b7-94ef-5b2b5d667271 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:49.331055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:49.333220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:49.334000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:49.334593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:49.335636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=e9956cb40cbb421aaeb1742ad492779a) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:49.336130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:49.338095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107066a6-2630-4a04-a6d3-617d5c2b5fc5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:49.344427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 113/234] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:49 2022] GET /identity/v3/role_assignments?user.id=e9956cb40cbb421aaeb1742ad492779a&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=7fae3e7cc044438ea145a155975c346d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:51.282152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822019-02a1-416d-b091-b160eda2b477 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.282738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822019-02a1-416d-b091-b160eda2b477 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.282738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f822019-02a1-416d-b091-b160eda2b477 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.284967 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 122/235] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:51.309247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.309755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.309854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.333734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:51.334952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:51.423069 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 114/236] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:51.474606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f822019-02a1-416d-b091-b160eda2b477 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:51.609225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f822019-02a1-416d-b091-b160eda2b477 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:51.653218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:51.654045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.654335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.654613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.669319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:51.677294 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-b6b153b5-c126-4161-b934-ac8b288da807 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:35:51.683036 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 123/237] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:35:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:51.684224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:51.699844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b5a0-605b-4ba4-a76a-438720747df5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.700139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b5a0-605b-4ba4-a76a-438720747df5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.700805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b5a0-605b-4ba4-a76a-438720747df5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.702502 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 124/238] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:51.715506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54821b7-17d9-4ad7-847e-c42676467140 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.715793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54821b7-17d9-4ad7-847e-c42676467140 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.716078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54821b7-17d9-4ad7-847e-c42676467140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.737311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f54821b7-17d9-4ad7-847e-c42676467140 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:51.738814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f54821b7-17d9-4ad7-847e-c42676467140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:51.797609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3049f-d154-4bd0-b87d-9a7e1d58acb1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 125/239] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6f9-f196-4f17-8f6e-4a20e8465bcf None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6f9-f196-4f17-8f6e-4a20e8465bcf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebd6f9-f196-4f17-8f6e-4a20e8465bcf None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 126/240] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f039-259d-42c3-9427-6e976c2e0625 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.812476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f039-259d-42c3-9427-6e976c2e0625 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.812982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f039-259d-42c3-9427-6e976c2e0625 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.818384 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 127/241] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:51.819678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.819966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.820243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.832031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:51.832731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.833017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.833292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.834039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:51.834344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:51.835736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dd7c7-f879-4c6c-93e0-b46b76e8d9a9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:51.837975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:51.839162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:51.844625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 115/242] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:51.845839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6b85-e723-4292-a909-d00839506580 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:51.846270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6b85-e723-4292-a909-d00839506580 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:51.846388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6b85-e723-4292-a909-d00839506580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:51.863202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bcae6b85-e723-4292-a909-d00839506580 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:51.864410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bcae6b85-e723-4292-a909-d00839506580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:51.910346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 128/243] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:51.911195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:51.934115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 116/244] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:51.935537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6b85-e723-4292-a909-d00839506580 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.011878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474542fc-a4fe-42e3-803c-5a6de0db5684 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.036612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6b85-e723-4292-a909-d00839506580 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.046346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.047165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.047452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.047730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.058917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:52.066560 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:52.068007 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 129/245] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:52.068654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.075578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.076500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.076785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.077060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.078242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.079696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.081574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 117/246] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:51 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.086564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.168022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce643f1e-3c48-454e-9c70-e915734f3304 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.182304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f833-20a0-48a2-8fba-8063110ed425 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.201721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.202544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.202825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.203119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.204272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.205764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.207432 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 130/247] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.208181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.216253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.217075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.217359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.217634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.228217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:52.235415 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:35:52.236744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 118/248] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:52.237661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.317179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805528ee-79fa-4dc0-a4b1-208c95c433ae None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.342174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c8396-3f66-4194-a401-d5ff6efb21b5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.349321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.349986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.350268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.350538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.351273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:52.351578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.352986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.361004 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 131/249] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.362059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.381439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.382092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.382377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.382661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.446857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.448244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.458916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ce5e0-d29b-49dc-ad47-6a7fb107c9f6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.490621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.491279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.491560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.491835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.492552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.494001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.511816 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 132/250] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:52 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:52.511816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.549223 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 119/251] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:52.550425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.633467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0cbd5-ac03-49e4-8e8b-c56df954d758 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.672056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.672804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.673093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.673372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.674160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:52.674473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.676433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a075-5921-40e2-9997-34ea98955cab None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.686099 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 133/252] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.687450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd84c-cbab-446f-a87f-d3ce58815b95 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.687744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd84c-cbab-446f-a87f-d3ce58815b95 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.688025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cd84c-cbab-446f-a87f-d3ce58815b95 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.689824 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 134/253] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:52.696855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cd84c-cbab-446f-a87f-d3ce58815b95 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.777517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e564f4-1c28-4223-8000-888e98967bf6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.801248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cd84c-cbab-446f-a87f-d3ce58815b95 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.812713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.813594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.813876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.814150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] PATH_INFO: `/v3/users/f968a21a239e48f8b706421b0649304b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.828243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] RBAC: Authorizing `identity:get_user(user_id=f968a21a239e48f8b706421b0649304b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.832413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.832413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 120/254] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/users/f968a21a239e48f8b706421b0649304b => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.832413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.835506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.836555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.836846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.837371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.838709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.840278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99831-ce6e-448e-ae59-c361dca2be84 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.842168 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 135/255] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.843535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.843832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.844107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.863018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:52.864314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:52.937957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b15eb-2917-4e27-8f14-9c104b1b4e64 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:52.940592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 136/256] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:52.941582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:52.974596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:52.975500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:52.975786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:52.976064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] PATH_INFO: `/v3/users/dd6c9fd180784d56afd65ef9d28f33f5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:52.977351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] RBAC: Authorizing `identity:get_user(user_id=dd6c9fd180784d56afd65ef9d28f33f5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:52.978822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:52.980641 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 121/257] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/users/dd6c9fd180784d56afd65ef9d28f33f5 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:52.981413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.044968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f4e0b-89e7-4bc5-a5fd-e473f4d865ac None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.081587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3522c3f-fd8c-4e27-a68e-c8b5a445087a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.081919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.082514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.082807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.083086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.117576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.118249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.118535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.118859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.119736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=dd6c9fd180784d56afd65ef9d28f33f5) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:53.120055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.121584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.128467 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 122/258] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/role_assignments?user.id=dd6c9fd180784d56afd65ef9d28f33f5&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=274759295627427290199d61ae093512 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:53.129294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.163011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.164752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.275624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465113-36ef-4cb5-9e98-ceb59bdc59d0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.351509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.352285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.352541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.352827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.366974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 137/259] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:53.367682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.376782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:53.391840 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:53.394177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 123/260] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:53.395073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.481370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8eff9-2aa2-462d-b95f-9740d945d4f1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.517106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.517774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.518062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.518343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.562055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e375de-b70e-4555-9a6c-4a9e164fa081 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.590430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.594207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.620753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.622035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.622604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.623266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.624898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.626378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.629002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 124/261] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:53.629802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.724576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 138/262] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:35:53.725330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.748483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cb95-5713-4385-ba2f-05e30b76ed40 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.784084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.784853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.785140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.785422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.786168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:53.786476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.787977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.796954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 125/263] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:53.798651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.828970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8a967-3db3-40e7-b1b6-8c4a69da5933 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.865971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.866644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.866924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.867198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.868027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=f968a21a239e48f8b706421b0649304b) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:53.868338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.869858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.875776 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 139/264] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/role_assignments?user.id=f968a21a239e48f8b706421b0649304b&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:53.876419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:53.903268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09790a-a468-4da2-8b64-b7b9dba08006 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:53.942854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:53.943739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:53.944028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:53.944312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:53.945685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:53.947239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:53.949406 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 126/265] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:53.955121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:54.000659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f173-9947-4af0-ad44-659fd3fb2e0c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:54.039086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:54.039983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:54.040262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:54.040621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] PATH_INFO: `/v3/users/e9956cb40cbb421aaeb1742ad492779a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:54.041895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] RBAC: Authorizing `identity:get_user(user_id=e9956cb40cbb421aaeb1742ad492779a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:54.043397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:54.048604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 140/266] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/users/e9956cb40cbb421aaeb1742ad492779a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:54.051226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:54.083841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2979b2-bd3e-4642-b975-d9f60e2a10b4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:54.132484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:54.134093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:54.134378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:54.139331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:54.140253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=dd6c9fd180784d56afd65ef9d28f33f5) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:54.142520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:54.145964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:54.156047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 127/267] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:53 2022] GET /identity/v3/role_assignments?user.id=dd6c9fd180784d56afd65ef9d28f33f5&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:54.172081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5763e-6b75-4625-82fb-84ca6e0b8af5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:54.225602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:54.226850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:54.227329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:54.227820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:54.229318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:54.230993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a0c5d-3575-43d2-8039-76b4338be3fe None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:54.233032 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 141/268] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:54 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:54.239087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:54.345200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74b3b2-e449-41fa-9df9-21cc895492d9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:54.380095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:54.382007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:54.382607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:54.383078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/users/e9956cb40cbb421aaeb1742ad492779a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:54.385418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, user_id=e9956cb40cbb421aaeb1742ad492779a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:54.387108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeec08-1624-4a6a-b75a-08396918df73 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:54.408799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 128/269] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:54 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/users/e9956cb40cbb421aaeb1742ad492779a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:35:55.268033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf66f-2044-449a-83fb-aa9449baf130 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.268618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf66f-2044-449a-83fb-aa9449baf130 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.268693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf66f-2044-449a-83fb-aa9449baf130 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.272505 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 142/270] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:55.279475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b26c3-c435-4bdf-a4ba-69800ca6b9cd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.279767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b26c3-c435-4bdf-a4ba-69800ca6b9cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.280054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b26c3-c435-4bdf-a4ba-69800ca6b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.297745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c99b26c3-c435-4bdf-a4ba-69800ca6b9cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:55.298948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c99b26c3-c435-4bdf-a4ba-69800ca6b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:55.372721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 129/271] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:55.377526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777077-26fa-449d-bdca-dca68c2912e1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.378692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777077-26fa-449d-bdca-dca68c2912e1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.379180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777077-26fa-449d-bdca-dca68c2912e1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.381601 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 143/272] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:55.389003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8801-7490-4785-901e-698e190adc41 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.389958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8801-7490-4785-901e-698e190adc41 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.390246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8801-7490-4785-901e-698e190adc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.392093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777077-26fa-449d-bdca-dca68c2912e1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:55.408836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-74cc8801-7490-4785-901e-698e190adc41 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:55.410553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74cc8801-7490-4785-901e-698e190adc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:55.479570 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 130/273] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:55.505915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8801-7490-4785-901e-698e190adc41 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:55.508707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777077-26fa-449d-bdca-dca68c2912e1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:55.542382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:55.543321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.543678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.544020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.554746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:55.561889 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:55.563153 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 144/274] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:55.569062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:55.606455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8801-7490-4785-901e-698e190adc41 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:55.641495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:55.642561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.642992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.643933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.645295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:55.646924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:55.653383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 131/275] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:55.654384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:55.670398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b67cf-885d-40f3-ac9c-2d521a85949f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:55.707758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:55.708711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.709204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.709658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.710580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:55.711068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:55.713192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:55.724277 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 145/276] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:55.730482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:55.760851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45941bb8-a87e-47e1-86ba-5d88a534de42 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:55.794934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:55.795528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.795814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.796095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.796850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:55.798304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:55.821495 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 132/277] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:35:55 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:55.841890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f663182-3fa0-4c36-a199-8280f5dad43c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:55.881124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:55.882027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:55.882478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:55.882762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] PATH_INFO: `/v3/users/64cc251e708c44f9b51dd4bc673bcd8f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:55.899416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] RBAC: Authorizing `identity:get_user(user_id=64cc251e708c44f9b51dd4bc673bcd8f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:55.901071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ad29-4485-46d7-a2a0-acde66e6f848 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:55.907898 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 146/278] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:55 2022] GET /identity/v3/users/64cc251e708c44f9b51dd4bc673bcd8f => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:55.909898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:56.026727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9901a-cf87-4da9-8329-fde48932f358 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:56.062527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:56.063102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:56.063392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:56.063691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:56.064585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, user.id=64cc251e708c44f9b51dd4bc673bcd8f, scope.system=all) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:56.064887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:56.066997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e92504-40b0-4d6f-affe-d63bec6619c1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:56.072383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 133/279] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Apr 2 20:35:55 2022] GET /identity/v3/role_assignments?user.id=64cc251e708c44f9b51dd4bc673bcd8f&scope.system=all&role.id=7fae3e7cc044438ea145a155975c346d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:56.596319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df8d13-9549-422f-b6b2-1774c286d4d6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:56.598025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df8d13-9549-422f-b6b2-1774c286d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:56.598516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df8d13-9549-422f-b6b2-1774c286d4d6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:56.601036 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 147/280] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:56.607582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:56.608522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:56.609030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:56.627434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:56.633730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:56.719643 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 134/281] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:56.761007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df8d13-9549-422f-b6b2-1774c286d4d6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:56.879686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df8d13-9549-422f-b6b2-1774c286d4d6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:56.913786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:56.914914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:56.915396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:56.915870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:56.926615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:56.934020 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:56.935782 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 148/282] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:56.941807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.103086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c3590-03df-4572-b1a0-5937351e5a00 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.148720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.149396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.149687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.149971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.150721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:57.151031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.152411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d514a-0a02-4ee6-812e-06c84b086c81 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.164096 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 135/283] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:57.169651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.193498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29bfde-cf00-4cd8-b1bb-2b8763940c0e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.193825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29bfde-cf00-4cd8-b1bb-2b8763940c0e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.194127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29bfde-cf00-4cd8-b1bb-2b8763940c0e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.196128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 136/284] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:57.203020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.203304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.203599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.234302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:57.235494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:57.331646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ee4a6-65e4-44bd-9912-a37fdee450c4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.368594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.368803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 137/285] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:57.373733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.374017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.374300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] PATH_INFO: `/v3/users/f968a21a239e48f8b706421b0649304b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.375724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] RBAC: Authorizing `identity:get_user(user_id=f968a21a239e48f8b706421b0649304b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.377251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.380556 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 149/286] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/users/f968a21a239e48f8b706421b0649304b => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:57.385112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.399831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.521656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7889b3-7846-4196-9165-acd3a118a3fa None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.558387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.559199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.559487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.559767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.570855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:57.571749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b376-2d24-4099-9749-1d9bbdc4dea1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.577951 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:57.579323 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 150/287] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:35:57.585213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.658081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.659484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.659764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.660034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.665182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.666648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.668667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 138/288] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:57.673730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.690308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666292-f371-4a44-9a3d-1e963497cec1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.727416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.728100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.728388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.728695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.729505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:57.729812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.731420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.740747 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 151/289] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:57.746150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.856037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3dbfb-566d-4cb3-86da-4ced48efa8d2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.882932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559dde2-5dd7-4d81-ae91-78f5a6af3cb9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:57.889130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.890007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.890287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.890560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] PATH_INFO: `/v3/users/e9956cb40cbb421aaeb1742ad492779a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.891742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] RBAC: Authorizing `identity:get_user(user_id=e9956cb40cbb421aaeb1742ad492779a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.893779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.899913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 152/290] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/users/e9956cb40cbb421aaeb1742ad492779a => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:57.901164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:57.957774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:57.958592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:57.958926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:57.959200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/users/f968a21a239e48f8b706421b0649304b/roles/d13d017f3e5f4482ad4603250d31e10d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:57.965712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, user_id=f968a21a239e48f8b706421b0649304b, role_id=d13d017f3e5f4482ad4603250d31e10d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:57.967212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:57.995733 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 139/291] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:35:57 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/users/f968a21a239e48f8b706421b0649304b/roles/d13d017f3e5f4482ad4603250d31e10d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:35:58.004147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad2ab7-89ff-4ab9-84cd-a7b1866ace9c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:58.040753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:58.041431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:58.041720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:58.042000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:58.113811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:58.115510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:58.240722 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 153/292] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:35:58.242045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:58.348279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cd703-3f72-4e7f-b621-3c4e85624b00 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:58.382098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71572aea-a115-4659-b2de-1c147595627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:58.382979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572aea-a115-4659-b2de-1c147595627f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:58.383258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572aea-a115-4659-b2de-1c147595627f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:58.383533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71572aea-a115-4659-b2de-1c147595627f None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:58.384752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71572aea-a115-4659-b2de-1c147595627f None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:58.386204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71572aea-a115-4659-b2de-1c147595627f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:58.392558 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 140/293] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:35:58 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:58.394228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:58.508093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02123eea-67da-431d-b53a-ecb4be647d34 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:58.543152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:58.543825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:58.544112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:58.544393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:58.545249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=e9956cb40cbb421aaeb1742ad492779a) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:58.545563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:58.547179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5997e-704f-4849-940e-dcfa4766349a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:58.556967 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 154/294] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:35:58 2022] GET /identity/v3/role_assignments?user.id=e9956cb40cbb421aaeb1742ad492779a&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=7fae3e7cc044438ea145a155975c346d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:58.714027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a1c-6a3c-41f4-bba5-f4617efed283 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:58.714770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a1c-6a3c-41f4-bba5-f4617efed283 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:58.714770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a1c-6a3c-41f4-bba5-f4617efed283 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:58.717058 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 141/295] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:58.723748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:58.724742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:58.725248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:58.748572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:58.750120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:58.840613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 155/296] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:35:58.865971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1a1c-6a3c-41f4-bba5-f4617efed283 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:58.975923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1a1c-6a3c-41f4-bba5-f4617efed283 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.017315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.018161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.018475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.018754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.029915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:59.037756 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-689dbbc7-6769-4036-8ede-0e8b6aa78785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:35:59.038960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 142/297] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:59.044842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.140187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f220-2a6c-4466-8b92-05b9db5e19e4 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.140531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f220-2a6c-4466-8b92-05b9db5e19e4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.140840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849f220-2a6c-4466-8b92-05b9db5e19e4 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.142739 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 143/298] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:35:59.151276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4e8e0-bfbe-4cae-a3b8-5eb236c96d6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.151904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93397-fcb5-4a46-9e7c-dfdd1d9da0de None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.151904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93397-fcb5-4a46-9e7c-dfdd1d9da0de None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.151904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea93397-fcb5-4a46-9e7c-dfdd1d9da0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.167810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1ea93397-fcb5-4a46-9e7c-dfdd1d9da0de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:59.169329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ea93397-fcb5-4a46-9e7c-dfdd1d9da0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:59.183109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.183877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.184163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.184438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.185204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:59.185505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.186896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.196488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 156/299] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:59.201694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.252647 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 144/300] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:59.254401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd13-5f3b-430c-ae87-48f8d1374643 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.254693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd13-5f3b-430c-ae87-48f8d1374643 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.254976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd13-5f3b-430c-ae87-48f8d1374643 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.257709 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 145/301] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:35:59.266960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.267464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.267752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.285505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:35:59.286671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:35:59.315927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a676a6-0b09-4dae-817a-cf93adb0a826 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.351566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.352438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.352755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.353033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] PATH_INFO: `/v3/users/64cc251e708c44f9b51dd4bc673bcd8f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.353573 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 146/302] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:35:59.354754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.365282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=64cc251e708c44f9b51dd4bc673bcd8f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.367541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.374793 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 157/303] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/users/64cc251e708c44f9b51dd4bc673bcd8f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:59.375945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.464182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4607a6-9f84-4e36-95fc-5e909338bbcc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.478559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17874d-1752-4b40-9329-c71b9e072ff3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.500740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.501539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.501823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.502097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.503879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.506036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.513112 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 147/304] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:35:59.513112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.520073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.521332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.521615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.522196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] PATH_INFO: `/v3/system/users/64cc251e708c44f9b51dd4bc673bcd8f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.523819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=64cc251e708c44f9b51dd4bc673bcd8f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.525278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.536145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 158/305] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Apr 2 20:35:59 2022] PUT /identity/v3/system/users/64cc251e708c44f9b51dd4bc673bcd8f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:35:59.544599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.641491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794279-b7a1-4389-8d91-27b590f0e5cb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.670900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d486a84-4a57-4f32-aa25-859364525df0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.679710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.680599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.680882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.681158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.693270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:35:59.700651 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:35:59.706612 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 148/306] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:35:59.709038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.710251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.710946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.711285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.711571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.712788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.715182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.731675 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 159/307] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Apr 2 20:35:59 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:35:59.830529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a73b2-36c4-4763-a7be-090301680ad6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:35:59.867343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:35:59.868023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:35:59.868302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:35:59.868606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:35:59.869355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:35:59.869661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:35:59.871043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:35:59.880521 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 149/308] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:35:59.886189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:35:59.989297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f8b0-44e7-451a-988a-ffa60b523084 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:00.023241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:00.024106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:00.024506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:00.024878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] PATH_INFO: `/v3/users/e22bd90e144d4588bfff3a05f2409bbd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:00.045023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] RBAC: Authorizing `identity:get_user(user_id=e22bd90e144d4588bfff3a05f2409bbd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:00.046496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152e1b1-8b2a-4b7c-8935-824db787e584 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:00.048253 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 160/309] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:35:59 2022] GET /identity/v3/users/e22bd90e144d4588bfff3a05f2409bbd => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:00.054606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:00.161493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42ee98-408e-42ee-a332-3d433c8c0be6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:00.199170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:00.199830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:00.200116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:00.200391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:00.201242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, user.id=e22bd90e144d4588bfff3a05f2409bbd, scope.system=all) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:00.201551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:00.202980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad82b12-84da-41d0-8b82-b15ce64c4757 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:00.208960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 150/310] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Apr 2 20:36:00 2022] GET /identity/v3/role_assignments?user.id=e22bd90e144d4588bfff3a05f2409bbd&scope.system=all&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:00.693361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808538a1-eb49-4102-a678-47561fbeeeae None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:00.693747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808538a1-eb49-4102-a678-47561fbeeeae None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:00.693937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808538a1-eb49-4102-a678-47561fbeeeae None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:00.696273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 161/311] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:00.703815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:00.704037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:00.704325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:00.721797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:00.722972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:00.790554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 151/312] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:00.815362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808538a1-eb49-4102-a678-47561fbeeeae None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:00.921137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808538a1-eb49-4102-a678-47561fbeeeae None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:00.956053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:00.956868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:00.957154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:00.957429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:00.968275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:00.975476 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:36:00.977036 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 162/313] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:00.982791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:01.084500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa6bcb-d6d0-4dfc-b074-1acc757d4394 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:01.119743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:01.120412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:01.120723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:01.121000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:01.121733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:01.122036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:01.123412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:01.132331 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 152/314] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:01.137561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:01.238425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133521-7e42-428a-b646-08dc66519adb None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:01.274800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:01.275675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:01.275957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:01.276233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] PATH_INFO: `/v3/users/f968a21a239e48f8b706421b0649304b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:01.277460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] RBAC: Authorizing `identity:get_user(user_id=f968a21a239e48f8b706421b0649304b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:01.278919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:01.280861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 163/315] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:36:01 2022] GET /identity/v3/users/f968a21a239e48f8b706421b0649304b => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:01.287476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:01.393843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda7737-9738-42ca-a79a-b9a9e876c499 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:01.429432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:01.430091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:01.430376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:01.430656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:01.509443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:01.510821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:01.608554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 153/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:01.614321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:01.719331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b302d0-3f5a-4a9c-bd26-2a0d5723482f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:01.757038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:01.758064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:01.758356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:01.758630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:01.759872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:01.761286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd8498-ca83-42be-ad3e-bdd53bd227a4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:01.763332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 164/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:01 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:01.769279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:01.875419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe69bf-7424-4732-a63f-d73b55d5bc5a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:01.910310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:01.910971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:01.911238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:01.911517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:01.912340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, scope.project.id=0822299472b84bdba87f302a57c0ab73, user.id=f968a21a239e48f8b706421b0649304b) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:01.912680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:01.914107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fd942-23c0-40b0-9237-52149d6aebbd None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:01.920478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 154/318] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:01 2022] GET /identity/v3/role_assignments?user.id=f968a21a239e48f8b706421b0649304b&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:02.062966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9be75-950b-4ad7-93db-49d102ff92a8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.063990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9be75-950b-4ad7-93db-49d102ff92a8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.064516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9be75-950b-4ad7-93db-49d102ff92a8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.067106 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 165/319] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:02.074411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821299-29ab-4cb3-8c8d-b15e3009f62f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.074935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821299-29ab-4cb3-8c8d-b15e3009f62f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.075011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87821299-29ab-4cb3-8c8d-b15e3009f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.095466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-87821299-29ab-4cb3-8c8d-b15e3009f62f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:02.097153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-87821299-29ab-4cb3-8c8d-b15e3009f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:02.165474 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 155/320] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:02.191682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9be75-950b-4ad7-93db-49d102ff92a8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.217981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b39d-d138-4f5f-9830-585cc2e39c7d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.218318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b39d-d138-4f5f-9830-585cc2e39c7d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.218560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b39d-d138-4f5f-9830-585cc2e39c7d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.220343 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 156/321] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:02.226515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.226807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.227093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.243798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:02.245019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:02.299534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9be75-950b-4ad7-93db-49d102ff92a8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.313743 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 157/322] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:02.332863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.333712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.333998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.334328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.337646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.347223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:02.354336 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:02.360275 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 166/323] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:02.361241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.436574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27f82c-058f-4291-8905-f7736b936b5c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.469798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45804d39-babc-476a-9f51-06bcf98ddb87 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.470403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.471261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.471551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.471830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.473036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:02.474482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:02.476246 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 158/324] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:02.481699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.504283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.504999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.505304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.505568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.506314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:02.506714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:02.508910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:02.519335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 167/325] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:02.524827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.580592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fff37-1e97-494f-9159-9f915fc1e426 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.615115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.615790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.616074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.616352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] PATH_INFO: `/v3/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.617067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:02.618543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93b3c-9083-4b50-986f-a2cab8787615 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:02.631363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b915-fa68-410c-803f-8204e1c2537a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.633661 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 159/326] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Apr 2 20:36:02 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:36:02.648135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaeaa-8051-40a4-8faa-b7d41baab323 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.648551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaeaa-8051-40a4-8faa-b7d41baab323 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.648751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caaeaa-8051-40a4-8faa-b7d41baab323 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.650865 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 160/327] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:02.657936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.658274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.658504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.669343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.670235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.670521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.670792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] PATH_INFO: `/v3/users/64cc251e708c44f9b51dd4bc673bcd8f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.672075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] RBAC: Authorizing `identity:get_user(user_id=64cc251e708c44f9b51dd4bc673bcd8f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:02.673597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:02.675915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 168/328] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/users/64cc251e708c44f9b51dd4bc673bcd8f => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:02.678076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:02.679275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:02.681797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.758018 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 161/329] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:02.781708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:02.789027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bdbd-b72c-4c5a-98b1-aa56f015612f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.822770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.823431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.823714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.824015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.824828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] RBAC: Adding query filter params (role.id=7fae3e7cc044438ea145a155975c346d, user.id=64cc251e708c44f9b51dd4bc673bcd8f, scope.system=all) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:02.825143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:02.826577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:02.839830 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 169/330] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/role_assignments?user.id=64cc251e708c44f9b51dd4bc673bcd8f&scope.system=all&role.id=7fae3e7cc044438ea145a155975c346d => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:02.887095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a0ad-2f51-4ec9-85b2-9b0ce1ded300 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:02.924713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:02.926040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:02.926321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:02.926596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:02.938582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:02.945843 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:36:02.947320 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 162/331] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:02.953197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:03.070443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c5d9-b5cf-47e3-b514-bf7f035c74e5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:03.106033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:03.106963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:03.107252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:03.107533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:03.108279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:03.108635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:03.110052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:03.118783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 170/332] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:03.124563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:03.231274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee8927-6c73-49e4-8552-475bbe8fb7c8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:03.264679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:03.265563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:03.265853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:03.266165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] PATH_INFO: `/v3/users/e22bd90e144d4588bfff3a05f2409bbd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:03.267357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] RBAC: Authorizing `identity:get_user(user_id=e22bd90e144d4588bfff3a05f2409bbd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:03.269421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3860d77-f15e-4ac2-afc1-93a979f94dca None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:03.271104 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 163/333] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:36:03 2022] GET /identity/v3/users/e22bd90e144d4588bfff3a05f2409bbd => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:03.276868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:03.379126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf52e2-6209-4ad7-ba67-cbf0c2d72669 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:03.414293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:03.415514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:03.416001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:03.416514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] PATH_INFO: `/v3/system/users/e22bd90e144d4588bfff3a05f2409bbd/roles/d13d017f3e5f4482ad4603250d31e10d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:03.418212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e22bd90e144d4588bfff3a05f2409bbd, role_id=d13d017f3e5f4482ad4603250d31e10d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:03.419860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2983a-988a-4038-9a3c-7ce1b1d55cdb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:03.430263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 171/334] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Apr 2 20:36:03 2022] PUT /identity/v3/system/users/e22bd90e144d4588bfff3a05f2409bbd/roles/d13d017f3e5f4482ad4603250d31e10d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:05.353737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc41-bed6-4656-94a9-9ad80bfc3655 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:05.354278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc41-bed6-4656-94a9-9ad80bfc3655 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:05.354278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc41-bed6-4656-94a9-9ad80bfc3655 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:05.356208 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 164/335] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:05.371559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:05.372061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:05.372136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:05.401454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:05.402665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:05.491028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:05.532816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1dc41-bed6-4656-94a9-9ad80bfc3655 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:05.653734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1dc41-bed6-4656-94a9-9ad80bfc3655 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:05.701657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:05.702470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:05.702758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:05.703038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:05.717686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:05.725273 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:05.726812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 165/337] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:05.732238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:05.839709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c19db8-f6af-40df-9970-10b513d9b246 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:05.880503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:05.881192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:05.881481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:05.881771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:05.882530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:05.882843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:05.884237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:05.893514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 173/338] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:05.898727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.009567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424269ae-a95a-4d04-b435-4aa96d3a24d4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:06.048727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:06.049927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.050210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.050487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.140035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:06.141592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731115f2-c8bf-4bc2-a8b2-ea80450e6c4c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:06.265379 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:06.271112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.412230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29b57-62c9-414f-aab7-6211233373d4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:06.453300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:06.453528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19002-fd12-4057-b31e-1363eb43a090 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.453961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19002-fd12-4057-b31e-1363eb43a090 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.454036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19002-fd12-4057-b31e-1363eb43a090 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.454281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.454474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.454755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.456814 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 167/340] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:06.460339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:06.462160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:06.464352 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 174/341] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:06 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:06.465927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.466235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.466488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.469569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.490398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:06.491580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:06.583430 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 168/342] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:06.631547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.690405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311717-c20a-464b-a8cd-01aa2cae96d4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:06.768348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dedea-28cc-4892-be86-cb81e53a4883 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:06.774538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:06.775416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.775704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.775984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.790265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:06.792088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70108f0-5c1a-4471-9a2c-0c1de6946041 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:06.793792 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 175/343] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:06 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:06.795062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464905cf-2656-470b-9c12-ed430ac2cd75 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.795352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464905cf-2656-470b-9c12-ed430ac2cd75 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.795633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464905cf-2656-470b-9c12-ed430ac2cd75 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.797318 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 176/344] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:06.804487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464905cf-2656-470b-9c12-ed430ac2cd75 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.812000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:06.813122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.813629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.814107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.826955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:06.836061 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-808f1c49-de5f-4356-bfd9-8db4afb033e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:06.838319 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 169/345] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:06.839997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:06.844624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:06.845228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:06.864244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:06.865839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:06.935298 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 170/346] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:06.939848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:06.971093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464905cf-2656-470b-9c12-ed430ac2cd75 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.004897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.005557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.005836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.006113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.006982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:07.007299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.008755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ea2c8-ba1f-4f1e-9d73-1b1f546c1c16 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.014954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 177/347] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:06 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=7fae3e7cc044438ea145a155975c346d => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:07.016269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c757-1ef2-4ad4-b5ff-673dbf4e7b78 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.016530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c757-1ef2-4ad4-b5ff-673dbf4e7b78 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.016809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c757-1ef2-4ad4-b5ff-673dbf4e7b78 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.021963 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 178/348] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:07.022931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c757-1ef2-4ad4-b5ff-673dbf4e7b78 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.072036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119abf-0197-4361-a1ae-f160d8b5ca33 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.108726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.109795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.110293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.110785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.111800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:07.112324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.113923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819b6a-41f2-4d9f-85ee-fc055016de58 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.122843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 171/349] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:07.124657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.125171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.125675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.140212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c757-1ef2-4ad4-b5ff-673dbf4e7b78 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.145444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:07.146937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:07.176440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.177364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.177601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.177873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.189123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:07.196568 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:07.198184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 179/350] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:07.199209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.223454 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 172/351] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:07.224649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.327803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93fe74-3d82-45c5-ab0a-ca90efdbc16b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.330188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215125d7-0d70-4756-aff0-33c9571442dc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.366775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.367953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.368364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.368590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.369010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.369359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.369731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.370102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.370400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:07.370960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.372514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.382429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 173/352] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:07.383509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.441157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.442723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.499994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402558e-729e-4c84-b682-8e0fef4474af None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.536506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.537631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.538074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.538498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.547279 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 180/353] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:07.548380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.550107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:07.557409 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2bae7836-0d2c-46a5-9441-50de701af4f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 02 20:36:07.558809 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 174/354] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:07.560259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe713-ee8c-4daf-b2c5-e329d195e376 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.560724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe713-ee8c-4daf-b2c5-e329d195e376 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.561169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fe713-ee8c-4daf-b2c5-e329d195e376 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.563495 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 175/355] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:07.566069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe713-ee8c-4daf-b2c5-e329d195e376 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.658193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adf062-3db2-4c6f-919b-8e6d948a06eb None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.671438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fe713-ee8c-4daf-b2c5-e329d195e376 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.692679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.693593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.693593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.693854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.708119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.709331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.709825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.710321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.712070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.713740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcafe-1353-45b9-8982-f7bf74c28d4b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.715652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 176/356] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:07.721309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.721885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.722370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.740321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:07.741938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:07.762804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.764047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.812634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 177/357] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:07.813814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.865176 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 181/358] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:07.866044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:07.918003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cc521-ce4e-414a-bf65-6688a6006f03 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.954030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:07.954978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:07.955368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:07.955806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:07.956915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] RBAC: Adding query filter params (name=reader) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:07.957240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:07.959052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:07.965333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02a747-bc79-4b5f-9b50-57e597dbc834 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:07.969793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 178/359] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:07.970049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.013272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.014484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.015001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.015596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.017015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.019228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.021458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 182/360] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.022450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.102132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b5999-9cce-4c79-a945-f363ee6ececc None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.142486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.143419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.143699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.143977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.153036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5fdd-84c6-4745-aa63-35719ef909b1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.162647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:08.170393 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9f17b3a9-e8ac-40c7-987b-85e3f5fb3231 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:08.171702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 179/361] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:08.173000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e94612-0319-48bd-9ffb-96f384d39188 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.173286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e94612-0319-48bd-9ffb-96f384d39188 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.173568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e94612-0319-48bd-9ffb-96f384d39188 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.176067 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 180/362] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:08.176194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e94612-0319-48bd-9ffb-96f384d39188 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.202146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.203008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.203296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.203579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.206134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.207597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.209697 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 183/363] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.210184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.306474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e94612-0319-48bd-9ffb-96f384d39188 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.337020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ca1a-a611-4c1b-8854-3308f59106a6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.350520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.351409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.351695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.351971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] PATH_INFO: `/v3/users/e22bd90e144d4588bfff3a05f2409bbd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.353223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] RBAC: Authorizing `identity:get_user(user_id=e22bd90e144d4588bfff3a05f2409bbd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.355281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a331-4673-442f-b9b5-9436136f89f5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.359561 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 181/364] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/users/e22bd90e144d4588bfff3a05f2409bbd => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.359561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.359561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.359561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.379411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:08.380933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:08.382032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.382766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.383055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.383352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.384191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=274759295627427290199d61ae093512, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:08.384542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.385981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.395069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=274759295627427290199d61ae093512 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.395609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.473404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 182/366] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:08.474908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.515359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96316fd-c0e3-4f49-957d-c6bb2378a03c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.567215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.568152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.568644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.569068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.570079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:08.570638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.572267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.582204 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 185/367] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.583408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.604615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9defeb-8953-4667-9644-68bddb6abd70 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.647961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.649525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.649811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.650091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.651806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.653755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.656227 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 183/368] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.656826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.701535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a479f03-6631-483d-b7d6-30f5da8461d1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.742103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.743658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.744438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.744943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.745969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] RBAC: Adding query filter params (role.id=d13d017f3e5f4482ad4603250d31e10d, user.id=e22bd90e144d4588bfff3a05f2409bbd, scope.system=all) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:08.746643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:08.749264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:08.765624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 186/369] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/role_assignments?user.id=e22bd90e144d4588bfff3a05f2409bbd&scope.system=all&role.id=d13d017f3e5f4482ad4603250d31e10d => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:08.766465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:08.788853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82669f17-9f35-4569-abea-d1ee5ff2dd79 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:08.850631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:08.852105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:08.853951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:08.853951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:08.885088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:08.892517 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:08.894069 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 184/370] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:08.894629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.051905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03620ecd-7c7f-4722-af24-cc8f10024aec None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.100360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.101064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.101941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.101941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.110325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d57ade-ea4f-47fc-992b-109d01f15d45 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.151163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.152188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.152717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.153186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.154197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=0822299472b84bdba87f302a57c0ab73) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:09.154704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.161500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.167937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=7fae3e7cc044438ea145a155975c346d => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:09.169176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.183517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.185553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.311076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23a7a-abfb-4e29-aacc-f0f2b564a2c8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.318088 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 187/372] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:09.323126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.350300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.351039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.351332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.351666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.352504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:09.352826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.354282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.363401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 186/373] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:09.369186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.427622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ee99d-97d7-4145-9787-f16b801f5df2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.466583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.467467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.467754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.468035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.469260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.471288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.473331 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:09.481167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.488648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743cc18-a742-4915-bd30-326879006d15 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.523777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.524446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.524770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.525063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.597328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.598737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.622320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce34c3-7f38-42f2-8acf-e85843b0dc7d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.677853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.678732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.679014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.679471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.682516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.683976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.685686 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 189/375] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:09.692156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.707831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 187/376] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:36:09.713601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.809507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ff631-afe4-435a-ba8c-e9b907c23e57 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.817342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d913af-b43f-41f5-8995-8f9cfb2c568e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:09.849449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.850098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.850362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.850646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.851521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=274759295627427290199d61ae093512, scope.project.id=0822299472b84bdba87f302a57c0ab73) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:09.851833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.852242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:09.853141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:09.853318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.853461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:09.853752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] PATH_INFO: `/v3/projects/fa034640396047d6b05aa8a8842d2e67` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:09.854962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fa034640396047d6b05aa8a8842d2e67)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:09.856395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:09.858124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 188/377] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/projects/fa034640396047d6b05aa8a8842d2e67 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:09.859274 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 190/378] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=274759295627427290199d61ae093512 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:09.864336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:09.970220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee37fe2-bb26-4963-887b-0d92aa61b0c9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:10.007905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:10.008816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.009097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.009369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] PATH_INFO: `/v3/groups/329fcf99e54943eab8cb5dd5677e37bc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.016103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] RBAC: Authorizing `identity:get_group(group_id=329fcf99e54943eab8cb5dd5677e37bc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:10.018142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8a5c0-fc39-4d6a-88bb-458e8b48b783 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:10.020174 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 189/379] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:09 2022] GET /identity/v3/groups/329fcf99e54943eab8cb5dd5677e37bc => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:10.029626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:10.106046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2606dd-9cd2-4abc-8399-4a0955ea5169 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.106358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2606dd-9cd2-4abc-8399-4a0955ea5169 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.106521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2606dd-9cd2-4abc-8399-4a0955ea5169 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.108557 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 190/380] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:10.116274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.116584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.116865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.138384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:10.140160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:10.156517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8111d5-75ec-4bef-8ae0-dd7c89812dfc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:10.196837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:10.197903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.198409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.198883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.199884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] RBAC: Adding query filter params (group.id=329fcf99e54943eab8cb5dd5677e37bc, role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=fa034640396047d6b05aa8a8842d2e67) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:10.200406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:10.202110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:10.210863 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 191/381] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:10 2022] GET /identity/v3/role_assignments?group.id=329fcf99e54943eab8cb5dd5677e37bc&scope.project.id=fa034640396047d6b05aa8a8842d2e67&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:10.245648 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 191/382] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:10.272023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:10.406928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6819b-07ae-4bcd-b9f8-aaf2bda2846e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:10.463262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:10.464080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.464364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.464666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.484019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:10.491641 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:10.493183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:10.498739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:10.637471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864f8d6-1c68-44d4-a69a-c92b221e5b2a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:10.681241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:10.682294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.682802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.683282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.684231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:10.684774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:10.686371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:10.695587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 192/384] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:10.701003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:10.842206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d5ee-2862-4d5b-b511-4f8933124d36 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:10.878548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:10.879410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:10.879689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:10.879962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:10.885296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:10.887408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:10.889458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 193/385] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:10 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:10.896100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:11.031121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f557-34ac-4969-be9a-63915f6bd3a0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:11.071587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:11.072476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:11.072759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:11.073033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:11.074226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:11.075667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecb228-acd2-4094-b5bc-34d49bd2cda8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:11.077440 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 193/386] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:10 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:11.083248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:11.217350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dad16-b467-4af8-a37f-4bfa5098ffcc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:11.257953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:11.258845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:11.259129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:11.259406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/groups/fbb8608028e5499a9f908795140e86dc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:11.261452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, group_id=fbb8608028e5499a9f908795140e86dc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:11.262883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04366de-e05f-4546-bfdb-e57a2831a956 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:11.281237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 194/387] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Apr 2 20:36:11 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/groups/fbb8608028e5499a9f908795140e86dc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:11.815877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261041-0572-430c-bf0f-7124f3000e48 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:11.816909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261041-0572-430c-bf0f-7124f3000e48 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:11.817397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261041-0572-430c-bf0f-7124f3000e48 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:11.819463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 194/388] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:11.826279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:11.826778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:11.826854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:11.851295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:11.852514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:11.931314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 195/389] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:11.969604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261041-0572-430c-bf0f-7124f3000e48 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.091423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261041-0572-430c-bf0f-7124f3000e48 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:12.129856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:12.131095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.131589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.132056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.145191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:12.155391 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:12.157027 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 195/390] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:12.162876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.275813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0c9a0-526e-45c1-8601-c62704b3a5e9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:12.316621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:12.317376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.317664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.317938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.318688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:12.319029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:12.320358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:12.328783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 196/391] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:12.337643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.445150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34c8-7fb3-43ad-86c9-80153f0038e3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:12.482405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:12.483420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.483707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.483983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.487618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:12.489135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa18ab-8fed-4c66-88d4-db1255e8e907 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:12.491063 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 196/392] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:12 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:12.496683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.585950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b0db-b775-48cd-9295-ced3da8011b7 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.586265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b0db-b775-48cd-9295-ced3da8011b7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.586776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b0db-b775-48cd-9295-ced3da8011b7 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.588905 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 197/393] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:12.595959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.596248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.596550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.604873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03508-9c9d-4cbe-ade6-91bf31fea9c8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:12.637674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:12.638891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:12.647520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:12.648783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.649293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.649739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.651139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:12.653003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:12.655214 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 197/394] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:12 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:12.661234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.788201 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 198/395] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:12.799423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bf46f-1b4f-4124-9320-4234fdc2187f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:12.824204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:12.850126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:12.851020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:12.851304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:12.851583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/groups/fbb8608028e5499a9f908795140e86dc/roles/274759295627427290199d61ae093512` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:12.860876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] RBAC: Authorizing `identity:create_grant(project_id=fafd8cd7b251409d95125f977eb9d2e3, group_id=fbb8608028e5499a9f908795140e86dc, role_id=274759295627427290199d61ae093512)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:12.862988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:12.887746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 198/396] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Apr 2 20:36:12 2022] PUT /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3/groups/fbb8608028e5499a9f908795140e86dc/roles/274759295627427290199d61ae093512 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:12.984539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24f736-d49e-4de4-9c9b-cd1259872df5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.045980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.046718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.047001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.047277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.069185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:13.076571 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9b6a8f0b-1a4d-4c1b-8024-299ca1914814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:13.078183 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 199/397] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:13.083685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.090215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413622a5-33b3-4a54-beb0-115ec345a161 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.090527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413622a5-33b3-4a54-beb0-115ec345a161 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.090769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413622a5-33b3-4a54-beb0-115ec345a161 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.094283 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 200/398] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:13.104485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.104485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.104485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.130673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:13.132008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:13.225297 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 201/399] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:13.242591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1b7de-a258-448e-b037-7f7e05eaa255 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.256907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.284786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.286004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.286554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.287013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.288333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:13.288557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.293361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.300045 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 199/400] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:13.305341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.375268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f729-2a57-4ca6-8869-0371449ce2fe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.424256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.425156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.425449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.425880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.431815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173b7d2-b99a-4664-9465-a5d64d00c788 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.438624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:13.447803 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:13.452555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 202/401] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:13.456043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.478885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.480191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.480644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.481046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.482400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.484408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.487686 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 200/402] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:13.494431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.614144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d69a-23ac-4236-a292-b26508c50778 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.672503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.672978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47b9e4-a736-4385-a5cb-094946231925 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.673184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.673470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.673785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.674694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:13.675011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.676383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.686075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 203/403] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:13.694106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.740275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.741839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.742131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.742408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.745956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.747398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.749102 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 201/404] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:13.754796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.853984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf8e6-66d5-498d-a18e-710e8b867e0a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.895042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.896367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.896688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.897234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.898582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.900630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1fef-d094-43e2-afe8-2a659f2e2b1d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.901848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb04e-af54-45ba-a16a-012576cc30da None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:13.902549 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 204/405] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:13.903755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937439-5b07-40d7-a330-aff7f84b01c4 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.904039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937439-5b07-40d7-a330-aff7f84b01c4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.904318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937439-5b07-40d7-a330-aff7f84b01c4 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.905972 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 205/406] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:13.909859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937439-5b07-40d7-a330-aff7f84b01c4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:13.947763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:13.949074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.949074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.949339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/groups/fbb8608028e5499a9f908795140e86dc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.951336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, group_id=fbb8608028e5499a9f908795140e86dc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:13.953143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a4619-8229-43b1-a571-4b87b358260c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:13.974254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 202/407] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Apr 2 20:36:13 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/groups/fbb8608028e5499a9f908795140e86dc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:13.975791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7015-7745-408f-9d26-058cd35b306e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:13.976092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7015-7745-408f-9d26-058cd35b306e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:13.976377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7015-7745-408f-9d26-058cd35b306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:13.997504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-558a7015-7745-408f-9d26-058cd35b306e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:13.998794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-558a7015-7745-408f-9d26-058cd35b306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:14.085260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 203/408] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:14.117256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937439-5b07-40d7-a330-aff7f84b01c4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.121575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7015-7745-408f-9d26-058cd35b306e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.181352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.182149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.182428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.182752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.184509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:14.187439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:14.190290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 206/409] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:13 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:14.197319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.283845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7015-7745-408f-9d26-058cd35b306e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.318716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.319563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.319849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.320124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.329290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee63e5-ee06-470b-b91b-bf014bdd97f0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.332381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:14.339716 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:14.340945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 204/410] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:14.346831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.365375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.366270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.366555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.366837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73/groups/fbb8608028e5499a9f908795140e86dc/roles/274759295627427290199d61ae093512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.369126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] RBAC: Authorizing `identity:create_grant(project_id=0822299472b84bdba87f302a57c0ab73, group_id=fbb8608028e5499a9f908795140e86dc, role_id=274759295627427290199d61ae093512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:14.370576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:14.391339 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 207/411] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Apr 2 20:36:14 2022] PUT /identity/v3/projects/0822299472b84bdba87f302a57c0ab73/groups/fbb8608028e5499a9f908795140e86dc/roles/274759295627427290199d61ae093512 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:14.508664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa83df-7538-492e-8636-0dedd426b1a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.553237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.553919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.554206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.554483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.555231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:14.555540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:14.556958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f6f0-8d23-4674-b6db-cb97f14bd9a1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:14.570999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:14.575560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.635399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb05b9-9cf1-4f26-8c0b-4eb0a6003a6a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.635727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb05b9-9cf1-4f26-8c0b-4eb0a6003a6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.635965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb05b9-9cf1-4f26-8c0b-4eb0a6003a6a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.637937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 206/413] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:14.644825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.645117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.645394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.675116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:14.676359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:14.718378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890cc8-61c2-47a9-8ff5-81ad78a56163 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.757413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.758287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.758672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.758961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] PATH_INFO: `/v3/groups/329fcf99e54943eab8cb5dd5677e37bc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.760262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] RBAC: Authorizing `identity:get_group(group_id=329fcf99e54943eab8cb5dd5677e37bc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:14.761760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:14.762074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:14.765729 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:14 2022] GET /identity/v3/groups/329fcf99e54943eab8cb5dd5677e37bc => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:14.771137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.802460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:14.943243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a9f75-0b09-42c0-850a-8cd19ed4d25e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.987510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756af70-da81-4f4f-b0f9-86fc180902d0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:14.988559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:14.989721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:14.990209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:14.990697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] PATH_INFO: `/v3/projects/fa034640396047d6b05aa8a8842d2e67` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:14.992179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa034640396047d6b05aa8a8842d2e67)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:14.993871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:14.996346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 208/416] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:14 2022] GET /identity/v3/projects/fa034640396047d6b05aa8a8842d2e67 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:15.003587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:15.047997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:15.049802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.050347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.050823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.067883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:15.081931 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:15.083784 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 209/417] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:15.089850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:15.118790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16746e09-baeb-4771-a82c-8d915f51baf6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:15.195541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:15.196442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.196745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.197019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] PATH_INFO: `/v3/projects/fa034640396047d6b05aa8a8842d2e67/groups/329fcf99e54943eab8cb5dd5677e37bc/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.206974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] RBAC: Authorizing `identity:create_grant(project_id=fa034640396047d6b05aa8a8842d2e67, group_id=329fcf99e54943eab8cb5dd5677e37bc, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:15.208427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:15.231450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76bdc0-2a24-4bdd-8c95-103f95ae9e38 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:15.241619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 209/418] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Apr 2 20:36:15 2022] PUT /identity/v3/projects/fa034640396047d6b05aa8a8842d2e67/groups/329fcf99e54943eab8cb5dd5677e37bc/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:15.325282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:15.326051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.326344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.326627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.327395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] RBAC: Adding query filter params (name=member) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:15.327713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:15.329182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:15.344538 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 210/419] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:15.350551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:15.487706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2b96-92be-42e1-a986-eb59f1ad27fe None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:15.522027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:15.522604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.523003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.523291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.600155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:15.601647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaac184-d932-4289-b4bd-c2d9b440c0bb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:15.731967 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:15.738209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:15.814259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e3a7-5b83-4f27-8e42-b121f6422d94 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.814446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e3a7-5b83-4f27-8e42-b121f6422d94 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.814734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e3a7-5b83-4f27-8e42-b121f6422d94 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.816672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 211/421] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:15.830581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.830581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.830581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.852470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:15.861888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:15.866686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84695fb-e4e5-4080-b80d-112c6b335afe None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:15.908670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:15.909839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:15.910274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:15.910685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:15.913401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:15.915031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:15.920560 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:15 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:15.929148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:15.990978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 212/423] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:16.063470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2606-3d1f-4a11-a5ee-6fd83a776489 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:16.086795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:16.107704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:16.108822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.109257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.109703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.111088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:16.112710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:16.119248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:15 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:16.120577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:16.196689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28351f9-1c59-42e4-a06e-f44c115abc0a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:16.245692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:16.246520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.246804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.247082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.249581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d438-60e5-453f-b0fa-368481914653 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:16.268142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:16.283762 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:16.287372 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:16.288848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:16.289678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.290138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.290564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.291536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:16.292091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:16.293310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:16.294912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:16.309980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:16 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=7fae3e7cc044438ea145a155975c346d => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:16.434336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740caae-0a7d-473f-af81-f65d267ec3e1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:16.493336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:16.494326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.494763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.495189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.496099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:16.496581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:16.498132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:16.507569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 214/427] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:16.513100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:16.650847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d77-4c71-46b6-a70b-091f769ccee4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:16.698484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:16.699068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.699352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.699628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.788974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:16.790546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20aaba9-8b31-465d-9031-8a8f51f2a1b9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:16.904627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 214/428] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:16.910275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:16.978832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86297-c533-491a-a1bb-06d1f060afbb None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.979125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86297-c533-491a-a1bb-06d1f060afbb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.979308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c86297-c533-491a-a1bb-06d1f060afbb None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:16.981394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 215/429] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:16.987948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:16.988241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:16.988566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.007982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:17.009587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:17.055935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114531a-0581-4f31-ad17-c311b7217a02 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.089824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:17.098388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.099256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.099538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.099809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] PATH_INFO: `/v3/projects/fafd8cd7b251409d95125f977eb9d2e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.101014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] RBAC: Authorizing `identity:get_project(project_id=fafd8cd7b251409d95125f977eb9d2e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.102443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.104374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:16 2022] GET /identity/v3/projects/fafd8cd7b251409d95125f977eb9d2e3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:17.109709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.117400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.237866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbb14-7818-4fae-ac24-f71cd042b98b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.243330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae10c9-4c2f-4cb3-ac08-cdaa776c756b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.279360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.280615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.281044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.281632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.282894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.284517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.285635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.286356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.289816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.291553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.294062 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:17.300571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:17.301195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.307908 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 02 20:36:17.309205 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:17.316071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.420779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0ed4-98fd-464e-bf27-5af80dbc62e7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.420979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e75ef-6c1e-4a85-9df7-22538a32f428 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.459065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.459791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.460184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.460481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.461490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] RBAC: Adding query filter params (name=member) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:17.461800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.463360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77a083-1cbb-47ee-8f91-35c56b110912 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.463729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.464388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.464707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.464983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.465801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=274759295627427290199d61ae093512, scope.project.id=fafd8cd7b251409d95125f977eb9d2e3) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:17.466112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.467525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.472055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:17.474868 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=fafd8cd7b251409d95125f977eb9d2e3&role.id=274759295627427290199d61ae093512 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:17.474985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e359-3859-420b-9805-1de622b372c6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.474985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e359-3859-420b-9805-1de622b372c6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.474985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e359-3859-420b-9805-1de622b372c6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.477142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.477583 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 218/436] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:17.488186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.488378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.488692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.506580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:17.507785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:17.587068 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 219/437] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:17.604507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76deb-aa73-4156-97f1-1ff0641cf044 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.607207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.642812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.643901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.644393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.644927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.719241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5376096-b269-42fe-9628-1044299b87b9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.723759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.725269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.762407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.763153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.763435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.763708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.778614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:17.789129 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:17.789129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 220/438] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:17.794415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.853037 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 219/439] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:36:17.858538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:17.915440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec893-cf5c-4b98-ba9a-82cfeefa6b40 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.958386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:17.959235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:17.959521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:17.959797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:17.960604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:17.960919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:17.962547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:17.976559 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 221/440] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:17.976731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a97e-8f47-4146-8399-e57694200152 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:17.978822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.012812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.014425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.014756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.014997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.016321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.018224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.024719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 220/441] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:18.025893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.082488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88955cb-a185-458d-ae9c-1386cb1b4d8e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.115248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.115903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.116189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.116498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.123781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deec7d-f748-4f7a-a773-16163262613f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.159662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.160560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.160850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.161125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.162294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.163726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d40ca8-e9eb-48a2-8a81-808b0b439527 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.165341 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:18.166480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae2b0-4392-4f48-952b-99ec108b9bbc None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.166759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae2b0-4392-4f48-952b-99ec108b9bbc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.167029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae2b0-4392-4f48-952b-99ec108b9bbc None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.168784 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 222/443] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:18.170814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ae2b0-4392-4f48-952b-99ec108b9bbc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.186433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.187877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5103-c6e7-45e7-b08d-8ba5909f4b30 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.265840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ae2b0-4392-4f48-952b-99ec108b9bbc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.279989 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 222/444] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:36:18.281286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.281575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.281854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.297241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:18.298463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:18.298901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.299555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.299842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.300127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.300973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=7fae3e7cc044438ea145a155975c346d, scope.project.id=0822299472b84bdba87f302a57c0ab73) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:18.301290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.302706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.308439 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=7fae3e7cc044438ea145a155975c346d => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:18.309146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.377203 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 223/446] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:18.407313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.416418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760090d-4d40-49ba-8da6-238b0b0d76a8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.464029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.464946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.465229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.465502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] PATH_INFO: `/v3/projects/0822299472b84bdba87f302a57c0ab73` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.466792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] RBAC: Authorizing `identity:get_project(project_id=0822299472b84bdba87f302a57c0ab73)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.468241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.469988 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 224/447] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/projects/0822299472b84bdba87f302a57c0ab73 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:18.476246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.518707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc567e-dbef-49f5-98f8-045958961004 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.560771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.561824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.562111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.562389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.575538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:18.583037 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:18.585661 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 224/448] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:18.588191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687a99a-cbde-4222-ae5d-6912f30c60bd None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.590192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.628372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.629513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.629623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.629805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] PATH_INFO: `/v3/groups/fbb8608028e5499a9f908795140e86dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.630997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] RBAC: Authorizing `identity:get_group(group_id=fbb8608028e5499a9f908795140e86dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.633080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.634855 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 225/449] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/groups/fbb8608028e5499a9f908795140e86dc => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:18.640676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.701042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db709b-ebf1-4fde-8cba-6759c0662620 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.737213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.737883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.738162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.738436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.739171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:18.739477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.740867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.748508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 225/450] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:18.750239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888dca-4c82-4b65-a80f-01bd1b192533 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.754537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:18.783090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.783677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.783965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.784243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.785098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] RBAC: Adding query filter params (group.id=fbb8608028e5499a9f908795140e86dc, role.id=274759295627427290199d61ae093512, scope.project.id=0822299472b84bdba87f302a57c0ab73) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:18.785414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.786846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:18.792505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/role_assignments?group.id=fbb8608028e5499a9f908795140e86dc&scope.project.id=0822299472b84bdba87f302a57c0ab73&role.id=274759295627427290199d61ae093512 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:18.851225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee2e12-ea9c-423d-8541-f5f786711327 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:18.885820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:18.886485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:18.886771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:18.887049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:18.956857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:18.958336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:19.057815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 226/452] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:19.063341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:19.160567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed99f2-6485-48ed-bd7d-3c822b31b863 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:19.192849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:19.193707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:19.193992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:19.194273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] PATH_INFO: `/v3/projects/fa034640396047d6b05aa8a8842d2e67` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:19.195449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] RBAC: Authorizing `identity:get_project(project_id=fa034640396047d6b05aa8a8842d2e67)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:19.196932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:19.198609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:36:19 2022] GET /identity/v3/projects/fa034640396047d6b05aa8a8842d2e67 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:19.204054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:19.295789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dddffd0-32e5-458e-a1de-668b120be98f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:19.327280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:19.328055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:19.328337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:19.328655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] PATH_INFO: `/v3/groups/329fcf99e54943eab8cb5dd5677e37bc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:19.330376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] RBAC: Authorizing `identity:get_group(group_id=329fcf99e54943eab8cb5dd5677e37bc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:19.331824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16be0e-627f-42dd-ab28-fcae415f56ad None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:19.333434 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Apr 2 20:36:19 2022] GET /identity/v3/groups/329fcf99e54943eab8cb5dd5677e37bc => generated 229 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:19.339179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:19.431359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0deb-bc27-476b-b6cb-0a78935a8444 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:19.465567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:19.466215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:19.466499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:19.466775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:19.467584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] RBAC: Adding query filter params (group.id=329fcf99e54943eab8cb5dd5677e37bc, role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=fa034640396047d6b05aa8a8842d2e67) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:19.467894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:19.469354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b7a40-8045-4549-8c19-29feb1c830b3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:19.474875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Apr 2 20:36:19 2022] GET /identity/v3/role_assignments?group.id=329fcf99e54943eab8cb5dd5677e37bc&scope.project.id=fa034640396047d6b05aa8a8842d2e67&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:22.694707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8b10-5533-4710-91a4-c35e4f4c654e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.695248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8b10-5533-4710-91a4-c35e4f4c654e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.695248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b8b10-5533-4710-91a4-c35e4f4c654e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.698482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddfebe-5e0c-4714-b41e-66545441a961 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.699324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddfebe-5e0c-4714-b41e-66545441a961 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.699795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddfebe-5e0c-4714-b41e-66545441a961 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.702203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 229/457] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:22.703516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224857-dedc-4f48-a994-8bce8318f7a8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.703727 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 228/457] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:22.704213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224857-dedc-4f48-a994-8bce8318f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.705266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224857-dedc-4f48-a994-8bce8318f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.709390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.709595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.709876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.732094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:22.733302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:22.735104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-70224857-dedc-4f48-a994-8bce8318f7a8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:22.736363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70224857-dedc-4f48-a994-8bce8318f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:22.811640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 230/458] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:22.813019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e17d0-c795-4043-905c-9e172df3d08d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.813312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e17d0-c795-4043-905c-9e172df3d08d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.813592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e17d0-c795-4043-905c-9e172df3d08d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.815940 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 231/459] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:22.822678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.822972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.823253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.824562 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 229/460] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:22.839942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:22.841151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:22.848752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:22.911968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 232/461] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:22.913184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:22.951997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c5347-2bd3-44ac-8e5b-45b8cc8f0ec9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:22.986543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:22.987203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:22.987491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:22.987768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:22.997814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:22.999261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.012367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a58083-a552-4b83-b8bb-a7320224df0c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.016500 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:23.019003 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 230/462] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:23.019956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.047941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.049149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.049651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.050126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.060470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.062182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.080402 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:23.082245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 233/463] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:23.083216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.118694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339256c-af21-4045-b246-a59de7eacd6e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.153049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.153467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.153753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.154031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.165652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.167107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.183099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75516dc2-7595-4a39-93e7-501f3d72a947 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.184100 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:23.185326 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 231/464] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:23.186723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.220414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.221359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.221809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.222224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.223072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:23.223517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.225048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.242577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 234/465] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:23.243558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.288244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353b68-ed1a-46f3-bd03-cff146402b2c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.321233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.321897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.322182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.322461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.323176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:23.323487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.324901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a199d-ba3f-4568-94b9-0f596fdad9ad None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.336765 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 232/466] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:23.338108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e16d0-b891-493f-981a-7a9dead023c7 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.338392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e16d0-b891-493f-981a-7a9dead023c7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.338668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e16d0-b891-493f-981a-7a9dead023c7 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.340478 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 233/467] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:23.341391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e16d0-b891-493f-981a-7a9dead023c7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.352182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c65e31-7a9d-4d83-b5ba-830d24184237 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.386147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.387186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.387479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.387905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.388675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:23.388984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.390356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.401804 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 235/468] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:23.402577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.449289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e16d0-b891-493f-981a-7a9dead023c7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.483723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.484399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.484714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.484990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.486335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.487770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd42b7-f9e4-438f-88fb-a3cafb0ae728 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.517294 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 234/469] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:23 2022] POST /identity/v3/users => generated 248 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:23.517294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.517294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.517294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.522103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58073676-60db-44b1-bd3d-96b491ca0bba None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.528246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:23.529512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:23.571854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.572574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.572861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.573136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.573853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.575414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.603847 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 236/470] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:23 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:23.604739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.607457 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 235/471] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:23.659680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.727122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969132b-6503-4dba-8f54-87b68c5efc0c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.763997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.764706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.765042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.765322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.766031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.768117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0ebcb-0259-4f70-ac99-d7278f28dc6f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.799547 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 237/472] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:23 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:23.823188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b426-c1f2-4a9c-ad5e-0e4cf65f6969 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:23.839697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538a4f-506f-4750-8a6d-a18c1303ac0a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.840033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538a4f-506f-4750-8a6d-a18c1303ac0a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.840313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538a4f-506f-4750-8a6d-a18c1303ac0a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.842599 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 238/473] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:23.851062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.851350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.851619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.867764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:23.868729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:23.869020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:23.869295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:23.879540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:23.880930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:23.882447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:23.882659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:23.905324 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:23.908281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 236/474] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:23.915066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:23.973859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 239/475] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:24.008652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:24.029044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2be59-b510-482e-9544-a21ba4fd608b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:24.070840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:24.070840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:24.070840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:24.071157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:24.071686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:24.071993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:24.073401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:24.085743 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 237/476] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:24.092669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:24.120557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea6c7-9fa0-4283-8c1c-6613e6994865 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:24.156317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:24.157180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:24.157571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:24.157926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:24.158673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:24.160054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:24.167303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.sql.core [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 02 20:36:24.167303 ncdv-master-1 devstack@keystone.service[97317]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 02 20:36:24.167303 ncdv-master-1 devstack@keystone.service[97317]: [parameters: {'id': '8291211ba4ec4bc99be9d183adb05f87', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 02 20:36:24.167303 ncdv-master-1 devstack@keystone.service[97317]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97317) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 02 20:36:24.182926 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 02 20:36:24.185371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 240/477] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Apr 2 20:36:24 2022] POST /identity/v3/roles => generated 144 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:24.191869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:24.214893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e8da-f5e9-40ee-b873-6337c4400919 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:24.256006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:24.257158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:24.257680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:24.258150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:24.259100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:24.260811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:24.287534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 238/478] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:24 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:24.328899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214889-0137-41c4-8edc-183e6b4fe86a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:24.375787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:24.377629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:24.378110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:24.378602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:24.394258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:24.402385 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fc6d0b57-9632-42d5-b0a4-5f1f0a76fc73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 02 20:36:24.403970 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 241/479] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:36:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:24.409970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:24.520991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91bb77-c4c3-4e6d-9d9b-050f42f978cd None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:24.553771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:24.554358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:24.554638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:24.554910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:24.555639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:24.555942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:24.557326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe163d-4dd7-4373-a4a3-7b24a7d44326 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:24.566080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 239/480] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:26.577537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c178-6317-4df0-94f0-acbb5fdbf258 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:26.578046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c178-6317-4df0-94f0-acbb5fdbf258 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:26.578121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c178-6317-4df0-94f0-acbb5fdbf258 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:26.580192 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 242/481] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:26.587407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e691ce-14db-47c9-9df0-35289405bbd5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:26.587849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e691ce-14db-47c9-9df0-35289405bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:26.588029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e691ce-14db-47c9-9df0-35289405bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:26.608446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-31e691ce-14db-47c9-9df0-35289405bbd5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:26.613734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31e691ce-14db-47c9-9df0-35289405bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:26.702510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 240/482] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:26.720956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1ba2-6b1f-4a2c-85e0-bc7f411ccc88 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:26.721231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1ba2-6b1f-4a2c-85e0-bc7f411ccc88 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:26.721441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d1ba2-6b1f-4a2c-85e0-bc7f411ccc88 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:26.723460 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 243/483] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:26.730007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:26.730299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:26.730582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:26.734950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d1ba2-6b1f-4a2c-85e0-bc7f411ccc88 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:26.757846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:26.759047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:26.834555 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 241/484] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:26.876591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:26.878135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d1ba2-6b1f-4a2c-85e0-bc7f411ccc88 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:26.958660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:26.959573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:26.959859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:26.960309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:26.987377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:26.989082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9aec4-79d2-4b39-ab72-c71569ad2f2c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:26.994361 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:27.005625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 244/485] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.008869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.026386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33471469-9b3a-481a-9047-fba708985355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.027554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33471469-9b3a-481a-9047-fba708985355 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.028059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33471469-9b3a-481a-9047-fba708985355 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.028588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33471469-9b3a-481a-9047-fba708985355 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.041276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33471469-9b3a-481a-9047-fba708985355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:27.050157 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-33471469-9b3a-481a-9047-fba708985355 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:27.051984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 242/486] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.058465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33471469-9b3a-481a-9047-fba708985355 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.171489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b766b0f-29fa-4ac5-9083-a86d4e1120b0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.173759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33471469-9b3a-481a-9047-fba708985355 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.207326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.208527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.209315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.210034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.211251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:27.211739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.213345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea852b-712a-4fea-9292-fbe978ec627f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.213985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.214745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.215106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.215623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.216673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:27.217012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.218379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680992-96b6-4c3b-9d9c-627c103e6446 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.230182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 245/487] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:27.230182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50289af-4598-417f-a415-dc3cee55d5d6 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.230182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50289af-4598-417f-a415-dc3cee55d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.230182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50289af-4598-417f-a415-dc3cee55d5d6 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.230182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 246/488] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:27.231146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50289af-4598-417f-a415-dc3cee55d5d6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.233885 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 243/489] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:27.239872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.239872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.239872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.259948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:27.261756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:27.332027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 244/490] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:27.333111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.347705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50289af-4598-417f-a415-dc3cee55d5d6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.385149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.386622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.387111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.387685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.402459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.404671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.426489 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:27.428732 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.433879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.445582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631d533-a98a-4c46-8c77-2ab8c2c8a895 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.488016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.488980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.489165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.489399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.499759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.501760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.518866 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:27.522944 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 245/492] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.522944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.553684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563102-b96d-4e82-8d6e-8434acafc306 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.586070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.586896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.587184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.587461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.597987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:27.605016 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3e7e3cfa-7b79-42f7-9775-9b18fc13014b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:27.606496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 248/493] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.607704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ff1ec-65cc-4efb-8b48-1c1e3a74124a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.607989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ff1ec-65cc-4efb-8b48-1c1e3a74124a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.608265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ff1ec-65cc-4efb-8b48-1c1e3a74124a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.612493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 249/494] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:27.612493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ff1ec-65cc-4efb-8b48-1c1e3a74124a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.627532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e8a6-42a5-4a80-a939-e680fa2f7c4f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.664948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.665845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.666657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.667090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.668193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:27.668909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.671002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.690643 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 246/495] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:27.690643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.716069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ff1ec-65cc-4efb-8b48-1c1e3a74124a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.748406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.749085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.749364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.749636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.750398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:27.750646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.752607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe352e5-143f-4ccf-9095-e0b8abe19fe4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.763613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 250/496] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:27.764834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b880d-652f-47f6-ae7b-916cfbd14954 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.765097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b880d-652f-47f6-ae7b-916cfbd14954 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.765368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b880d-652f-47f6-ae7b-916cfbd14954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.780611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e5b880d-652f-47f6-ae7b-916cfbd14954 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:27.781779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e5b880d-652f-47f6-ae7b-916cfbd14954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:27.788106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eaaed-9e3d-4553-8606-6b16971fc157 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.819916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.820609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.820902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.821180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.821912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:27.822222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.823581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.831121 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 247/497] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:27.831883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.844694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 251/498] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:27.845990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ae573-084e-4ac0-b3e7-71af1df50ea2 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.846279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ae573-084e-4ac0-b3e7-71af1df50ea2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.846561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ae573-084e-4ac0-b3e7-71af1df50ea2 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.848506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 252/499] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:27.849217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ae573-084e-4ac0-b3e7-71af1df50ea2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:27.932320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ccad-d379-41bd-85b8-b6634db68f4f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.956086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ae573-084e-4ac0-b3e7-71af1df50ea2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:27.966647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.967438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.967719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.967992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.976540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:27.977964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:27.989186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:27.989966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:27.990278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:27.990556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:27.991193 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 02 20:36:27.992335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 248/500] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:27.993104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.002244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.003646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.017568 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-92f524c7-8148-476e-af12-02120dc86d75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:36:28.018741 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 253/501] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:28.023284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.023284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.023284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.039075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:28.040254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:28.091108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b27be9-5910-4d9f-a28e-3ae840565b78 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.101781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 254/502] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:28.103644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.123737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.124557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.124846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.125116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.135367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.136842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.152575 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:28.153725 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 249/503] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:28.154489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.197506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529ec16-5adc-4636-b32a-6675a4cf69f8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.229408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.230191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.230472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.230747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.240938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:28.247666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16e12-3dc9-412e-94b6-d7b6cd49d84b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.247915 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:28.249115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 255/504] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:28.249865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.279730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.280327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.280661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.280930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.281754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:28.282586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.284025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.319794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 250/505] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:28.320418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.344293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fad18-51e5-4d28-8d9f-18c784de9316 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.375464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.376745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.377023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.377293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.378107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:28.378418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.379828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.413438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd293b4-7c72-4d30-a87c-1062fe5fdf4f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.414583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 256/506] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:28.415373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.451654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.452500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.452748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.453031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.463264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.464783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.481655 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:28.482844 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 251/507] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:28.483628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.518520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b8dd-2dab-48de-a61c-47f710c76030 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.551907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.552523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.552811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.553089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.553808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:28.554118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.555502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.566862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 257/508] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:28.567658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.579612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dc319-b057-4346-9b8c-7f988510da59 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.611604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.612257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.612637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.612913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.613643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:28.613950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.615299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.622889 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 252/509] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:28.623651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.664041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313ce39-8209-43a7-a33b-ea5272ef0dac None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.696231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.696899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.697184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.697456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.725125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10323f-4516-4ffc-bf5f-e4046552083e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.755810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.756437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.756750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.757025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.759968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.761469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.826196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.827547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:28.858544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 258/510] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:28.859390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.939256 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 253/511] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:28.940318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:28.958132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d8582-2e7d-47de-9ed5-1530c7aeea6d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:28.989721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:28.990373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:28.990658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:28.990935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:28.991643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:28.991948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:28.993343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.004562 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 259/512] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:29.005352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.033445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138ed5c-767e-4d31-b1ff-975a8cf044db None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.065176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.065970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.066252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.066527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.073342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.074779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.088600 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 02 20:36:29.089695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 254/513] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:29.090450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.099642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8bbf-56c4-41a2-9a9d-78d3b7fecad3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.131189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.131971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.132254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.132562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.142648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.144132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.161311 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:29.162572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 260/514] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:29.163358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.186827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075130-f4a3-488c-8939-016fb401ee42 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.221741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.222528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.222811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.223086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.232683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.234137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.250277 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:29.251524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 255/515] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:29.252268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.269896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887c490-fccd-4733-a802-922a97e9d860 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.301029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.301805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.302083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.302356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.312244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.313750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.329798 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:29.331093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 261/516] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:29.331681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.354158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a99aa9-3088-42cd-a731-5a9486c107e9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.385702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.386492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.386847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.387199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.388246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.389521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.409300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 256/517] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:29 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:29.410097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.425764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c6b0-5088-48f8-8b88-3b1407c9793d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.462905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.464155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.464713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.465200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.466267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:29.466825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.468566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.503020 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 262/518] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:29.503991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.530066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816c65b-5feb-417e-a32d-16f2c6ff85a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.566149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.566825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.567107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.567454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.568096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:29.568418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.569833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.583278 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:29.584139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.609982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a838e-2857-49ef-918e-2bc92ef5e119 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.644407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.645106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.645437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.645718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.646427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:29.646732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.648097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.660189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:29.661109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.685085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986dbda-447d-4050-af5b-0e3e144a1a6b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.717823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.718487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.718769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.719044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.720275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:29.720610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.721966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.736676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:29.736676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.759063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e32234-8f60-4522-8d14-05f1be4fb622 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.792478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.793151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.793440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.793722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.831089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b007c-3bed-4f42-a1ec-188714e92241 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:29.862059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.863450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.864908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:29.865924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:29.866207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:29.866481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:29.873949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:29.875366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:29.889000 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 02 20:36:29.894959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 259/522] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:29.894959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.959482 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 264/523] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:29.961004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:29.999779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895f44-731f-4e12-b021-c2b10a76c9a8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.031920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.033288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.033577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.033855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.040318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.041814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.056255 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:30.062184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 260/524] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:30.062184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.064333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b8595-9061-4fa3-ae13-1299dc2887c7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.098034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.099181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.099695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.100212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.108691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.110276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.122936 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:30.128673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 265/525] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:30.128673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.162133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f7c89-5fe1-4597-a80e-3fbec9002372 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.193971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.194636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.194915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.195185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.195998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.196302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.197766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.215463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 261/526] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.216115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.227826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457747ab-1f07-4d76-845c-e3d138e31411 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.259818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.260641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.260922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.261193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.271882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.273346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.289706 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:30.291166 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:30.291720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.312102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233125a-c376-46f9-b6c4-6a0a90122da4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.346684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.347344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.347628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.347904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.348715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.349025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.350451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.373941 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 262/528] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.373941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.389691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a104b-7f5b-4153-af74-02c67e812ec0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.422274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.423506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.423793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.424076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.424901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.425215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.426665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.444015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 267/529] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.444712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.480627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db100e-d5f5-4df6-9b3e-fdfab4cba17f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.513201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.513859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.514135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.514406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.544909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a48a-868f-48fd-b4f6-f973b2354631 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.579300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.579959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.580242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.580553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.581259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.581570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.582925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.587417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.588919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.599168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 268/530] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.599168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.688870 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 263/531] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:30.689749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.694273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb49a-0533-4748-8e39-27bf40951a99 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.726563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.727406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.727697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.728001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.728824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=a51bfe290bcb46ca8fbecbaed36d2044) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.729141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.730589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.744493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 269/532] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/role_assignments?user.id=a51bfe290bcb46ca8fbecbaed36d2044&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.744493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.796611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0aee2-c795-48dd-a68c-4dc59436381d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.840790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.841508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.841800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.842081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.843488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:30.844176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.846944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.855838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc3438-5d65-44bf-9811-54b3333b7ca4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:30.861957 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 264/533] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:30.862949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:30.936486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:30.936486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:30.936486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:30.936486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:30.949021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:30.951269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:30.972670 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:30.974588 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 270/534] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:30.980210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.081994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66266-3972-4758-97cf-ed2a449c78d7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.153225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1af946-6bcc-41ff-b17c-d0f03f828d30 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.168832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.169859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.170067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.170342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.193551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.195704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.197079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.197994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.198602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.199140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.200162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:31.200685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.202291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.215804 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 271/535] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:31.222751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.227344 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:31.228860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 265/536] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:31.240597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.369697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb972b0-0da9-4bf5-bb55-0a091afa694e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.407471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.409137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.410307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.410736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.411860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=64e876b0e0844090aa652c98af67ab8b) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:31.413480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.415782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.426397 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 272/537] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:31 2022] GET /identity/v3/role_assignments?user.id=64e876b0e0844090aa652c98af67ab8b&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:31.442489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe0919-6f3f-4197-8f93-0654149fe41b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.498508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.499460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.499894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.500317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.501302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:31.501797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.503378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.522451 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 266/538] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:31.528539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.658595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281246-7f6a-4fa0-b92c-8b8b3978fe40 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.695835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.696914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.697404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.697829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.705856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.707532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.722017 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:31.723749 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 273/539] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:31.729192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.868674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198349e-001d-49c0-b67b-c5d153dae673 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:31.916890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:31.917803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.918240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.918688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.919613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:31.920086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:31.921727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b26f49-4a4e-4bdb-b83b-14124f3d0795 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:31.939671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 267/540] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:31.945772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:31.963084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726175d-a015-472b-87c3-6590cf83169d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.963591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726175d-a015-472b-87c3-6590cf83169d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.964019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726175d-a015-472b-87c3-6590cf83169d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:31.966235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 268/541] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:31.983377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:31.983980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:31.984601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.015093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:32.016373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:32.066129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092198-7789-4116-bbce-e445f494bd0d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:32.109721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:32.110913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:32.111411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:32.111900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.121066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=f4e42d69072d4f629c21c41a879dc01d) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:32.121643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:32.123325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:32.130006 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 269/542] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:32.132286 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 274/543] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:31 2022] GET /identity/v3/role_assignments?user.id=f4e42d69072d4f629c21c41a879dc01d&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:32.154762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:32.294855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f9ae-2096-41f3-aa84-39f37a084836 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:32.337687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:32.338481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:32.338759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:32.339028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.350165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:32.357146 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:32.358712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 270/544] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:32.364961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:32.465422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7eaba-fe7b-4a6b-aefa-964161111876 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:32.501063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:32.502097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:32.502383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:32.502658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.503404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:32.503710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:32.505106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:32.514082 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 275/545] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:32.520085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:32.637747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3262b6-5cb2-4824-b44b-17795f324ba5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:32.671282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:32.672078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:32.672358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:32.672713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.683440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:32.684936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:32.701613 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:32.703070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:32.708742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:32.809700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fd5e3-932e-4e4c-a79a-480c9c642040 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:32.842345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:32.843003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:32.843283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:32.843555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:32.844267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:32.845123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:32.846595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:32.858593 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 276/547] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:32.864492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:32.966301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6336cfd-df25-4210-9218-681274f7073a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:33.000490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:33.001401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.001687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.001963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] PATH_INFO: `/v3/users/swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.009890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:33.011339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:33.026835 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:36:33.028316 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 272/548] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:33.033865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:33.137366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0696f-56c9-4e9c-8d4d-a6dbe8fdcce0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:33.173818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:33.174495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.174776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.175046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.175949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:33.176257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:33.177729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:33.196715 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 277/549] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:33.202363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:33.304568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297753f-c25e-488f-a2f9-a5c1f688dffa None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:33.338221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:33.338870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.339161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.339481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.406693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:33.408710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:33.511634 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 273/550] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:33.517148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:33.616514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a45f4-385c-44ca-bd00-85341ef25ddc None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:33.650806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:33.651651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.651933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.652206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.663096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:33.664616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:33.681379 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-34d34530-cfb0-49a3-b3cb-520579773a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:33.682873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 278/551] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:33.688385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:33.697933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa138-5fcf-4cb7-8c2d-4898ea8cca3b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.698208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa138-5fcf-4cb7-8c2d-4898ea8cca3b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.698493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fa138-5fcf-4cb7-8c2d-4898ea8cca3b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.700615 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 279/552] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:33.718729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.719004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.719345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.757518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:33.758714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:33.805583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d82dbb-f945-4ef2-9a07-0ce776f4716c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:33.842605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:33.843265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:33.843544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:33.843816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:33.844693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:33.845474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:33.846859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:33.859228 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 274/553] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:33.866165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:33.902217 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 280/554] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:33.940248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.004817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996da155-8fea-4dcf-9198-0e05edca52af None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.050031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.051679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.052133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.052591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.061530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.064282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.072685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164c013-f23a-4754-9068-072f7a0954c6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.082304 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-0108c6ee-13cf-4f94-b096-9c362a656e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:34.083678 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 275/555] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:34.088723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab1ea-376a-4ada-96f4-f7b387bee49d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.088723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab1ea-376a-4ada-96f4-f7b387bee49d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.088723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab1ea-376a-4ada-96f4-f7b387bee49d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.092534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 276/556] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:34.093518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab1ea-376a-4ada-96f4-f7b387bee49d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.119605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.120492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.120893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.121181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.132118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:34.139262 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c1b1b324-a735-4853-9df4-644749f0dbe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:34.145288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 281/557] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:34.145288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.145288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.145288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.163912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:34.165932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:34.212750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab1ea-376a-4ada-96f4-f7b387bee49d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.248755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.249418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.249760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.250044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.251445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:34.251757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.253323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.256868 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 282/558] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:34.257934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.271063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 277/559] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:34.281508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.384776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c4f2f-0ab3-43bc-bd09-ac983af1efed None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.393095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6a01f-db08-4179-a00a-4920c45a0d2e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.424533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.425423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.425848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.426276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.427314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46a7aa639ada47bd8cdf615e9a7a5961) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:34.427783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.428179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.428981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.429366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.429759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.430185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.430702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:34.431112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.432602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.445181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 278/560] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/role_assignments?user.id=46a7aa639ada47bd8cdf615e9a7a5961&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:34.445181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.448993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 283/561] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:34.462032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.588749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73685c-797c-4dc3-b0c1-776cfa5b22a7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.645588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.646821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.647114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.647679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.659849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:34.665141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916139-7a10-42b6-82ae-8a2bc555385f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.667008 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-128e29a7-6c26-4b13-94b7-c3e47d1f0ffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:34.668392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 279/562] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:34.670299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8fc4-000a-489e-873b-6a00ee8cd1c6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.670592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8fc4-000a-489e-873b-6a00ee8cd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.670873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8fc4-000a-489e-873b-6a00ee8cd1c6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.673368 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 280/563] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:34.676992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a8fc4-000a-489e-873b-6a00ee8cd1c6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.713152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.714057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.714346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.714628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.727557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.729733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.751167 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-82f2f0c3-51f3-46e6-9d41-4d46c5515738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:34.756923 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 284/564] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:34.756923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.756923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.756923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.777840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:34.779396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:34.799256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a8fc4-000a-489e-873b-6a00ee8cd1c6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.842084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:34.843898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:34.844710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:34.845023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:34.845918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:34.846233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:34.847691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:34.860794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 281/565] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:34.860794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.866402 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 285/566] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:34.867518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:34.975484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdb1ea-2d1c-4d9b-9c40-44cbb284b4cf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:34.989195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b0aef-a7b5-4d16-a401-f4e6a5bdc715 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.013975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.014769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.015054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.015334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.025739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.026642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.027194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.027303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.027566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.027832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.028570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:35.028877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.030224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.045752 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 282/567] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:35.045752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.046013 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f926ec0f-c67d-469f-86a7-b557412349b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:35.046013 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 286/568] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.046013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1db4-96bd-4e58-b965-e2e578f409fa None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.046593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1db4-96bd-4e58-b965-e2e578f409fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.046593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1db4-96bd-4e58-b965-e2e578f409fa None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.048500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 287/569] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:35.054397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac1db4-96bd-4e58-b965-e2e578f409fa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.148784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614bd8d-b6f2-4f95-9206-dba3319b495d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.158113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac1db4-96bd-4e58-b965-e2e578f409fa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.181525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.182401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.182758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.183046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.193463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:35.194815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.195867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.196320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.196837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.200483 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:35.201848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.202438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.205886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.207599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.221844 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e210d314-9ff4-49cd-99c2-63cf84e32b49 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 02 20:36:35.227554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 288/571] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.227554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.227554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.227554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.241365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:35.242555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:35.316483 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 289/572] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:35.316676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48f9f-c836-4915-928c-832543dfad67 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.316755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.349438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.350104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.350928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.350928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.351356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:35.351661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.353061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.365219 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 284/573] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:35.366031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.420517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743627-f1b4-41f6-89ee-325d1ec323a7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.457210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.457888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.458165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.458450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.459195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:35.459500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.461163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.467034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2785f6-495d-45be-934e-6e5d2a491dd2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.469763 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 290/574] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:35.470328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.505428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.506022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.506302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.506580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.507399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:35.507707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.509172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.530767 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 285/575] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:35.530767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.579586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786a28-acba-4ae4-ba57-77181f445ea4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.615594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890630-6a84-4284-b779-20d333206114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.616390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890630-6a84-4284-b779-20d333206114 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.616701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890630-6a84-4284-b779-20d333206114 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.616976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69890630-6a84-4284-b779-20d333206114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.626961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69890630-6a84-4284-b779-20d333206114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:35.633801 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-69890630-6a84-4284-b779-20d333206114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:35.634981 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 291/576] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.635737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890630-6a84-4284-b779-20d333206114 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.642857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125849e-9c11-41b6-b801-ee5d4d5304fd None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.677077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.677871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.678160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.678444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.685382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.686861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.700439 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:36:35.706669 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 286/577] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.706669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.742303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69890630-6a84-4284-b779-20d333206114 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.774509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.775236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.775518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.775792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.786938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.788387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.803103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e7c41-c984-4249-a464-5445028fbfa0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.805010 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:35.806218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 292/578] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.806991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.837365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.838455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.838748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.839029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.852068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.853542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.869804 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:35.876039 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 287/579] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:35.876039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.912814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd277-7451-4c0b-bc53-a18ce9f58cf1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:35.956585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:35.957265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:35.957550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:35.957828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:35.958575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:35.958883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:35.960267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:35.968409 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 293/580] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:35.969283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:35.980954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66090d-09d8-416d-beb4-de76d0c5d9f0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.020752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.021438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.021805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.022087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.023646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.024032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.025584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.046762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 288/581] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.046762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.068857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb488-8b28-4b92-b6f4-25f33522d3a0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.100832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.101488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.101768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.102064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.102749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.103052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.104405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.116166 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 294/582] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.116989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.149699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f657-99f7-422c-b777-2e1634aba5f1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.183379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.184047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.184330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.184643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.185394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.185671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.187026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.200831 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 289/583] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.201709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.216764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41eb5-7479-4d43-8e92-24fae008cae7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.251273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.252402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.252857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.253282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.265629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.267967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.287188 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:36.289078 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 295/584] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:36.289535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.306390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a665c8-505c-471f-96e8-15b2eb0ca78b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.339866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.341007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.341476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.341949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.353476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.354934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.371138 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:36.377391 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 290/585] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:36.377391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.389999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04b57-0041-4626-970b-cabe6dcf7275 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.424350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.425204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.425482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.425765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.432810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.434250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.448319 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 02 20:36:36.454263 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 296/586] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:36.455160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.481241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa0cb-c3e0-4b26-a373-00df8232a65d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.521725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.522542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.522832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.523175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.531490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.533059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.548242 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:36.549420 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 291/587] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:36.550187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.560839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478733d5-88fc-44f6-a0a7-9b2ea27e8742 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.594862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.595677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.596086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.596478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.597322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.597732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.599184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.614417 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 297/588] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.614417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.654348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474752e-6db3-41bd-9486-af7536669ec8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.690112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.690769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.691053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.691327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.692041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.692345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.693728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.705271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 292/589] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.706063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.713725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e16056-a2b8-4f55-9fca-f79be8b9f95d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.749613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.750297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.750680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.750960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.751786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.752097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.753548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.775743 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 298/590] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.775743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.806688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99330311-74d3-4561-905e-f18bbcf7df41 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.842902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.843567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.844595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.844595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.845005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:36.845317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.846745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.863944 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 293/591] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:36.864672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.872632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98e82-fa52-44a5-8b4e-14512384bfe8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.907136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.907982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.908265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.908571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:36.915439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:36.916903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:36.930509 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 02 20:36:36.931657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 299/592] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:36.932403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:36.959994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f74a-6523-44b2-958c-dbb424102981 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:36.993197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:36.993987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:36.994270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:36.994543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.001480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.003553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.019254 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:37.020443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 294/593] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:37.021391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.027866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cb0c-73d2-422b-ba69-a57de5f1b155 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.060117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.060838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.061121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.061396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.071321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.072793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.090380 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-1ee897a8-da48-4191-b528-fd0cf274a43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:37.091516 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 300/594] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:37.092769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb0a8-dfcb-46d2-b1d9-2518d9ac3ada None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.093059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb0a8-dfcb-46d2-b1d9-2518d9ac3ada None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.093330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb0a8-dfcb-46d2-b1d9-2518d9ac3ada None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.095008 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 301/595] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:37.096641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb0a8-dfcb-46d2-b1d9-2518d9ac3ada None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.118215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ff41-bc72-417f-911d-042acea53b61 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.149829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.150701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.150983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.151256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/a51bfe290bcb46ca8fbecbaed36d2044/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.164611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=a51bfe290bcb46ca8fbecbaed36d2044, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.166063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.178492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 295/596] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:37 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/a51bfe290bcb46ca8fbecbaed36d2044/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:37.179284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.195468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb0a8-dfcb-46d2-b1d9-2518d9ac3ada None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.232414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.233179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.233402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.233679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.234536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:37.235481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.236990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.260168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 302/597] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:37.260168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.284909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b4fbf-b1f2-4120-9977-1da1bcd92212 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.321016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.321605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.321889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.322166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.322951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:37.323260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.324745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41053445-d127-4e85-85f9-c4c9c9318243 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.342088 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 296/598] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:37.342088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.342088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.342088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.356612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:37.357823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:37.378294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb35b8-a697-438e-980e-f2cabcced32e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.414846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.415671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.416024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.416369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.417181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:37.417578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.419000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.435093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 297/599] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:37.435093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.435332 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 303/600] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:37.435332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.534105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ce794-64c4-4338-b043-4f52cfb59bf3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.537582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7d22-39e0-4198-9148-021ffd541ee9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.567059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.567880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.568166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.568444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.570468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.571521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.571858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.572304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.578943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.580497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.588362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=46f6dffd311b4df69ae3c89ab41e8738, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.589898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.597639 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:37.599251 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 298/601] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:37.600086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.612674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 304/602] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:37 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:37.612674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.716493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39cf57-4a80-4b4d-92ef-e76f20dec92a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.746285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebe956-61da-4333-b877-625c821d60f4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.753193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.754163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.754526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.754919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.767753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:37.775219 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:37.776660 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 305/603] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:37.777550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.785079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.785984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.786341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.786689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.794710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.796304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.810400 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:37.812614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 299/604] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:37.813951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.886563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f41e3-7747-4a2c-a913-98a84e67c641 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.921256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca025c-8c79-4a0e-a8f4-56511d9af35e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:37.921709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.922655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.923161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.923642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.924599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:37.925125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.926715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.939997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 306/605] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:37.941208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:37.961154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:37.961827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:37.962111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:37.962393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:37.963155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:37.963566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:37.964986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:37.974193 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 300/606] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:37.979312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.066405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b19f-84ee-480e-aba2-f4d176fa29c9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.082774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909190b-c2b4-471e-bb73-5b6304d64d25 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.105945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.106915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.107338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.107735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.108685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:38.108998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.111034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.116541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.117333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.117615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.117892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.123842 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 307/607] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:38.124730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.130841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.131943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.154512 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:38.157106 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 301/608] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:38.158069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.235542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4658a-1ec1-4729-b12a-463c07d05a79 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.269278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.270330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.270753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.271166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.275601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805b2ba-d25e-4196-b6ac-afc1149cbf8b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.282189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.283837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.300759 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:38.302479 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 308/609] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:38.303449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.316307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.317677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.318065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.318445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/64e876b0e0844090aa652c98af67ab8b/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.342261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=64e876b0e0844090aa652c98af67ab8b, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.343859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.363261 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 302/610] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:38 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/64e876b0e0844090aa652c98af67ab8b/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:38.365755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.414502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5836e0-704c-4619-a9c9-a2069d9f0572 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.465413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.467062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.467461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.467848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.473082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:38.473733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.475433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.503212 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 309/611] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:38.509089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.525931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb783-6833-462e-8488-e496f5a32aea None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.600999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.601959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.602203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.602705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.603539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:38.604304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.606202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.628111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 303/612] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:38.629242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.662824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74640-3674-47a7-a6a4-16f3bdcc6fb7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.707478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.708617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.709039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.709450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/f4e42d69072d4f629c21c41a879dc01d/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.729203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=f4e42d69072d4f629c21c41a879dc01d, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.731373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.744019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e1559-ecee-4ae3-bdd0-8faf7e272539 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.760805 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 310/613] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:38 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/f4e42d69072d4f629c21c41a879dc01d/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:36:38.784015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.784955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.785289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.785573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.794355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.795910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.811431 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:36:38.813591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 304/614] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:38.819601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:38.930132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71159c-a01b-4def-b415-c8ddb89717ae None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:38.967690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:38.968277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:38.968596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:38.968878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:38.969795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:38.970162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:38.971612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:38.990927 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 311/615] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:38.996609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:39.103767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192ff8-de73-4813-b782-353f71893df7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:39.138155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:39.138951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:39.139235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:39.139518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:39.151476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:39.152983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:39.169931 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:39.171494 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 305/616] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:39.177642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:39.279344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eddb4d-5a91-44d8-8d2a-de37b8a91466 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:39.313790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:39.314457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:39.314744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:39.315022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:39.315755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:39.316064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:39.317475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:39.329766 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 312/617] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:39.335552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:39.438909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f839326-7774-4667-a0fb-5fa6e0b909b7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:39.477150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:39.478019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:39.478307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:39.478588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:39.486584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:39.488058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:39.502765 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:39.504255 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 306/618] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:39.509847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:39.612488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea518a6-ec13-448e-b321-487af9c918ea None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:39.646873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:39.647536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:39.647822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:39.648098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:39.648917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:39.649233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:39.650661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24ca0e-0d04-42f7-aa66-bb39a60fdf0d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:39.663665 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 313/619] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:39.669470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:39.770972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e10a3-c6b4-47bc-a306-e0cfedbd425f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:39.806811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:39.807717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:39.808001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:39.808278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46a7aa639ada47bd8cdf615e9a7a5961/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:39.824532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=46a7aa639ada47bd8cdf615e9a7a5961, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:39.825998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628888-18c6-4103-9821-d57f9159af78 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:39.845474 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 307/620] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:39 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46a7aa639ada47bd8cdf615e9a7a5961/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:40.041345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd19f-3314-44f6-81e8-a75d0bc41d83 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.041345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd19f-3314-44f6-81e8-a75d0bc41d83 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.041345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbd19f-3314-44f6-81e8-a75d0bc41d83 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.042378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 314/621] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:40.051443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a73f-6f17-4f2e-9e78-bf62b5a79446 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.051443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a73f-6f17-4f2e-9e78-bf62b5a79446 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.051443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a73f-6f17-4f2e-9e78-bf62b5a79446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.069023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dea0a73f-6f17-4f2e-9e78-bf62b5a79446 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:40.070562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dea0a73f-6f17-4f2e-9e78-bf62b5a79446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:40.159022 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 308/622] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:40.199459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd19f-3314-44f6-81e8-a75d0bc41d83 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.262394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bcf-5c31-4ae1-8d27-8300f5ab94ec None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.262706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bcf-5c31-4ae1-8d27-8300f5ab94ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.262946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bcf-5c31-4ae1-8d27-8300f5ab94ec None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.267754 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 309/623] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:40.271846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.272136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.272414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.292635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:40.294537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:40.334097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbd19f-3314-44f6-81e8-a75d0bc41d83 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:40.398772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:40.399569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.399842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.400120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.404618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 310/624] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:40.426303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.429332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:40.436344 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:40.437801 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 315/625] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:40.445404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.608392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125354a-bbd2-4c49-aab0-7c9224727372 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:40.634629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b298e5-b250-4b7e-b4df-b11b1ff42db9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:40.646539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:40.647665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.647955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.648284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.649071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:40.649382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:40.650762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:40.661017 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 316/626] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:40.667416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.704859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:40.705707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.705998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.706274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.741343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:40.748388 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:40.749922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 311/627] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:40.755486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.830104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87f88-2b2b-4f4a-bd3e-530d8f6823a9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:40.885444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:40.886166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.886452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.886725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.898189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:40.899812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:40.912707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91d9e7-4108-4279-80b2-ff2e6bbc7839 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:40.917874 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:40.919413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 317/628] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:40.924464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:40.982384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:40.983056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:40.983341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:40.983618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:40.984378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:40.984741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:40.986174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.003863 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 312/629] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:41.009842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.071665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199e3d1-9778-4d52-b50b-8fed6100a939 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.113414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.114128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.114566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.114982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.115707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:41.116021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.117613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.131467 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 318/630] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:41.136574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.214930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb4137-070a-466d-a13c-5f48c648a57e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.278914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.279718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.279998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.280274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.296730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.298268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.315315 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:41.316853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 313/631] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:41.322559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d830b-7394-4347-96b4-307602ed802b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.328211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.363474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.365076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.365562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.366104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.374566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.377114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.400224 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 02 20:36:41.401534 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 319/632] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:41.407301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.472579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d869782-ce8a-40a6-86eb-f2246ded7a65 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.507417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.509818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.510383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.510864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.511878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:41.512479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.514340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ced703-ee33-4ac3-bb42-eef20f38dd6e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.542162 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 314/633] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:41.543601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e835-e0da-4be9-83c1-6e4c646508e1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.543889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e835-e0da-4be9-83c1-6e4c646508e1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.544270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e835-e0da-4be9-83c1-6e4c646508e1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.551524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 315/634] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:41.552421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e835-e0da-4be9-83c1-6e4c646508e1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.576209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1890a15-5b89-4523-aeb8-0cdcdf17a127 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.618273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.619102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.619386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.620121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.621133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:41.621575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.623912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a500605-b0a0-4fa7-a6be-5bbe8d7bbd07 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.648060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 320/635] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:41.649372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.649660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.649937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.661089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e835-e0da-4be9-83c1-6e4c646508e1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.666048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:41.667241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:41.700933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.701888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.702909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.703225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] PATH_INFO: `/v3/users/nova` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.711917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.713898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.731221 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:36:41.732703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 316/636] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:41.733344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 321/637] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:41.733556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.738751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.855282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6328dc-18c6-4b70-906c-ebb3961ed33f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.864912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc6e1b-8e83-49be-a88d-4d3ed6714791 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:41.889373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.890022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.890301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.890575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.902048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:41.902728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:41.903012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:41.903289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:41.904121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:41.904431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.906114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:41.924826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 322/638] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:41.925602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:41.958719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:41.960405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e6fda-9b6a-43c7-baf9-09802df88d45 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.023070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17d06d-b59f-4368-aead-11688d492edb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.056057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.056910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.057155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.057427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.066489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 317/639] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:42.067577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:42.067687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e549f0-2f6d-4887-8723-9010c70d748c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.067964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e549f0-2f6d-4887-8723-9010c70d748c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.068245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e549f0-2f6d-4887-8723-9010c70d748c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.072568 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 318/640] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:42.072568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e549f0-2f6d-4887-8723-9010c70d748c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.074534 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:42.076011 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 323/641] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.076998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.173705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e549f0-2f6d-4887-8723-9010c70d748c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.174128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7149a34-779a-40ca-937c-4bfdb485b657 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.207001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.207602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.207882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.208155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.213056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.214146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.214684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.215153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.225877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.227641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.244409 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2e2446a0-b684-42cb-a6db-6e93b4d325a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:42.245795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 324/642] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.247099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.247388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.247666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.264477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:42.266236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:42.279401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.280986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.336668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 325/643] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:42.337807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.390389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 319/644] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:42.391282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.447761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c2d12-210f-4724-960c-a5ad73e1fb82 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.481917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.482512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.482792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.483066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.483958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:42.484141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.485554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.493432 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 326/645] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:42.494222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.502578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3c2be-47fe-4fb9-a24b-8c538522d232 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.535764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.536418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.536727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.537016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.537705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:42.538007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.539376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.554897 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 320/646] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:42.554897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.598964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac836cae-253a-4e1e-b363-8088b0fb4060 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.631155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.631959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.632245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.632570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.642397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:42.649383 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:42.654901 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 327/647] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.654901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.662262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931e4c2-1a4c-4533-8e8d-3b8dcc5ef712 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.693887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.694682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.694966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.695243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.706064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.707508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.723765 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:42.724953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 321/648] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.725707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.747016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e60-b192-47bb-a40e-dcb80b3ce667 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.778172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.778952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.779230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.779501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.789412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.790837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.806862 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:42.808002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 328/649] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.808775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.821760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6283a7-146d-4ddc-88bb-905db74ca22a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.855587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.856371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.856689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.856964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.864010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.865487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.878623 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-9827c5e4-7dac-4f0c-a68b-5a32f6d46bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:42.879794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 322/650] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:42.880998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe605a4-58d2-4821-a732-7c0f852ffe70 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.881565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe605a4-58d2-4821-a732-7c0f852ffe70 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.881565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe605a4-58d2-4821-a732-7c0f852ffe70 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.884568 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 323/651] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:42.884568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe605a4-58d2-4821-a732-7c0f852ffe70 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.908322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765968dd-bc65-4ef4-9647-35c0bfa830bf None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:42.939951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:42.940633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:42.940914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:42.941185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:42.941913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:42.942217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:42.943634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:42.951222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 329/652] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:42.952075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:42.982150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe605a4-58d2-4821-a732-7c0f852ffe70 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.014704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.015288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.015599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.015879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.016622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.016931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.018297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.029097 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 324/653] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.029880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.045707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141952-d5a6-4166-8b3c-53f4e000e241 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.079796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.080481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.080768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.081048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.081766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.082082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.083445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a63649-a7d0-4c39-bcaa-c795c5436c9a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.095384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 330/654] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.096595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.096889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.097171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.113415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:43.114597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:43.124835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120000e4-fbd2-4538-8ac8-68aef12696f6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.156033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.157237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.157518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.157887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.158666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.158975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.160402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.171779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 325/655] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.172801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.176793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 331/656] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:43.177502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.269943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04707cbd-da73-465f-890a-f9bd8e5b9762 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.270563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ef5b-435e-4389-9a6a-61379cdb843d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.300895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.301516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.301673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.301955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.302231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.302414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.302574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.302844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.309237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.310673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.311838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.313789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.323850 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:43.325041 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 332/657] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:43.325804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.330315 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:43.336022 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 326/658] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:43.336022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.420695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b13ea5-24fe-4330-99da-40dea724c2f7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.424353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7138-8baf-4a1e-a859-0fafbafe5d36 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.452140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.452983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.453762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.454305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.457687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.458336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.458618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.458892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.459711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=a51bfe290bcb46ca8fbecbaed36d2044) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.460024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.461635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.461816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.463088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.467436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 327/659] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/role_assignments?user.id=a51bfe290bcb46ca8fbecbaed36d2044&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.468198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.476705 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 02 20:36:43.478241 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 333/660] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:43.479198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.582487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff693c-8226-42e4-9765-4d6088aef5d9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.585671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587af3b-dfa9-4be7-982f-38433a2e0295 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.619355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.619698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.620156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.620342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.620632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.620722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.620793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.620946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.621718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.622032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.623503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.633444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:43.647400 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 334/661] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.647587 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:43.647664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.647758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 328/662] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:43.647758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.747583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b209d89-5558-4a76-8eac-0dbf237179c3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.750032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457708-983f-4e32-b735-189318a343a3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.782351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.783057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.783345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.783625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.783885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.784473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.784568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.784793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.784885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.785096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.785802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.786104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.786250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.787433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.798316 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 335/663] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.799115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.805166 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 329/664] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.806224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:43.909040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313f1d-38b3-44a4-9be0-9da6f0327481 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.929329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63aa4-e4d8-4cd0-b4c3-29dafcfd45b7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:43.945106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:43.945810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:43.946093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:43.946514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:43.947446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:43.947798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:43.949438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:43.967431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 330/665] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:43.969488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.003232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.004222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.004773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.005245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.006152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:44.006643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.008290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.023092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 336/666] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:44.024348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.090847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856249b-e548-4616-b35a-ce388c03e6e8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.127362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.128168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.128479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.128775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.136140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60cae8-c3e4-47ff-b879-bd7ea1eae8dc None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.136650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.138293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.153238 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 02 20:36:44.159741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 331/667] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:44.160756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.173777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285911-8226-4e59-be9f-18673e861540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.174678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285911-8226-4e59-be9f-18673e861540 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.175138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285911-8226-4e59-be9f-18673e861540 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.175560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12285911-8226-4e59-be9f-18673e861540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.248403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285911-8226-4e59-be9f-18673e861540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.249809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12285911-8226-4e59-be9f-18673e861540 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.278580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b222dba-240b-45ea-a632-6374885b4093 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.314295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.315312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.315592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.315861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.336686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.338204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.363998 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:44.365565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:44.366353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.390427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 337/669] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:44.391839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285911-8226-4e59-be9f-18673e861540 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.482864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b06d-8aad-4101-add2-8613ef022a9f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.505328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12285911-8226-4e59-be9f-18673e861540 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.526390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.527494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.527678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.528100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.529117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:44.529442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.531805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.540625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.541360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.541758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.542098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.542948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:44.543319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.544769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.552101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 333/670] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:44.552951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.560982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 338/671] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:44.561960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.666783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ec0f3-9a3e-4bce-8dbb-e018b8307459 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.683980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b602-d033-453c-9717-6fd74822b4ed None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.705529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.706243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.706530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.706802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.717314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.719476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.725094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.725750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.726041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.726738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.737267 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:44.738872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 334/672] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:44.739785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.808376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.810017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.853385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140468c-e441-4a12-b166-2ef5b23948dc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:44.901256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:44.902357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:44.902646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:44.903079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:44.912818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:44.914934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:44.924749 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 339/673] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:44.925713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:44.930626 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:36:44.931818 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 335/674] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:44.932604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.041878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cf00-86d6-4c6b-98c1-a2879d5f3058 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.065883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0efbbb-1ad9-4d3b-8dc8-6bd1c6cbbe07 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.081328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.082421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.082966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.083442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.084356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.084891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.086726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.102740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.102740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.102740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.102740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.103549 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 340/675] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.104687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.113019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.114733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.131251 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:45.132623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 336/676] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:45.133188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.207646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de94710-011d-416e-9cd5-80280f172c62 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.236132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea73-078b-44f2-9602-c36893f17e67 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.242709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.243676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.244160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.244664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.245721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.246381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.248058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.271686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 341/677] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.271902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.271902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.272486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.272486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.273720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.280215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.281541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.295469 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:45.301333 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:45.301333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.383896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f42b7-07ea-4685-aa86-92c47b3f8b72 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.400723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca15c-6170-4fb4-9493-b0e2da23f69b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.418834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.419851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.420353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.420855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.421883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.422408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.423970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.434336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.434986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.435265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.435533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.436984 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 342/679] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.438553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.519495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.520972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.539075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b852256-0fad-4fc0-a9da-4d9fc31b8eef None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.575727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.576824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.577336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.577840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.578956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.579488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.581282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.595068 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 343/680] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.596231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.623621 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 338/681] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:45.629305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.700430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a3229-a9ac-4d78-b3d2-d5a42ceda7f8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.723055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5758-c83c-4779-b5ff-7ee954d72878 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.735741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.736831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.737315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.737785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.744880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.746592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.756878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.757532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.757811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.758086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.758894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=64e876b0e0844090aa652c98af67ab8b) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.759202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.760625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.761440 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:45.763115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 344/682] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:45.764256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.772241 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 339/683] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/role_assignments?user.id=64e876b0e0844090aa652c98af67ab8b&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.773212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.876075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2a830-caec-4cfc-9af3-8081d8fd23d9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.879655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62335031-9351-4387-a76b-fd5cdfb14f53 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:45.913563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.914730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.915213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.915317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:45.915841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.915945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:45.916178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:45.916472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:45.917272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:45.917573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.919025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.929300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:45.931107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:45.933220 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 340/684] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:45.938955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:45.949306 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:45.951171 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 345/685] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:45.957338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.063409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbbcd7-a76b-4255-b60a-d728a6539ca5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.083967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8796f-3865-4b14-9a38-b8cbb55bd6a2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.112334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.113197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.113485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.113768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.114938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=f4e42d69072d4f629c21c41a879dc01d) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:46.115257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.116737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3d42-a4fd-4f60-b01b-fdae78ed9d39 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.128559 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 341/686] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/role_assignments?user.id=f4e42d69072d4f629c21c41a879dc01d&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:46.128559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe5d62-e797-4b6e-a468-727bc9150f7e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.128559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe5d62-e797-4b6e-a468-727bc9150f7e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.128559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe5d62-e797-4b6e-a468-727bc9150f7e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.128559 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 342/687] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:46.134768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.135210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.135461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.135562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.135749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.135846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.136028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.136830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:46.137142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.138570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.161908 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 346/688] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:46.167955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.169513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:46.170729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:46.253088 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 343/689] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:46.279582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.380489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d536d-1be3-4e21-8d86-1f624f4bacf5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.404320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da074a-2fed-4151-8264-b06e24486937 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.414803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.415596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.415882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.416157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.423608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.425085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.439497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.439675 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:46.443172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.443172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.443172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.443463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 347/690] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:46.451883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.469710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.471187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.496821 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:46.503133 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 344/691] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:46.504361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.585969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a633e-28ef-43c2-9ff2-d1f840bc94eb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.612062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf6b8-6724-40de-b42d-49f668e8bd95 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.631880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.632995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.633297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.633583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.634672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:46.634984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.637250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.648821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.649482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.649813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.650091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.650813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:46.651118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.652514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.654349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 348/692] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:46.660806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.676489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 345/693] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:46.676489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:46.776214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17814-32ce-4c25-9506-22bb0817b37c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.796401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f287cd-0c74-4d05-850d-c61a123b20b9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:46.809571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.810241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.810523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.810855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.811552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.813657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e5512-9968-46d7-93c4-c902fd00d972 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.835990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 346/694] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:36:46 2022] POST /identity/v3/users => generated 254 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:36:46.837845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769115-5035-486f-9a24-de89c273d11e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.840501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769115-5035-486f-9a24-de89c273d11e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.840501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3769115-5035-486f-9a24-de89c273d11e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.840501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 347/695] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:46.847529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.847832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.847986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.851371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:46.852056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:46.852342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:46.852657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:46.853515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46a7aa639ada47bd8cdf615e9a7a5961) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:46.853833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:46.855335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:46.865962 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 349/696] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:46 2022] GET /identity/v3/role_assignments?user.id=46a7aa639ada47bd8cdf615e9a7a5961&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:46.885352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:46.887186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:47.020981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 348/697] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:47.049589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:47.173638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069238f-5d8d-4f9a-968e-85ad5acfed09 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:47.207154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:47.207956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:47.208241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:47.208534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:47.219434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:47.226372 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:47.227919 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 350/698] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:47.233302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:47.346448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911c9f-0cea-48ee-b755-e297cd7b1cd6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:47.384044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:47.384758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:47.385042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:47.385320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:47.386072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:47.386376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:47.387745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:47.396499 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 349/699] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:47.401908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:47.542998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6935c4-f019-4175-9699-ff0ea39918f7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:47.589130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:47.589926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:47.590214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:47.590494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:47.609516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:47.610965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:47.627749 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:47.629330 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 351/700] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:47.634522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:47.736759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb21ea7-b676-48dd-b64b-93790b6ea7f4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:47.770699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:47.771678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:47.772136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:47.772616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:47.773514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:47.774058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:47.775763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:47.792543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 350/701] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:47.797593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:47.939246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635acdf-eddc-4070-854e-4d91f814f41d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:47.989797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:47.990515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:47.990809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:47.991087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.000753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:48.002194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:48.020414 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:36:48.021938 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 352/702] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:48.027452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:48.184279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f04a-8598-470f-bc01-b254dd5ddfbd None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:48.227737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:48.228791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:48.229392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:48.229812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.230782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:48.231237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:48.232918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:48.259373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 351/703] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:36:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:48.264685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:48.401513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993be63-3c76-47ea-9e89-2b18e5a126fa None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:48.440036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:48.440992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:48.441420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:48.441837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.530010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:48.531958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:48.634672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 353/704] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 20:36:48.639675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:48.784295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c79a9a-850a-4edb-bff0-fd5a37dff964 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:48.838956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:48.839829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:48.840111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:48.840384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.857743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:48.859231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:48.879713 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5172e87c-3ab3-4fd6-9ee8-b54977f38292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:48.884558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 352/705] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:48.886343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:48.951041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d0d5-67f3-43f7-aa99-bf5afa9b2a6e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:48.951385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d0d5-67f3-43f7-aa99-bf5afa9b2a6e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:48.951620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d0d5-67f3-43f7-aa99-bf5afa9b2a6e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.953912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 353/706] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:48.961474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:48.961759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:48.962039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:48.988470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:48.989788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:49.007045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f537-a750-44c0-a72c-7e0b71232d2d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.048076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.048693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.048980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.049261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.049988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:49.050297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.051676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.074550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 354/707] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:49.080827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.118713 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 354/708] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:49.153684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.240115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a93ef-5b3a-4b92-9a62-25ae754d40fa None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.282535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aacb56-04a5-401e-b42e-4d78f5d06d22 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.289113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.290168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.290598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.291079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.298265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.299887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.314464 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5ec3a6e4-b131-47f6-b0f7-2cea59e7b8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:49.320583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 355/709] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:49.320583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3565c4-0b23-4f89-9482-ddcbe117762a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.320583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3565c4-0b23-4f89-9482-ddcbe117762a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.320583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3565c4-0b23-4f89-9482-ddcbe117762a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.322306 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 356/710] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:49.323789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3565c4-0b23-4f89-9482-ddcbe117762a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.326433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.327425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.328552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.328968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.330198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.331988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.348889 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-fcb219a8-c182-4dda-a28c-3e9f592d6e88 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 02 20:36:49.350564 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 355/711] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:49.351823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.352442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.352941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.373078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:49.375209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:49.448569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 356/712] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:49.449780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.450829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3565c4-0b23-4f89-9482-ddcbe117762a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.496719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.497779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.498264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.498740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.499780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:49.500307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.501990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.514587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 357/713] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:49.516290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.579167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876072b-c960-4b10-9f94-f210b27fd584 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.614094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.615006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.615435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.615853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.616742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:49.617218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.618741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.618856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebb5d0-e713-4fc2-99f1-1418b793b7ea None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.623892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 357/714] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:49.625434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.662513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.664369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.664825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.665489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] PATH_INFO: `/v3/services/network` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.666285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.668492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.684937 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 02 20:36:49.688526 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 358/715] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:49.689575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.745237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331df95-b613-410b-84e6-d0cdff23db0d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.779528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.780186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.780492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.780879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.781666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:49.781981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.783398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.796643 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 358/716] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:49.797656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:49.798743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01b97-70dd-41ab-bd30-c1ac22daa72f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:49.836207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:49.837276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.837784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.838260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.839174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:49.839703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:49.841448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa7a3e-00c6-4dac-bb23-6371e9d3075c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:49.848237 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:49.861827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9b09-93bb-4c6e-8da4-39294f050d44 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.862136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9b09-93bb-4c6e-8da4-39294f050d44 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.862403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9b09-93bb-4c6e-8da4-39294f050d44 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.869066 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 360/718] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:49.872210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:49.872526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:49.872810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:49.901886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:49.904004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:50.000689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483daf4d-7db4-4660-8418-0c48ff18925a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.069273 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 361/719] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 20:36:50.081422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.082110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.082397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.082713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.083397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:50.083708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:50.085428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780e39-fa44-4fac-9a69-9d0a0fe022c2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:50.092650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 359/720] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:36:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:50.098384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.103226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713940-6bf8-4195-b3c7-503d0ff641e6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.103568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713940-6bf8-4195-b3c7-503d0ff641e6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.103856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d713940-6bf8-4195-b3c7-503d0ff641e6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.108250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 360/721] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:36:50.112270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d713940-6bf8-4195-b3c7-503d0ff641e6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.209103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5a9e7-4e87-487b-8848-d070e9710925 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.246066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.247113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.247620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.248157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.249158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:50.249747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:50.250142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d713940-6bf8-4195-b3c7-503d0ff641e6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.251650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc91a2-e152-4345-9379-6f59fec092a3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:50.256910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 362/722] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:50.258405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.258950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.259462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.279025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:50.280702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:50.302887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.304618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.306092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.308130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.335671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:50.351254 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:50.353838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 361/723] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:50.360339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.420092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 363/724] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:50.468325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.475790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32f79-c4da-4047-bc5a-19e25b066251 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.520994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.521671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.521956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.522232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.523362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:50.523681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:50.525724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:50.540624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:50.542841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.634662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb757-8de9-481e-8be1-2fa242999461 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.654716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69588bd-94a9-4de3-942d-93767a6c0d9a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.691513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.692691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.693185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.693665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.706368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:50.708139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:50.723390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.724243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.724675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.724996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.728182 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:50.730200 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 363/726] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:50.736078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.753415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:50.762876 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:50.768545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 364/727] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:50.777650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:50.909429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737780e-cd89-4a3f-8194-5ce86212e3a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.959448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4eac-7924-4486-b293-7532dd0ea4f8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:50.978705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:50.979379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:50.979873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:50.980153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:50.980898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:50.981206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:50.985455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.008780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 364/728] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:51.014759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.035915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.036983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.037474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.037971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.038918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:51.039426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.041051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.059897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 365/729] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:51.065516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.189408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52c99-f557-40cd-a5e0-9e8bf6b7b9bb None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.220437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0639d-c25d-48dd-9975-915cc664f6a7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.256490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.257338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.257689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.257894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.270110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.271127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.271578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.272621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.273112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.273609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.288301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.289009 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:51.294603 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:51.295183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.301458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.311014 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:36:51.313358 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 365/731] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:51.318889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.404785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31683-c289-4f07-9325-3890dbdebefe None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.424694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214209-4334-4b11-92cf-7b1eaa796fdc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.453308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.453983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.454186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.454728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.455192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:51.455502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.456903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.463401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.464328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.464861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.465338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.466357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:51.466872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.469025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.477836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 367/732] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:51.492171 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 366/733] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:51.496510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.497899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.597472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce2ea-ef96-417a-b0a7-b55ce70bb506 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.632912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.634311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.634810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.635290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.703289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153a5a-ad32-40b4-b2a9-bb066160c9ce None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:51.728246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.729658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.774704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:51.775506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:51.775786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:51.776061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:51.786791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:51.788973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:51.812322 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:36:51.814013 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 368/734] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:51.825398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.884909 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 367/735] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:36:51.892488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:51.990196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee02332-11f5-49f6-b328-34bc55961fbe None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.029817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.030494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.030838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.031123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.031947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:52.032252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.033708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.052157 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 369/736] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:52.058733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.092675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a2d6-e6d5-4b92-9769-34e2f38005b2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.141292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.142087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.142363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.142628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.165831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.167323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.196787 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:52.198551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 368/737] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:52.204056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.243090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d787-1077-405e-bd42-ea428b990548 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.297178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.298220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.298720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.299235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.315551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32945b-06ef-461a-9cdb-ccb59d63dbd7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.350518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab090577-649c-48bb-8332-511f5948182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.351566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090577-649c-48bb-8332-511f5948182e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.352055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090577-649c-48bb-8332-511f5948182e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.352560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab090577-649c-48bb-8332-511f5948182e None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.353479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab090577-649c-48bb-8332-511f5948182e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:52.354022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab090577-649c-48bb-8332-511f5948182e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.355581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab090577-649c-48bb-8332-511f5948182e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.367691 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 369/738] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:52.373232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab090577-649c-48bb-8332-511f5948182e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.412551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.414035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.480960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab090577-649c-48bb-8332-511f5948182e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.515793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.516992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.517486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.517983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.525260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.526953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.527100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 370/739] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 02 20:36:52.537491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.558846 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:52.560070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 370/740] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:52.567560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.669116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e374a6-0ca0-4757-8af8-0d05328f31c6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.721334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.722146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.722430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.722707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.734648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.736099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.743320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357f36-f1f8-4f72-93d5-e6a4bfde80cf None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.753491 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d8b4dbfc-60f6-402e-964a-877f6d8df7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:52.754689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 371/741] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:52.755958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a0d8-aecb-441c-871f-6acb2980a286 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.756488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a0d8-aecb-441c-871f-6acb2980a286 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.756986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a0d8-aecb-441c-871f-6acb2980a286 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.759081 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 372/742] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:52.760339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b6ff-c551-4798-a9d1-d332900f0ce5 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.760644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b6ff-c551-4798-a9d1-d332900f0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.760921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b6ff-c551-4798-a9d1-d332900f0ce5 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.762592 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 373/743] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:52.767701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b6ff-c551-4798-a9d1-d332900f0ce5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.785309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.785980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.786270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.786546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.787323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:52.787631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.789105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c67b6-1f76-4d5b-8bc1-8b09ad26fa5b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.800995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 371/744] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:52.802239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5539-7698-4c80-8ffd-fc7ded04b29f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.802531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5539-7698-4c80-8ffd-fc7ded04b29f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.802810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5539-7698-4c80-8ffd-fc7ded04b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.818687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1fca5539-7698-4c80-8ffd-fc7ded04b29f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:52.819864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1fca5539-7698-4c80-8ffd-fc7ded04b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:52.869616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b6ff-c551-4798-a9d1-d332900f0ce5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:52.896475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 372/745] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:52.896475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.896475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.896475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.902906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:52.904100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:52.919862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:52.920581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:52.920879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:52.921147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:52.922468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:52.922777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:52.924142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:52.935697 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 374/746] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:52.937375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:52.972084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 373/747] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:52.973066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.064200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff227-96e8-4422-a06f-cfcc0a1ef18f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.087093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57753-8e9c-4978-be8b-38e88399701e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.098438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.099101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.099387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.099668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.100643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=eebea99569544b07bb780c71b41de686) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:53.100966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.102391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.107634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 375/748] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/role_assignments?user.id=eebea99569544b07bb780c71b41de686&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:53.108400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.123064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.124596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.125028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.125447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.137227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:53.144795 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:53.146640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 374/749] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:53.147602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.223906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f7e78-b9fe-4890-9b8f-efc53f07ad9f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.258107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ee81e-4f59-4602-a59f-04fca9a573a1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.260628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.261476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.261763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.262039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.270240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.271721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.288969 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-921a9b6c-d9e3-4027-b936-5865e5e6fd5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:53.290204 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 376/750] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:53.291443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eafee-255e-496a-baf4-1da953104daa None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.291731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eafee-255e-496a-baf4-1da953104daa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.292010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eafee-255e-496a-baf4-1da953104daa None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.293871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 377/751] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:53.294436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eafee-255e-496a-baf4-1da953104daa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.295083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.295811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.296097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.296480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.297213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.298596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d38d4-aca4-42c6-854b-0d8c50b77580 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.314587 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 375/752] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:36:53 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:53.315559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.315862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.316144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.334386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:53.335906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:53.432483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 376/753] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 20:36:53.432483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.434094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eafee-255e-496a-baf4-1da953104daa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.491649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.493455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.494236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.494998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.496217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:53.497163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.498906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.510011 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 378/754] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:53.511232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.543865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232a358-2a4f-4b4d-b384-f39017e9bb40 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.582216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.582862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.583154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.583434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.584225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:53.585479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.586296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.608901 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 377/755] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:53.609724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.637217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6277-215e-476d-ad80-d4bc3799d757 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.678898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.680429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.680969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.681697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.682632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.685185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.703730 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 379/756] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:36:53 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:36:53.704970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:53.736807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e380a7-7d93-4ea6-9efd-bab63b9a97d0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.826439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.827273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.827609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.827856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.829852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dadf77-88fa-43c4-bd28-7796b23566b6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:53.850846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.853571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.872008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:53.873441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:53.873922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:53.874429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:53.875494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46a7aa639ada47bd8cdf615e9a7a5961) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:53.876024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:53.878837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:53.885682 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 380/757] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/role_assignments?user.id=46a7aa639ada47bd8cdf615e9a7a5961&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:53.895312 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:53.895312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 378/758] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:53.896765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:54.007238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03ae05-f918-4206-9c8b-e128872d1907 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:54.061294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:54.062870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:54.063331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:54.063863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:54.064849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:54.065340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:54.066948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:54.082277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 381/759] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:54.088025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:54.202012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9134-ce3c-4625-a439-71cd37e6da38 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:54.243756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:54.244588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:54.244871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:54.245144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:54.255986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:54.257478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:54.274203 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:36:54.275720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 379/760] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:54.281557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:54.427690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5bf32-631c-43f8-8222-0797629625cf None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:54.475559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:54.476236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:54.476545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:54.476820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:54.477657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:54.477965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:54.479397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:54.508228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 382/761] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:36:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:54.513604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:54.658824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c149d-75a7-428b-b361-08cb796071c8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:54.698700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:54.699507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:54.699790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:54.700065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:54.720623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:54.722017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:54.742212 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:54.743692 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 380/762] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:54.748803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:54.909017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aec649-33b7-4fdc-9313-6daedd36f7c0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:54.953613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:54.954355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:54.954641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:54.954911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:54.955629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:54.955930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:54.957386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:54.969612 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 383/763] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:54.974842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:55.080993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4aa51-e0f3-4c44-9dc1-75883be2da5c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:55.123244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:55.124031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:55.124875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:55.125161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:55.132013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:55.133505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:55.147660 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:55.149266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 381/764] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:55.154925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:55.286360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e412a-bda1-451e-a2ea-5d19c170c850 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:55.332121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:55.332820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:55.333103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:55.333378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:55.334163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:55.334475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:55.336154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155e96c-e740-4543-be26-e926035c94a8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:55.351781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 384/765] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:55.358028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:55.485882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce61fd4-89e6-4deb-a789-2eb33a052365 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:55.523932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:55.524790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:55.525069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:55.525341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:55.527355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=46f6dffd311b4df69ae3c89ab41e8738, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:55.528749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42051959-a925-42a0-8a4f-c42f5bf3a65a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:55.548939 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 382/766] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:55 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:36:56.154971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebefe-3016-47da-bb9b-c62c12ccf858 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.155711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebefe-3016-47da-bb9b-c62c12ccf858 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.155711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebefe-3016-47da-bb9b-c62c12ccf858 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.157683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 385/767] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:56.174950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.175260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.175506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.199413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:56.200197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64c12-88ae-4bb1-b33d-bf7c9047c1b3 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.200550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64c12-88ae-4bb1-b33d-bf7c9047c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.200683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:56.200844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64c12-88ae-4bb1-b33d-bf7c9047c1b3 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.202949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 386/768] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:56.215534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.215847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.216115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.242641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:56.243851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:56.306247 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 383/769] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:36:56.317999 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 387/770] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:36:56.333842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.362078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.506332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb630-712f-4267-b481-9fa9746b1208 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:56.513475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173d5b-557a-4a32-8466-2ba015308388 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:56.548936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:56.549743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.550028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.550306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.560725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:56.568035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:56.568925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.569032 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:36:56.569208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.569486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.570142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:56.570414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 388/771] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:56.571518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:56.581629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.588439 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 02 20:36:56.590012 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 384/772] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:56.596306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.712676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b789-f8b0-4e6d-b95d-39eefce857ee None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:56.716947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba9159-b9a4-48c4-ac2c-b10e61b702d2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:56.745950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:56.746940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.747401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.747882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.748813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:56.749904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:56.751545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87f86b-7c48-4902-bb6d-6b4c49c07c7a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:56.756252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:56.756872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.756979 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 385/773] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:56.757166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.757425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.758161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:56.758464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:56.759226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624bff-e0f3-4c3b-b095-8925a04c7e82 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.759714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624bff-e0f3-4c3b-b095-8925a04c7e82 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.759829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a0edf-af01-4a77-8f2e-ce30647f477a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:56.760291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad624bff-e0f3-4c3b-b095-8925a04c7e82 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.762673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 386/774] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:56.764056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad624bff-e0f3-4c3b-b095-8925a04c7e82 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.776316 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 389/775] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:56.777656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.777943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.778220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.801673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:56.803610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:56.880833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad624bff-e0f3-4c3b-b095-8925a04c7e82 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:56.889165 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 390/776] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:36:56.890756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:56.915451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:56.916126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:56.916406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:56.916709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:56.917459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:56.917764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:56.919189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:56.925569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 387/777] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:56.931324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.019916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1bc19-dfb6-401e-816d-b7f7037a884d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.032780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c251b25-93e2-4b2c-9464-ed973d5428cc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.062307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.063130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.063515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.063795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.067714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.068813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.069313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.069770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] PATH_INFO: `/v3/services/network` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.070597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.072133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.073594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.075104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.083653 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 02 20:36:57.085702 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 388/778] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:57.086701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.091627 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9d68a5d6-8432-4537-b17b-6f0b905485d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:57.093082 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 391/779] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:57.095066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e0f9-264f-4c60-a510-f8a12658c488 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.095463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e0f9-264f-4c60-a510-f8a12658c488 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.095737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e0f9-264f-4c60-a510-f8a12658c488 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.097761 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 392/780] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:57.098474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115e0f9-264f-4c60-a510-f8a12658c488 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.197402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9518284-8fa4-4d51-abda-32fa3339ab24 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.198286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115e0f9-264f-4c60-a510-f8a12658c488 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.229648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.230312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.230617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.230885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.231653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] RBAC: Adding query filter params (interface=public, service_id=483b14940ae340bc96c6a533bbbcfebd, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.231977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.233373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.234215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.234918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.235206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.235609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.236187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] RBAC: Adding query filter params (name=network) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.236518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.237868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0837-fd61-49d5-b1a2-c414b552ac25 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.248645 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 389/781] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/endpoints?service_id=483b14940ae340bc96c6a533bbbcfebd&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.248645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.248896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.248896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.248896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.248896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.264192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:57.265439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:57.332902 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 394/783] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:36:57.334071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.360869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2e0c7-62a1-425f-af89-3250322eab7b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.394065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.394728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.395015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.395293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.396008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.396324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.397716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.409567 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 390/784] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.410361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.438115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bb21b-84f0-47e2-b3ec-a79b09aad7fc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.476192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.476906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.477182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.477457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.478133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.479499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.484416 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 395/785] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.485206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.532676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a97e-fb20-48d5-a2a0-1ce9b9ce232f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.586434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.587950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.588481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.588960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.589877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.590419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.592858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.604953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f45e-9412-4cbe-bbae-8918f89c1309 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.605603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 391/786] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.606766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.642126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.642988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.643271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.643596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.655624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:57.662926 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:57.664694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 396/787] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:57.665554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.718363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f9717-708a-40af-8a3b-b25d19aeb0a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.760160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.761356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.761356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.761649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.771283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.772865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.782164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78769d-9805-498b-80f7-8ee2c6f344bb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.787084 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:36:57.788651 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 392/788] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:57.789564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.824293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.825454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.826626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.827082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.828056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] RBAC: Adding query filter params (interface=public, service_id=cfca7650cdac4b06ae754e719ed87491, region_id=RegionOne) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.828535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.830098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.844674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 397/789] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/endpoints?service_id=cfca7650cdac4b06ae754e719ed87491&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.844674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.903761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c19e1a-bbf0-4b20-9914-7d147a6a66d7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:57.939155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:57.939825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:57.940108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:57.940387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:57.941183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:57.941490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:57.942846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:57.951751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 393/790] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:57.952879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:57.971747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bce563-940d-4c0f-a32f-0eec86c47550 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.008121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.008885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.009171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.009527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.010324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:58.010636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.012057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.030074 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 398/791] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:58.031324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.077929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14fa25-c504-4603-9511-2b91eb2ec3b9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.121367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.122901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.123361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.124086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.125010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.127253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.140704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab2ed9-e349-4c4a-90a4-16b7d6027878 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.140907 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 394/792] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:36:57 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:58.142057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.209391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.210472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.210755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.211032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.233221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.235539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.268629 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:58.269886 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 399/793] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:58.277979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.348251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6fe6-3eb8-49f8-b788-f8257d89a7b6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.389081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.390809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.391298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.391829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.404351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.406300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.423902 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:58.425785 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 395/794] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:58.427826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f77b-3c91-4c3b-893b-c5c883d04622 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.431288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.462777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.463444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.463731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.464023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.464799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:58.465047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.466423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.478292 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 400/795] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:58.484179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.543878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef1efc-070c-4939-b1ba-2341d0348f51 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.580541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.581632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.582165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.582664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.583575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:58.584079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.585956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9291b-9cb1-4e40-ba4d-5cffde487ef7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.591128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce68a77-5e82-48c2-a222-ae4940b1aae2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.599315 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 396/796] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:58.600897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056847-2f75-400a-a712-18c04e749d80 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.601456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056847-2f75-400a-a712-18c04e749d80 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.601930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1056847-2f75-400a-a712-18c04e749d80 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.604093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 397/797] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:36:58.610668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1056847-2f75-400a-a712-18c04e749d80 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.636506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.638142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.638939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.639472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.650121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.652749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.674344 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-77b169d4-529d-41f2-a656-9fc564a1b662 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:36:58.676935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 401/798] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:58.678425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.679027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.679502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.703696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:36:58.704926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:36:58.733349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1056847-2f75-400a-a712-18c04e749d80 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.778336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.779467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.779950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.780880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 402/799] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:36:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:36:58.781222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.781762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.788769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.791371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.806978 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:58.808781 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 398/800] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:36:58.819979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.902114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff3cd3-26bd-4bd8-9e79-9a7f6de488fd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.935044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.935761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.936047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.936323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.937795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:58.938107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.939530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:58.950714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7b62-8bf4-4426-aeb8-bfab98fde7ab None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:58.957739 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 403/801] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:58.958553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:58.992351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:58.993937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:58.994429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:58.994931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:58.996062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:58.996936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:58.998307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.016199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 399/802] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:59.017454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.067215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679197d-4865-476b-af74-80c1cd9a2fad None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.109430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.111094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.111850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.112355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.125968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:36:59.128745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3b69-002d-4fc0-8395-bfae13525c1a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.133518 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:36:59.135007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 404/803] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:59.136028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.169748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.170538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.170819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.171212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.182226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.183522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.201306 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:59.207861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 400/804] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:59.208942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.241873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f644a-e799-4b91-9369-f787636951b7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.280840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.282100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.282587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.283061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/eebea99569544b07bb780c71b41de686/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.298538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=eebea99569544b07bb780c71b41de686, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.300541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.312744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54c0a-d255-4d7a-a19e-8b520c172454 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.319046 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 405/805] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:59 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/eebea99569544b07bb780c71b41de686/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:36:59.320396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.392018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.392755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.393035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.393577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.394054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:59.394362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.395732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.419052 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 401/806] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:59.425156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.447991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a131-b814-4f72-b05a-2a7d6d8cf1d1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.496339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.497337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.497795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.498235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.499507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:59.500027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.501833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.516510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 406/807] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:59.529733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.631074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a7655-baf2-4d71-a1b9-6769d7ba5354 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.666494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.667296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.667718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.667846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.679566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.681008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.683605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a1cf-eafc-451f-b567-5ac821363131 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.698128 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:36:59.699787 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 402/808] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:59.705250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.721167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.722276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.722758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.723267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.730670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.732410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.746920 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:36:59.752768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 407/809] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:36:59.755109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.806883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8181c9-b2e3-4f0b-ae90-f91591beb705 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.840538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.841200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.841480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.841755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.842463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:59.843315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.844767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.859870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d87d8-0a67-4968-9c67-3f8ebbdb0ee7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:36:59.861237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 403/810] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:36:59.868769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.896028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:36:59.897122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:36:59.897603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:36:59.898088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:36:59.899082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:36:59.899625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:36:59.901497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:36:59.915079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 408/811] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:36:59.921927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:36:59.996566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c9c8-e9e9-42a4-8d3b-67a61a7f866b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.034756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.035557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.035837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.036882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] PATH_INFO: `/v3/users/nova` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.047696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.049306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.067711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75c37-b5cd-48f5-bca8-2a2c3cf509e3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.079119 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:37:00.080670 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 404/812] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:36:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:00.086226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.103980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.105654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.106346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.107046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46a7aa639ada47bd8cdf615e9a7a5961/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.110032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=46a7aa639ada47bd8cdf615e9a7a5961, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.111706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8fb06-d7d6-4ae8-8a5c-60e971760df4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.128798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 409/813] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:36:59 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46a7aa639ada47bd8cdf615e9a7a5961/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:37:00.130637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f3521-85bb-4e11-896f-a249f980ef16 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.131173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f3521-85bb-4e11-896f-a249f980ef16 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.131652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f3521-85bb-4e11-896f-a249f980ef16 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.134654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 410/814] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:00.155970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.156630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.157139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.188150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:00.190881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:00.274877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2df1-586a-4bf0-8992-1eed606d722f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.313107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.314174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.314662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.315139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.316180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:00.316955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.318716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.338580 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:00.344667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.361378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 411/816] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:00.393457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.502673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10a2c-81c7-47f1-98db-62b6cc557860 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.556159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408318f-6780-4df8-92e4-b4d48d264a72 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.575607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.576660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.577881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.578380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.627390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.628206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.628502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.628781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.629434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.630792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.648929 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 02 20:37:00.650421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 412/817] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:00.656749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.720171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.721652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.816367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0119b-cb25-45f2-a5b8-c7c18557f063 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:00.868403 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 406/818] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:00.874463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.894335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:00.895007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.895291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.895569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.896277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:00.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:00.898002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d442ec-d8cf-4768-8ad9-41de09bd8a6b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:00.902856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 413/819] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:00.904123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659efb92-dc7d-4b20-b196-db0ef99222a9 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:00.905054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659efb92-dc7d-4b20-b196-db0ef99222a9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:00.905054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659efb92-dc7d-4b20-b196-db0ef99222a9 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:00.912681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 414/820] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:00.913539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659efb92-dc7d-4b20-b196-db0ef99222a9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:00.994454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d597d20-eae8-4648-a6eb-f3e3fc52b616 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.019959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659efb92-dc7d-4b20-b196-db0ef99222a9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.038681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.039480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.039765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.040483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.053150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.053907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.054572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.054727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.054867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.055122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.055875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:01.056187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.058096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc051fe-6b65-4619-b5ab-71261b4bfd29 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.064607 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 415/821] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:01.065843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.066181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.066516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.083584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:01.085037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:01.085946 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:01.088563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 407/822] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:01.089402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.156295 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 416/823] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:01.157654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.196850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06d93-3b93-44b1-aa26-4b5ad0e8fe4f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.232501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.233198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.233528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.233809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.234550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.235924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.257081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6c9d-bf0f-4c19-bfde-b4c6787d899d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.261083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 408/824] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:01.261929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.323377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.323972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.324299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.324610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.325361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:01.325673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.327080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.353930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 417/825] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:01.360679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.379760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f9cf7-2590-46a3-9154-1aebac173811 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.441236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.442117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.442415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.442694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] PATH_INFO: `/v3/services/network` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.443408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.444847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.470076 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 02 20:37:01.471541 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 409/826] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:01.479188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.517671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b02e93-69c3-41c0-ac01-884a703b689c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.557391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.558197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.558479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.558755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.568813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.570479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.589642 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:01.591072 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 418/827] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:01.599007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.640747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089184-e5c4-4461-8462-5b1b02c3a442 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.691536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.692257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.692572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.693590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.698410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] RBAC: Adding query filter params (name=network) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:01.698731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.700117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.711648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 410/828] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:01.716245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.745432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf666-b4e2-4ba0-ac92-499a36e92dab None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.804927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.805639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.805922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.806194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.806981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:01.807287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.808964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.833641 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 419/829] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:01.841211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:01.898596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b68f77-e32e-4c09-ae85-8474a01f0470 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:01.958033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:01.958728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:01.959017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:01.959557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:01.960290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] RBAC: Adding query filter params (type=network) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:01.960631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:01.964810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:01.971312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 411/830] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:01.979765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:02.041555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992958-2e8b-42b7-a0dd-8f8a1973ba1c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:02.101105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:02.101693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.101981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.102259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.103087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:02.103400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:02.104856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885355ca-a25f-4c82-9933-1775fa23a603 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:02.117464 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 420/831] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:01 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:02.150507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5a69-812d-41b5-b201-b17a9a914511 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:02.192376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:02.193089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.193376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.193662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.194409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:02.195799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc694a-b468-4c6a-be28-b1dc4e0e2281 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:02.227466 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 412/832] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:02.398261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53684199-b4bb-4fa8-beba-75c207a1f993 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.398958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53684199-b4bb-4fa8-beba-75c207a1f993 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.399475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53684199-b4bb-4fa8-beba-75c207a1f993 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.401850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 421/833] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:02.409294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.409996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.410486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.429678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:02.431384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:02.528860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 413/834] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:02.556621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53684199-b4bb-4fa8-beba-75c207a1f993 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:02.687749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53684199-b4bb-4fa8-beba-75c207a1f993 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:02.722934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:02.724113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.724583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.725069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.737028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:02.744410 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:37:02.746079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 422/835] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:02.753685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:02.857481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd5b9e-278a-452f-82a1-0523b5c11a6d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:02.892296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:02.893346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.893850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.894336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.895284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:02.895802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:02.897395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711a6bb-2750-4a64-86e6-3fc3115fcdf7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:02.906663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 414/836] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:37:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:02.912971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:02.971008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daca7f-308b-4716-97ae-7534b2637e8a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.971189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daca7f-308b-4716-97ae-7534b2637e8a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.971476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daca7f-308b-4716-97ae-7534b2637e8a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.976093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 415/837] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:02.980327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:02.980655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:02.980940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:02.998072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:02.999304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:03.024989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa4fc7-6126-4ca9-abda-ad15eeeeab3e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.072488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 416/838] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:03.072666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.072666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.072666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.072666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.081877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.083375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.093541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.117354 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:03.124014 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 423/839] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:03.125345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.214196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca2ff0-e82f-40d9-9da7-2ff9acc13506 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.246231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae93ce-1787-4460-871e-2611a670263f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.260238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.261519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.262001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.262826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.276635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:03.284274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.284987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.285267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.285549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.286266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:03.286541 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:37:03.286650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.287924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.288626 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 417/840] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:03.293857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.300812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 424/841] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:03.305892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.408536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0e7b-1f25-443d-a1ca-1350b7d390e3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.430098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29c2a-4573-4e02-94e6-65745342ff57 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.442925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.443896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.444443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.444968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.445914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:03.446435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.447989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.457000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 418/842] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:03.463818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.470457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.471287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.471575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.471857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.479829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.481319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.495558 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:37:03.502133 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 425/843] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:03.503455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.568780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b82d-b47c-4b43-a087-a0bccb369b04 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.603743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.604776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fe20e-5879-4781-b34a-513995e742ba None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.605297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.605724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.606163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.621241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.623623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.642457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.643325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.643714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.644108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.645133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:03.645554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.646918 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:03.647242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.648998 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 419/844] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:03.654719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.677361 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 426/845] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:03.678367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.758137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7786f8-3de6-434e-9d6e-5e3865fdfac3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.778534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870b799-c4b6-44ac-b2ce-b3f2d505e89b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.792302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.793282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.793783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.794257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.795188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:03.796336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.797936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.810437 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 420/846] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:03.815839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:03.819296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.819992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.820816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.821108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.905659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.907905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:03.937279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ecbd3-6001-4173-a02a-14350c6fb02b None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:03.981312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:03.982509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:03.982943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:03.983926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:03.994473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:03.996115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.013466 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 02 20:37:04.015057 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 427/847] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:04.016023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.016146 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 421/848] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:37:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:04.021907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.119371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd58cb5-9e52-429b-9697-da536a0df4f2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.126581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187b4-25a5-4364-8123-6e9278e13d11 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.155756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.156541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.156833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.157114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.157933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:04.158247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.159304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.159663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfb26-7248-49f1-9107-fd77969e1ef5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.160094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.160375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.160677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.171794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.173367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.176569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 422/849] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:04.178026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efc3d-1492-47fe-8660-f24535aa565f None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.178500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efc3d-1492-47fe-8660-f24535aa565f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.178946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211efc3d-1492-47fe-8660-f24535aa565f None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.180745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 423/850] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:04.181986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211efc3d-1492-47fe-8660-f24535aa565f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.192218 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c821b114-0ddf-4a2f-a9fb-eb3e9ec56fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:04.196822 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 428/851] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:04.196822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.196822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.196822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.212527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:04.213730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:04.279523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 429/852] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:04.289336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.297931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211efc3d-1492-47fe-8660-f24535aa565f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.335122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.335780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.336066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.336352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.389669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c605b-697f-4df4-90eb-b3cc7d6b1136 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.402339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.403794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.423334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.424175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.424288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.424597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.425344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:04.425621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.427002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.440980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 430/853] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:04.442234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.506432 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 424/854] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:04.507611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.544200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a085ef-32b2-44a5-aecc-0c14c44ffe3e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.577260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.578058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.578346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.578615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.579263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.580665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.591721 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 02 20:37:04.596611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 431/855] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:04.597731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.608808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a179e4b-519e-4355-912e-652b2793f2cc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.646013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.646915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.647201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.647476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.654017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.655437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.668613 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:04.674940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 425/856] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:04.674940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.701150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5bcac-cd53-4471-8f27-3c790c80c061 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.738732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.739583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.739875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.740155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.751114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.752597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.769088 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:04.774704 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 432/857] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:04.774704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.774928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210de76-d3e9-4bdc-ba32-b84853d342a9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.805417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.806013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.806302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.806580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.807279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:04.807595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.809057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.814204 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 426/858] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:04.815045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.870979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc218-ed1c-43de-963e-701eb161fe11 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.903340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.903991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.904278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.904586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.905400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:04.905712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.907134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b398a-3c9e-411b-9269-0f571cd85ae7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.908557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273dc8-6941-4380-a79d-fda13f0313ae None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:04.918714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 433/859] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:04.920028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799248-c2c2-4274-8658-1773db390b52 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.920319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799248-c2c2-4274-8658-1773db390b52 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.920673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799248-c2c2-4274-8658-1773db390b52 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.922331 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 434/860] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:04.923025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799248-c2c2-4274-8658-1773db390b52 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:04.942113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:04.942781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:04.943071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:04.943351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:04.944066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:04.944381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:04.945785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:04.957650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 427/861] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:04.958449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.027895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799248-c2c2-4274-8658-1773db390b52 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.051537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5686b6-78e5-4f6b-acdb-f64625a46dc4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.059379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.059979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.060265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.060567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.061811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.062118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.063490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa88a74-dd53-4254-9b12-b94fea420cc9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.067710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 435/862] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:05.068907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.069196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.069476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.087354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:05.088631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:05.101621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.102297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.102578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.102851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.103680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=eebea99569544b07bb780c71b41de686) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.103994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.105487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.111794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 428/863] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:04 2022] GET /identity/v3/role_assignments?user.id=eebea99569544b07bb780c71b41de686&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:05.112663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.212632 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 436/864] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:05.235200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.258015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06052-eff0-4f76-8d3b-b6c3c273b25a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.302541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.303365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.303649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.303927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.318274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.319678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.336082 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:05.337592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 429/865] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:05.343549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.365592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7df02-3a9c-489f-ade2-5b756f21b102 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.410683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.411518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.411811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.412067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.412802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.414507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.426229 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 02 20:37:05.427590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 437/866] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:05.433331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.463762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6538-adc1-4c50-8fd7-986c58e8f57a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.500987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.501656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.501945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.502224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.503005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.503323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.504771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.522288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 430/867] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:05.523636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.542622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb43e90-3a5a-4883-a77c-cfbb4d4b1b65 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.577473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.578459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.578961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.579468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.580407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.581011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.582585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.587979 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 438/868] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:05.594038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:05.622912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3f9d3-c255-4cd3-aa7c-35be7738ac4f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.662992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.663801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.664090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.664370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.665231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46a7aa639ada47bd8cdf615e9a7a5961) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.665544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.666966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ded73-b0a8-4d1d-b984-82314c61a2c5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.680565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 431/869] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/role_assignments?user.id=46a7aa639ada47bd8cdf615e9a7a5961&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:05.700949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a7b85-bd96-4578-877e-0236ed590ad3 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:05.738232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:05.739039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:05.739226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:05.739458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:05.740171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:05.740499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:05.741967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fc824-d0cb-4934-982c-3dddbf0fa797 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:05.747475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 439/870] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:07.519614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d0e4-116e-475c-90b6-201b8eb97acc None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.520151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d0e4-116e-475c-90b6-201b8eb97acc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.520151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6d0e4-116e-475c-90b6-201b8eb97acc None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:07.522101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 432/871] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:07.528997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0706e9-f290-4714-a4f9-4e4c880483c3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.529927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0706e9-f290-4714-a4f9-4e4c880483c3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.530432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0706e9-f290-4714-a4f9-4e4c880483c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:07.548275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cf0706e9-f290-4714-a4f9-4e4c880483c3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:07.549789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf0706e9-f290-4714-a4f9-4e4c880483c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:07.621202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 440/872] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:07.646365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6d0e4-116e-475c-90b6-201b8eb97acc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:07.706923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60afd9-9199-40b8-9284-2a076bbd5313 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.707559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60afd9-9199-40b8-9284-2a076bbd5313 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.708036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60afd9-9199-40b8-9284-2a076bbd5313 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:07.710533 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 441/873] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:07.721442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.721726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.722007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:07.739674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:07.740934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:07.761278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6d0e4-116e-475c-90b6-201b8eb97acc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:07.800512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:07.801550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.802034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.802510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:07.803428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:07.805030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:07.824032 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 433/875] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:07 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:07.832740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 442/875] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:07.841715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:07.946340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956724c-2852-42a5-8b3c-423bd9782956 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:07.990358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:07.991103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:07.991398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:07.991668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.003981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:08.011943 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9d07caf1-a1a7-4134-868e-b4cd452d715e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:08.013574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 443/876] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:08.019936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.123742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05261d00-26a0-4940-bba6-e218f6ee84c3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.144386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449af93-ba61-41e3-8dce-0748fd0be5c8 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.144722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449af93-ba61-41e3-8dce-0748fd0be5c8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.144994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449af93-ba61-41e3-8dce-0748fd0be5c8 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.147005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 444/877] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:08.153441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b2ae-9739-462d-abb0-ddbec06ad3ad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.153933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b2ae-9739-462d-abb0-ddbec06ad3ad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.154221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b2ae-9739-462d-abb0-ddbec06ad3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.159715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.160446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.160837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.161123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.161898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:08.162211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.163735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4742187-f2f4-4b47-ba7a-2ff7fc83cfa4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.172370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c461b2ae-9739-462d-abb0-ddbec06ad3ad None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:08.172845 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 434/878] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:08.173581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c461b2ae-9739-462d-abb0-ddbec06ad3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:08.173951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942718-972d-4f66-adab-991aba56527f None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.174245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942718-972d-4f66-adab-991aba56527f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.174523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942718-972d-4f66-adab-991aba56527f None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.176299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 435/879] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:08.181612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942718-972d-4f66-adab-991aba56527f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.246696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 445/880] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:08.248357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.249257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.249540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.266627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:08.268379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:08.299101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942718-972d-4f66-adab-991aba56527f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.333016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.333572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 446/881] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:08.333878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.334480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.334762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.345138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.345351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.346977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.364817 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:08.366017 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 436/882] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:08.366848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.448131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa106c18-90b9-482f-93e8-bf6dee28f26a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.464559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9da8-33d9-4f2c-afbc-2662b3a69e68 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.485217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.485883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.486174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.486455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.487164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.488557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.498711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.499457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.499749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.500027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.500707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.502058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.512853 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 447/883] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:08 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:08.512853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.530373 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 02 20:37:08.536968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 437/884] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:08.539611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.637659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa73d8-fd00-46ef-9c5b-e86bbb85548c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.648634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd75a36-0a85-4793-a1d0-1e13895dc5f7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.676377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.677102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.677391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.677673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.678405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:08.678714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.680112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.687046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.687938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.688373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.688373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.688373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:08.688373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.688373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.697260 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 448/885] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:08.697428 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 438/886] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:08.703132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.703492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.808181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08127-c896-4b78-bc4f-40f7d066d4e4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.809105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6070a-af5f-4b50-a197-bf45c22daba8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:08.843164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.843368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:08.843888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.843994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:08.844174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.844269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:08.844444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.844555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:08.845174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:08.845486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.846931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.851990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 439/887] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:08.852129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:08.853463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:08.868633 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:37:08.870237 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 449/888] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:08.876625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:08.988313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cf4d6-e1a7-4dfb-bf42-eda826997575 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:09.026159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:09.027182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:09.027653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:09.028111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:09.029182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:09.029717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:09.031622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:09.052751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 440/889] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:09.058448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:09.167795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3236be8-e3a8-4741-a140-08aef2d34381 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:09.203000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:09.203969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:09.204438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:09.204925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:09.273224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:09.274972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:09.379017 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 450/890] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:09.384743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:09.489107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95588a7f-0ddb-4bf2-8bf1-2abb7169658a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:09.521802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:09.522596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:09.522876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:09.523150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:09.534180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:09.535662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:09.552141 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:09.553654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 441/891] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:09.559026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:09.661585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650a75f-f097-4e85-9086-3c2b0831d221 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:09.696784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:09.697517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:09.697802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:09.698085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:09.698853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:09.699167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:09.700618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:09.716563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 451/892] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:09.718252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:09.820108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e6d74-782e-4dcc-8a91-b1027edaed31 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:09.856540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:09.857352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:09.857631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:09.858461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:09.866805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:09.868254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:09.881283 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:09.887254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 442/893] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:09.888704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:09.996920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd593c-59ef-4c46-9408-a4f96f3205ac None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:10.036000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:10.036000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.036000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.036000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.036412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:10.036412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:10.036412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988d35-858f-4649-85fe-ae5f14bebfc6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:10.047954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 452/894] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:10.053778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:10.155827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715b68-f1d0-4a21-b6bb-fdb994222534 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:10.193944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:10.195017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.195510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.195990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.197041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] RBAC: Adding query filter params (role.id=94db239e0e3e4ee3ad5f8b904d01e356, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=eebea99569544b07bb780c71b41de686) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:10.197613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:10.199243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33b3d9-8e48-44a1-a03b-388b9f6cb271 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:10.205443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 443/895] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:10 2022] GET /identity/v3/role_assignments?user.id=eebea99569544b07bb780c71b41de686&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=94db239e0e3e4ee3ad5f8b904d01e356 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:10.328371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eab65-2e78-41a9-9990-e638ccfe7882 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.328700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eab65-2e78-41a9-9990-e638ccfe7882 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.328883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eab65-2e78-41a9-9990-e638ccfe7882 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.331085 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 453/896] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:10.339282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.339282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.339282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.357427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:10.359070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:10.428839 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 444/897] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:10.455278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0eab65-2e78-41a9-9990-e638ccfe7882 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:10.559040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0eab65-2e78-41a9-9990-e638ccfe7882 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:10.595016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:10.595754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.596041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.596321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.597003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:10.598471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:10.610347 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 02 20:37:10.611987 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 454/898] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:10.617908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:10.727815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bdb0a-48e0-4258-9eaa-b59d4d934a81 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:10.762726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:10.763406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.763689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.763967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.764718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:10.765033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:10.766403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:10.771477 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 445/899] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:10.777529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:10.886197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f033a-a43a-4fe4-93cf-4797fd2c6e12 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:10.919417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:10.920086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:10.920951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:10.921238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:10.921940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:10.922269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:10.923641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:10.930359 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 455/900] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:10.934885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.046829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c05ed3-b2eb-4be1-8ba4-03855312d555 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.081495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.082167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.082454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.082792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.083576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] RBAC: Adding query filter params (interface=public, service_id=d0b334c469ba480293d618096382f5c6, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:11.084199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.085589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6c312-2c7e-49be-badd-62dfdbb0eabd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.091160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 446/901] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:37:10 2022] GET /identity/v3/endpoints?service_id=d0b334c469ba480293d618096382f5c6&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:11.096943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.121886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ae01-704a-47be-b293-69b13a68d2ab None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.122213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ae01-704a-47be-b293-69b13a68d2ab None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.122464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ae01-704a-47be-b293-69b13a68d2ab None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.124260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 447/902] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:11.132326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.132675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.132960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.157338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:11.159574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:11.214748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8680071-ba56-47f5-b5b3-5ff6c15f064e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.248813 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 448/903] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:11.259714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.260447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.260758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.261039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.261724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.263143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4064a96-d311-41ac-878b-9fe3c0992af5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.269818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 456/904] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:11 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:37:11.274677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.399222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb06d90-2b61-4b91-9300-68445729747f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.418025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d429-a43a-460b-95b9-7e6366e6bcac None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.418656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d429-a43a-460b-95b9-7e6366e6bcac None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.419143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d429-a43a-460b-95b9-7e6366e6bcac None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.421793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 457/905] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:11.429227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.429859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.430343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.436882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.438583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.438583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.438583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.439016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.440365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.451340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:11.453596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:11.456708 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 02 20:37:11.463312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 449/906] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Apr 2 20:37:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:11.465708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.546262 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 458/907] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:11.571843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.584310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f825-f047-4f9b-878f-a03c9e7d4728 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.627747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.628554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.628745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.629016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.629938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:11.630295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.632252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.643596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 450/908] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:11.645329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.698660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02399744-9f61-4721-8a6d-d561caea1f0b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.734536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.734937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.735271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.735549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.736260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.737717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.756499 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 459/909] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:11 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:11.774066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6cff-8918-4207-a3e3-8b8183544585 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.818383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.819114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.819398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.819670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.820375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:11.820721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.822260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.828398 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 451/910] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:11.834615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:11.946374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b2bf-533c-48a5-b8ee-dac76c6558a0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:11.988779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:11.989843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:11.990370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:11.990837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:11.991787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] RBAC: Adding query filter params (interface=public, service_id=cc0aa2cbf29d488bbf387dcad6a078bf, region_id=RegionOne) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:11.992269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:11.993831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6380-a43e-4b85-b1c8-2e8ef3b9ee2a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:11.999377 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 460/911] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:37:11 2022] GET /identity/v3/endpoints?service_id=cc0aa2cbf29d488bbf387dcad6a078bf&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:12.005119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:12.106594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72885-a7ab-4d74-b44a-69c5ed973b5e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:12.139904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:12.140600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:12.140879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:12.141146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:12.141818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:12.143168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821b17-31e1-4349-bf77-0a7e02c25f31 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:12.149580 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 452/912] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:12 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:37:12.681346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd632-aef8-4489-964f-eb1b8b0ca83c None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:12.681633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd632-aef8-4489-964f-eb1b8b0ca83c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:12.682992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd632-aef8-4489-964f-eb1b8b0ca83c None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:12.685279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 461/913] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:12.692328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:12.693212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:12.693710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:12.711785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:12.713283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:12.784614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 453/914] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:12.804817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd632-aef8-4489-964f-eb1b8b0ca83c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:12.908489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd632-aef8-4489-964f-eb1b8b0ca83c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:12.942911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:12.944103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:12.944635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:12.945113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:12.956894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:12.965145 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:12.972036 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:12.973685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.075655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a9667-f858-4778-891a-f24b90a65325 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.110809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.111840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.112346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.112860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.113793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:13.114333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.115881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.129684 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:13.131318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.231590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38598-2b44-4523-a353-e3d20c75715e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.266231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.267368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.267872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.268363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.278691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.280943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.299286 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:13.304553 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 463/917] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:13.307081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.417883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae275f5-f369-4be2-b995-eb38c828269e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.463045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.463910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.464196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.464513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.465207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:13.465513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.466872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.479492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 455/918] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:13.485698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.588013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9144fd2-2db4-45c1-bc71-b25ad70ef953 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.623026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.624821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.625308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.625782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.633534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.635196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.649721 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-997f7a2a-d7d5-4962-b184-c4f67de59dda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:37:13.655982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 464/919] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:13.657599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.710268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dad16-db06-4a7a-81c7-92f2a402ff01 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.710613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dad16-db06-4a7a-81c7-92f2a402ff01 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.710853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dad16-db06-4a7a-81c7-92f2a402ff01 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.713073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 465/920] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:13.719278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47109-2487-46d9-8553-da69829d536d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.719567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47109-2487-46d9-8553-da69829d536d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.719842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc47109-2487-46d9-8553-da69829d536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.737130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5fc47109-2487-46d9-8553-da69829d536d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:13.737831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5fc47109-2487-46d9-8553-da69829d536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:13.774444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc87d-6beb-4a23-a645-d5005922d4a2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.810245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed164-de62-4827-936b-82407d2fecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.811215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed164-de62-4827-936b-82407d2fecda None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.811730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed164-de62-4827-936b-82407d2fecda None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.812227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faed164-de62-4827-936b-82407d2fecda None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.813274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed164-de62-4827-936b-82407d2fecda None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:13.813786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed164-de62-4827-936b-82407d2fecda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.815515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faed164-de62-4827-936b-82407d2fecda None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.820050 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 466/921] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:13.842765 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 456/922] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:13.844521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47109-2487-46d9-8553-da69829d536d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.844793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed164-de62-4827-936b-82407d2fecda None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:13.946369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc47109-2487-46d9-8553-da69829d536d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.949731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faed164-de62-4827-936b-82407d2fecda None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:13.981849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.983408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.983792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.984166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.986755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:13.987793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:13.988240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:13.988700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:13.989531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.991062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:13.995345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:13.996934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.003608 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 02 20:37:14.005478 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 457/923] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:14.015398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.024586 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:14.026178 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 467/924] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:14.034145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.141580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69565-2cbf-46d3-a584-f5f39a81a7b1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.144898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe662fe1-2720-4614-8275-a61c7a887939 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.177186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.178162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.178454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.178737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.179998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:14.180328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.182135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.185627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.186342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.186627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.186904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.187616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:14.187985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.190161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.195669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 468/925] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:14.196197 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 458/926] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:14.205942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.206126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.309317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f11b48-4a83-4c3d-ba10-b120ac7353f0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.314183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee26b-ac90-48d2-9522-fcae43c1448f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.341777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.343037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.343325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.343604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.344302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:14.344648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.346009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974055-5de4-467c-a9be-f5aaca695d30 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.347438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.348226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.348525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.348798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.355540 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 459/927] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:14.355679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.356747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4e42-a89f-468b-a232-6c5c53b00b68 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.356969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.357083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4e42-a89f-468b-a232-6c5c53b00b68 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.357368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4e42-a89f-468b-a232-6c5c53b00b68 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.360501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 460/928] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:14.360501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4e42-a89f-468b-a232-6c5c53b00b68 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.377970 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d85efdd0-f0b7-4ff4-a051-9a2e2166d719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:14.379200 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 469/929] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:14.380394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.380794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.380985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.397097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:14.398265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:14.468586 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 470/930] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:14.476766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4e42-a89f-468b-a232-6c5c53b00b68 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.480028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.513212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.513907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.514197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.514478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.515213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.516697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.544684 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 461/931] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:14.544684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.615498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25f5b-3517-4e02-b469-5370499f8bce None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.659637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6a50-f1a1-4429-aef1-18bd7fb73de8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.659998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.660702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.661030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.661468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.663179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:14.663498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.665009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fa35e-d9b4-40fe-bd92-5cfab434402b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.688954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 471/932] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:14.688954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8e87-9a1e-415f-adfe-36fad16865a5 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.688954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8e87-9a1e-415f-adfe-36fad16865a5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.688954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8e87-9a1e-415f-adfe-36fad16865a5 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.688954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 472/933] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:14.690154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8e87-9a1e-415f-adfe-36fad16865a5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.697559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.698744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.699257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.699752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.700652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.702599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.714920 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5a9dec16-6a29-4b95-8df3-60e04eb63592 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 02 20:37:14.716480 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 462/934] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:14.718425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.718894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.719361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.736210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:14.737508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:14.795594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8e87-9a1e-415f-adfe-36fad16865a5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.802718 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 463/935] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:14.803565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.835021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.835923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.836214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.836531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/eebea99569544b07bb780c71b41de686/roles/94db239e0e3e4ee3ad5f8b904d01e356` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.838709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=eebea99569544b07bb780c71b41de686, role_id=94db239e0e3e4ee3ad5f8b904d01e356)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.840132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.856536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 473/936] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:37:14 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/eebea99569544b07bb780c71b41de686/roles/94db239e0e3e4ee3ad5f8b904d01e356 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:37:14.857401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:14.919378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce077afc-a812-4c45-a50e-edb5bbd90ba9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.961776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:14.962918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:14.963431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:14.964009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:14.965130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:14.965667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:14.967486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:14.970705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d57b8-9091-40be-9c45-f2fffbbecefb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:14.974264 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 464/937] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:14.986021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.008652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.009488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.009776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.010054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.010725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.012134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.024469 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 02 20:37:15.025772 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 474/938] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:15.032091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.102720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1b55-016f-463f-8312-d0b98cf6cc40 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.137352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.138016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.138298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.138566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.139291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:15.139593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.140977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.145982 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 465/939] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:15.151638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.153486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0c7c-6902-48aa-b68b-45a1201cd899 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.198467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.199351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.199637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.199915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.201126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:15.201474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.202896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.210266 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 475/940] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:15.215303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.259017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc2c3-aa28-4ae3-b82b-faf3ce78dba8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.302028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59337-918b-4783-9407-03831c26662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.303070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59337-918b-4783-9407-03831c26662f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.304063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59337-918b-4783-9407-03831c26662f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.304591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59337-918b-4783-9407-03831c26662f None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.305943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59337-918b-4783-9407-03831c26662f None admin] RBAC: Adding query filter params (interface=public, service_id=b7c451c4fb7e4444912afabd3ec4d6d4, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:15.306471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59337-918b-4783-9407-03831c26662f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.308685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59337-918b-4783-9407-03831c26662f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.316510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 466/941] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:37:15 2022] GET /identity/v3/endpoints?service_id=b7c451c4fb7e4444912afabd3ec4d6d4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:15.322695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59337-918b-4783-9407-03831c26662f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.334068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24065f96-62ce-42c5-a74b-4f568703679c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.369094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.369814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.370103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.370382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.371087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:15.371397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.372797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.382903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 476/942] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:15.384232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:15.442685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59337-918b-4783-9407-03831c26662f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.478319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.479326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.479803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.480284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.481228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.483358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39051f89-7b7d-49ee-acb1-a5125a22febb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.487201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4fd04-6234-429d-883d-0b073d3f2004 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:15.496867 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 467/943] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:15 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:37:15.524397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:15.525114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:15.525453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:15.525735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:15.526532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:15.528003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420224fc-8d60-4b82-93ce-0c0f52b267bc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:15.560721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 477/944] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:17.014654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48c8-3cf3-420a-b9ea-c63c4519fc52 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.015657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48c8-3cf3-420a-b9ea-c63c4519fc52 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.016145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48c8-3cf3-420a-b9ea-c63c4519fc52 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.018458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 468/945] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:17.025233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.026114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.026673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.044058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:17.045593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:17.117870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 478/946] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:17.143409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f48c8-3cf3-420a-b9ea-c63c4519fc52 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.246170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f48c8-3cf3-420a-b9ea-c63c4519fc52 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.281310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:17.282315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.282819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.283300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.284211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:17.285900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:17.287477 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.common [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 02 20:37:17.308907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.sql.core [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 02 20:37:17.308907 ncdv-master-1 devstack@keystone.service[97316]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 02 20:37:17.308907 ncdv-master-1 devstack@keystone.service[97316]: [parameters: {'id': '5fb949ab3b5147979e93e1af01ff418e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 02 20:37:17.308907 ncdv-master-1 devstack@keystone.service[97316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 02 20:37:17.325096 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-bb7bbc93-19a1-423d-9a0b-ec364487a78e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5fb949ab3b5147979e93e1af01ff418e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5fb949ab3b5147979e93e1af01ff418e. Apr 02 20:37:17.331086 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 469/947] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Apr 2 20:37:17 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:17.338204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.351006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef72c-4717-4cc1-b6be-d20a7457fdb6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.351334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef72c-4717-4cc1-b6be-d20a7457fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.351577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef72c-4717-4cc1-b6be-d20a7457fdb6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.358850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 470/948] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:17.366025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.366315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.366597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.384927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:17.386553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:17.466553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0412-7fc9-4297-93e4-c9f11e03c0ae None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.467055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 471/949] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:17.491810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.502903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:17.504059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.504585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.505064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.512662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:17.514521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:17.529824 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:17.531882 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 479/950] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:17.538011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.597005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee025b2d-b8e2-4dd5-bc05-4015674630e1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.633262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:17.634510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.634510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.634780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.641098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dbdee-6691-44d6-a743-4db95458a7a5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.647572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:17.658666 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:17.665228 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 472/951] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:17.666637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.685104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:17.686319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.687136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.687624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.688623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:17.689151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:17.691563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:17.720705 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 480/952] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:17.779924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8d1e-b2f5-4d08-be47-9e4d438115ee None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.815995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:17.816643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.816929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.817206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.817961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:17.818269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:17.819790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cb00a-62e7-49b4-b250-28792e51e72f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:17.834155 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 473/953] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:17.835607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:17.915497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433de-12e3-4053-8369-9ad330bb793e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.915497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433de-12e3-4053-8369-9ad330bb793e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.915781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433de-12e3-4053-8369-9ad330bb793e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.917877 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 474/954] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:17.931106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603bfa-51e4-47fa-aee4-ff3c11974acf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:17.931454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603bfa-51e4-47fa-aee4-ff3c11974acf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:17.931678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc603bfa-51e4-47fa-aee4-ff3c11974acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:17.949273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a86a0-4c88-4127-953a-db1f2b708030 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:17.953818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cc603bfa-51e4-47fa-aee4-ff3c11974acf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:17.955034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cc603bfa-51e4-47fa-aee4-ff3c11974acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:18.006611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.007436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.008012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.008012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.020299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.022003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.041792 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:18.043146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 481/955] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:18.049406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.062128 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 475/956] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:18.063700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5b539-f90c-4072-a58a-d9f2cd0d56bf None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.063993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5b539-f90c-4072-a58a-d9f2cd0d56bf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.064274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5b539-f90c-4072-a58a-d9f2cd0d56bf None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.071872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 476/957] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:18.073314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.073794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.074230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.091789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:18.093002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:18.150348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff3e15-7da9-4c3c-b441-e2fdb450d90f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.163254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 477/958] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:18.164329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.193757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.194721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.195189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.195671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.196595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.197089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.198682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.211449 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 482/959] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.212639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.268098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956791d2-0c3a-4451-8f0b-af811665dd57 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.302740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.304095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.304448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.304760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.305410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.306802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.316660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c75b9-7c82-4141-a4e4-a26ba5fa8ce4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.318505 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 02 20:37:18.324516 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 478/960] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:18.324516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.353468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.354261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.354548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.354832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.355509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.356930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.368219 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 02 20:37:18.369585 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 483/961] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:18.375524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.425770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865120-6984-46c3-b85c-868e1ff3f5e3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.467432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.468243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.468639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.468919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.474594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502498e9-ae5c-4164-a5ab-96a63eec7133 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.476234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.477778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.491272 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 02 20:37:18.497133 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 479/962] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:18.497133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.512661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.513414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.513798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.514080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.514779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.515090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.516527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.521462 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 484/963] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.522238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.601505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafe349-e8be-4032-ba3f-d412d0914881 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.620044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338d764-9202-4ede-a222-c9ee0aa5e8da None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.636106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.636814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.637104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.637636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.638094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.638405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.639794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.644544 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 480/964] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.645321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.660954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.662248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.662621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.662973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.663923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.664234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.665732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.687692 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 485/965] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.687692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.752236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a476-a4e4-4353-8b7f-c78c362b9ef9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.783938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8ad8-53b9-4149-98ff-34fe0228d10f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.785429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.786102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.786407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.786669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.787373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.787680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.789100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.793867 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 481/966] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.794641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.831119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.832111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.832640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.833093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:18.834579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:18.835069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:18.837375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:18.852563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 486/967] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:18.852563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:18.927727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cad0c-cd51-4c4c-aeae-947f9306a033 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.963430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18751-dc38-4c78-889d-14aeb6d599bd None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:18.973207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:18.973879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:18.974167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:18.974839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.002022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.002833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.003191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.003579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.004409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.005946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.040713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 487/968] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:19.061075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.062592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.172151 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 482/969] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:19.177686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:19.288962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600029c1-e447-4ab6-a6a2-db18638f9326 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:19.322737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.323535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.323817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.324092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.335405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.336896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.355749 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:19.357317 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 488/970] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:19.362950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:19.465641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b0e3f-837d-4d4e-9549-1c4c56a74b0c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:19.501153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.501816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.502094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.502367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.503078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:19.503380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.504756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.517089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 483/971] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:19.522287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:19.624193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2f0c-f644-4e0c-8a51-2558bcf91e9b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:19.657930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.658737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.659021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.659301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.666330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.667786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.681938 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:19.683429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 489/972] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:19.689199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:19.793641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628acf5e-f5e7-41ab-9cf2-db3663eedca0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:19.828354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.829049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.829336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.829611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.830387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:19.830698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.832116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ff64d-97a6-48ee-8310-97f9fa2d0474 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:19.845576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 484/973] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:19.851172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:19.957195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472950be-c968-4a33-b17a-b5269c4185b5 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:19.991799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:19.992482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:19.992782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:19.993063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:19.993887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] RBAC: Adding query filter params (role.id=94db239e0e3e4ee3ad5f8b904d01e356, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=eebea99569544b07bb780c71b41de686) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:19.994203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:19.995641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec94e-ee30-44c2-8075-f7f77a144ca3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:20.002614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 490/974] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:19 2022] GET /identity/v3/role_assignments?user.id=eebea99569544b07bb780c71b41de686&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=94db239e0e3e4ee3ad5f8b904d01e356 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:20.293396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724991-20a9-4019-87f2-454ec0a821cb None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:20.294098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724991-20a9-4019-87f2-454ec0a821cb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:20.294098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2724991-20a9-4019-87f2-454ec0a821cb None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:20.296572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 485/975] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:20.303088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:20.303573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:20.303743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:20.322896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:20.324081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:20.393318 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 491/976] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:20.420154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2724991-20a9-4019-87f2-454ec0a821cb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:20.522733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2724991-20a9-4019-87f2-454ec0a821cb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:20.555913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:20.556545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:20.556832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:20.557109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:20.557813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:20.559230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:20.574566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.sql.core [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 02 20:37:20.574566 ncdv-master-1 devstack@keystone.service[97316]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 02 20:37:20.574566 ncdv-master-1 devstack@keystone.service[97316]: [parameters: {'user_id': 'bc1678b5308544689e793cea330cf275', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 02 20:37:20.574566 ncdv-master-1 devstack@keystone.service[97316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 02 20:37:20.581379 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 02 20:37:20.583026 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 486/977] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Apr 2 20:37:20 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:20.589132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:20.690321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e148e-9f2a-4688-8dfa-772cd61c65f1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:20.725707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:20.726521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:20.726802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:20.727082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:20.734699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:20.736153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:20.750659 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-27f0652c-6bef-4742-ab2b-2ab33c2557bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 02 20:37:20.752160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 492/978] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:37:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:20.758229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:20.862848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc242a5-454a-4f7f-8ad8-480a334aa3b9 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:20.897349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:20.898108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:20.898395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:20.898673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:20.899518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:20.899825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:20.905061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98271324-e3bf-4c46-a745-17b8e36caacd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:20.943005 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 487/979] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Apr 2 20:37:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:21.347491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51008-8cb6-481d-8ffe-356eb6d71539 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.348008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51008-8cb6-481d-8ffe-356eb6d71539 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.348083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51008-8cb6-481d-8ffe-356eb6d71539 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.354084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 493/980] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:21.366123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.366123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.368413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.393490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:21.395320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:21.472687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dc4e-7dd2-41fc-aeca-5ad1ad658884 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.473396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dc4e-7dd2-41fc-aeca-5ad1ad658884 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.473869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dc4e-7dd2-41fc-aeca-5ad1ad658884 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.476067 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 494/981] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:21.480710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 488/982] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:21.482351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.482738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.483056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.504664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:21.505470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:21.506820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:21.580022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 495/983] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:21.604650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:21.622238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed229644-daa3-4880-baf3-a61c7a08a695 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:21.662939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:21.663678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.663966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.664243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.665768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:21.667410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:21.683927 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 489/984] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:21 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:21.722065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0222e48-5915-4af2-a8bf-2172bced9539 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:21.767663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:21.768953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.768953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.769122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.769776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:21.771131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:21.783266 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 02 20:37:21.784741 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 496/985] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:21.790808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:21.893152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53746ed7-ef72-4a0e-b13b-6022e9995b02 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:21.929153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:21.929829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:21.930117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:21.930395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:21.931101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:21.931413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:21.932797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:21.938287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 490/986] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:21.944064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.042105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d4e22-95bd-4f27-8aff-6713c6eb916f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:22.074628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:22.075297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.075578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.075965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.077210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:22.077523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:22.078892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:22.084113 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 497/987] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:22.090444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.188757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223e85b-77f5-41c5-9241-b7e912027759 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:22.221583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:22.222249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.222533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.222810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.223596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] RBAC: Adding query filter params (interface=admin, service_id=b7c451c4fb7e4444912afabd3ec4d6d4, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:22.223910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:22.225295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc275bb-42fb-4cdc-ae15-78671b259ba2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:22.230398 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 491/988] 10.222.0.18 () {56 vars in 1249 bytes} [Sat Apr 2 20:37:22 2022] GET /identity/v3/endpoints?service_id=b7c451c4fb7e4444912afabd3ec4d6d4&interface=admin®ion_id=RegionOne => generated 193 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:22.235684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.330733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591602e-22cd-4fac-a9ff-709d36f46912 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:22.365212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:22.365947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.366152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.366426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.367100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:22.368475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdd4ca-c58a-4a18-b6cc-087228b082a8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:22.384482 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 498/989] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:22 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:37:22.481119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469480b-e0ee-4038-ad60-12274f315f74 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.481683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469480b-e0ee-4038-ad60-12274f315f74 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.481683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469480b-e0ee-4038-ad60-12274f315f74 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.484143 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 492/990] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:22.491307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.491620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.491873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.510707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:22.511927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:22.579721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 499/991] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:22.602957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469480b-e0ee-4038-ad60-12274f315f74 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.702247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469480b-e0ee-4038-ad60-12274f315f74 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:22.734299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:22.735017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.735298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.735568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] PATH_INFO: `/v3/services/image` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.736202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:22.737587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:22.748309 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 02 20:37:22.756575 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 493/992] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Apr 2 20:37:22 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:22.756726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.849578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d19aa-e33c-41dc-ae7a-7ff9d5e1525e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:22.881556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:22.882216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:22.882498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:22.882777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:22.883534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] RBAC: Adding query filter params (name=image) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:22.883844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:22.885231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66796ad2-655f-457f-a633-4ba3d2c94b2b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:22.895267 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 500/993] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:22.896619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:22.996952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d2af-079c-4d32-b305-e5e62c99ab03 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:23.029111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:23.029773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:23.030057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:23.030331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:23.031027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] RBAC: Adding query filter params (type=image) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:23.031335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:23.032730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef434ce-fd7f-49c0-9208-fc893e7509ba None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:23.043602 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 494/994] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:24.064391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c797-c40b-4584-8221-24969a9a628e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.064972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c797-c40b-4584-8221-24969a9a628e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.064972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c797-c40b-4584-8221-24969a9a628e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.066859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 501/995] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:24.073198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.073630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.073799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.090962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:24.092192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:24.161672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 495/996] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:24.186371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c797-c40b-4584-8221-24969a9a628e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.285452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c797-c40b-4584-8221-24969a9a628e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:24.317317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:24.318028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.318305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.318572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.319214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:24.320596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:24.331156 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 02 20:37:24.332476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 502/997] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:24.338585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.437152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2aaac-8c43-4971-9873-4a23cd8cd885 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:24.476681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:24.477350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.477638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.477908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.478599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:24.478904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:24.480293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:24.489959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 496/998] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:24.491487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.586631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f3e08-d148-4727-8351-16e1ce3b88d0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:24.619090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:24.619759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.620043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.620321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.621053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:24.621363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:24.622790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8c06e-c6b0-43ff-973f-6ba8a440e7c8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:24.632204 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 503/999] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:24.634083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.728408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f912cd-c057-4549-b899-0ef640051875 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:24.746509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11930330-009f-41ac-a462-4566d8bf47cd None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.746805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11930330-009f-41ac-a462-4566d8bf47cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.747086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11930330-009f-41ac-a462-4566d8bf47cd None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.749051 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 504/1000] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:24.755200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.755493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.755777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.760758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:24.761413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.761691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.761961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.762727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] RBAC: Adding query filter params (interface=public, service_id=ca59eede88cc427da50a488fc803ed48, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:24.763034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:24.764961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:24.769906 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 497/1001] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/endpoints?service_id=ca59eede88cc427da50a488fc803ed48&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:24.775413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.779661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:24.780883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:24.856423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 505/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:24.876637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a3b8-9cc8-412b-8840-54aa9c652569 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:24.880112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:24.910870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:24.911537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:24.911820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:24.912099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:24.912805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:24.914161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:24.920512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 498/1003] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:37:24.983547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a58b1-7073-4cfd-815c-acc9fbb17c52 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:25.019817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:25.020727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.021015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.021295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.022030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:25.023515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:25.036346 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 02 20:37:25.042921 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 506/1004] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Apr 2 20:37:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:25.045266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:25.144213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c5d3f-c74a-4069-b803-f8af652b301f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:25.177846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:25.178510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.178794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.179064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.179750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:25.180055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:25.181430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:25.190663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 499/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:25.192019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:25.288741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647d9f-6f0b-45cd-b18e-7bc0423f6cf6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:25.321603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:25.322273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.322560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.322838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.323536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:25.323845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:25.325238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66dfcd3-54f9-48e6-b593-e8af91fdafa0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:25.334717 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 507/1006] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Apr 2 20:37:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:25.336818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:25.411547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88862b8-eb68-4df9-b641-52147ba63d9d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.411739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88862b8-eb68-4df9-b641-52147ba63d9d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.412025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88862b8-eb68-4df9-b641-52147ba63d9d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.413824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 508/1007] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:25.420670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63312-af7c-4a43-b4f3-0dc97ef69524 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.420952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63312-af7c-4a43-b4f3-0dc97ef69524 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.421224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c63312-af7c-4a43-b4f3-0dc97ef69524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.433973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421c3a-576e-4ab0-9868-d3b4738fc1d7 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:25.437442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b5c63312-af7c-4a43-b4f3-0dc97ef69524 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:25.441287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b5c63312-af7c-4a43-b4f3-0dc97ef69524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:25.471715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:25.472661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.473148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.473604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.474506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:25.476043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:25.491037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 500/1008] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:25.515988 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 509/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:25.540967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:25.645736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be92d2-1204-466f-8d8b-373ab66b56d5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:25.680992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:25.681593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:25.681878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:25.682159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:25.682885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:25.684253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a22bd-0d5a-4a73-b963-dff36f806dc8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:25.698987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 501/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:25 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:27.320750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fce2b-4d4a-416e-bfb4-9f792b78ae05 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.321272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fce2b-4d4a-416e-bfb4-9f792b78ae05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.321373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fce2b-4d4a-416e-bfb4-9f792b78ae05 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.323124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 510/1011] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:27.329732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.330159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.330346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.348623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:27.349811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:27.423344 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 502/1012] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:27.447052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fce2b-4d4a-416e-bfb4-9f792b78ae05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:27.550405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fce2b-4d4a-416e-bfb4-9f792b78ae05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:27.583079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:27.584066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.584354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.584660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] PATH_INFO: `/v3/services/compute` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.585313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:27.586692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:27.598106 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 02 20:37:27.599425 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 511/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:27.605362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:27.699081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2244fa-df53-4b7d-95f3-b249e39959c7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:27.734525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:27.735219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.735505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.735782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.736535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] RBAC: Adding query filter params (name=compute) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:27.736850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:27.738254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e06d5-f6d6-40c2-926e-3fe82147d57a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:27.743926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 503/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:27.749665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:27.846169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96d04-f127-487e-b011-5531d6d4ecac None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:27.877539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a3e6b-f622-41ea-8f55-73f1be02a95c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.877837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a3e6b-f622-41ea-8f55-73f1be02a95c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.878125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a3e6b-f622-41ea-8f55-73f1be02a95c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.879845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:27.879996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 504/1015] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:27.880831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.881267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.881792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.882651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] RBAC: Adding query filter params (type=compute) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:27.883111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:27.884651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:27.886193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:27.886485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:27.886765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:27.890486 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 512/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Apr 2 20:37:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:27.895866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:27.905561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:27.906764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:27.979405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 505/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:27.996933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdf4c5-9f10-4461-9068-34ed7054746d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.005037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.031277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.031938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.032227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.032533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.033316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.034632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2f6d-dfd5-4f73-bd34-cb290af7ed38 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.053570 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 513/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:28.109534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a930-b715-4b9b-b29c-ee6fcc13e0fe None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.111717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d6f-f4e9-4ae1-baaa-03519b96ce46 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.112007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d6f-f4e9-4ae1-baaa-03519b96ce46 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.112284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d6f-f4e9-4ae1-baaa-03519b96ce46 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.114404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 514/1019] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:28.121484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.121793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.122149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.139247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:28.140587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:28.154492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.155307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.155594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.155872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.157137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.158607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.165309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 506/1020] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:28.166962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.210474 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 515/1021] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:28.236252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.268954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599920-1aad-4843-be1d-4116b62f55a8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.303147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.304150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.304652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.304930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.305624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.307040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.335514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 507/1022] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:28 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:28.340564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d8b5-a8dd-4654-ba71-2f101e2e87bd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.381248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.381969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.382255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.382536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] PATH_INFO: `/v3/services/image` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.383202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.384638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.398550 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 02 20:37:28.399838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 516/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:28.406850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.515306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16f33-4d43-4640-ba84-8dc9e43ba20c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.550140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.550809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.551089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.551362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.552055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] RBAC: Adding query filter params (name=image) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:28.552355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.553755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.558947 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 508/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:28.565183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.662828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138db5-2875-430b-bc08-1267643a8072 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.696749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.697457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.697742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.698013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.698704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] RBAC: Adding query filter params (type=image) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:28.699009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.700359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.705231 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 517/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:28.711377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.809276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df9be-79db-4c0b-a7b7-e1490cc4aa2c None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.840334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.841530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.841831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.842157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.842921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] RBAC: Adding query filter params (interface=public, service_id=3f72413aa6114a2d806c55401730a27a, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:28.843278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.844650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ded75-2303-411a-a9c2-43a4b75cd54c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:28.853739 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 509/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/endpoints?service_id=3f72413aa6114a2d806c55401730a27a&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:28.854958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:28.950679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9adfc-9f9d-4265-a5bd-ffdf945a29eb None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:28.988238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:28.988938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:28.989226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:28.989505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:28.990189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:28.991562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a69ce1-4fae-4206-985b-71711f09c367 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:29.004472 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 518/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:37:28 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:37:30.554157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a076d-712e-4e83-ad4e-0b88edec9233 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.554694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a076d-712e-4e83-ad4e-0b88edec9233 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.554694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a076d-712e-4e83-ad4e-0b88edec9233 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.556664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 510/1028] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:30.562870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fb044-a5cf-4d87-9ba4-a1554479c58c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.563275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fb044-a5cf-4d87-9ba4-a1554479c58c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.563455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fb044-a5cf-4d87-9ba4-a1554479c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.579917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5f5fb044-a5cf-4d87-9ba4-a1554479c58c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:30.581104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5f5fb044-a5cf-4d87-9ba4-a1554479c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:30.646024 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 519/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:30.671230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a076d-712e-4e83-ad4e-0b88edec9233 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:30.763964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818589f0-653c-43d8-b8b3-f38693baf254 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.764282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818589f0-653c-43d8-b8b3-f38693baf254 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.764485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818589f0-653c-43d8-b8b3-f38693baf254 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.766375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 520/1030] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:30.770237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a076d-712e-4e83-ad4e-0b88edec9233 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:30.772735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.773028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.773311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.790207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:30.791468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:30.804086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:30.804936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.805225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.805505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.816507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:30.823769 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:30.829977 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 511/1031] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:30.830835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:30.864614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 521/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:30.885843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:30.930692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28662dc-8561-4a96-8d26-822483d2a8c4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:30.963485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:30.964158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:30.964443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:30.964762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:30.965514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:30.965819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:30.967205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:30.980568 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 512/1033] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:30.982721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:30.991227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f32c19-40c5-4a0d-a5b4-c2e426d44908 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.026792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.027605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.027958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.028302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.030049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.031484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.033347 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 522/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:31.038657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.084400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f008-e264-4d05-b0ef-21b870895f14 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.117311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.118102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.118387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.118663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.129566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.131010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.136996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3e8ff-e33a-4812-9254-05487f2631ea None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.147131 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:31.148313 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 513/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:31.154374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.182474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.183156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.183439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.183719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.184531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.186520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.208925 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 523/1036] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:37:31 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:31.262559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bbf6-fa53-4f95-ba70-97c36e8a90e8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.300315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.300954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.301247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.301529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.302306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:31.302627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.304018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976ede4-47c7-4182-bde4-bf32124a435f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.319042 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 514/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:31.324763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.384972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bfccc-114a-4740-a667-66aa9c6f3fd3 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.385275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bfccc-114a-4740-a667-66aa9c6f3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.385529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bfccc-114a-4740-a667-66aa9c6f3fd3 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.387430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 515/1038] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:31.394696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.394696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.394941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.416445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:31.417698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:31.435307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139312c-837c-4fa9-a3e3-46f894b649f6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.471547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.472346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.472677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.472963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] PATH_INFO: `/v3/users/nova` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.480704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.482661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.495420 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 516/1039] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:31.496160 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:37:31.498033 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 524/1040] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:31.505660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.521793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.611366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f7e4b-0415-429d-bb4d-df6fa5ed92c7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.628037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5a47-35fa-453e-b54c-142b23887eec None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.644776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.645454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.645741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.646017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.646839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:31.647155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.648674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.661071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.661955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.662564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.662564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] PATH_INFO: `/v3/services/image` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.663158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.664543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.671117 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 517/1041] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:31.672020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.675848 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 02 20:37:31.677168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 525/1042] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:31.683091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.767104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c83c-bcb9-4f00-bf69-c02d4a2462db None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.779390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde4882-cfcf-47df-bd30-23a59ad6952f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.800676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.801332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.801619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.801900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.812006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.812711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.812995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.813276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.813973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] RBAC: Adding query filter params (name=image) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:31.814279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.815637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.825089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 526/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:31.826650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.868077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.869477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.923137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdca789-99a2-4f6c-a1a1-858237159c43 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:31.956162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:31.956855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:31.957139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:31.957422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:31.958391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] RBAC: Adding query filter params (type=image) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:31.958700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:31.960064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:31.964887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 527/1044] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:31.967032 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 518/1045] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:31.972634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:31.972762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:32.070412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649b0-2189-489e-ae61-9667a2dddd46 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.070613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2d0c-0502-422a-872f-745b4e85e29c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.103944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.104645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.104929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.105050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.105247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.105825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.105933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.106106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.106377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.107326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.116466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.117971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.136823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 528/1046] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:37:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:37:32.137029 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:32.137526 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 519/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:32.143026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:32.256007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41efd5-9e48-4747-bf4d-a2e9a81eed09 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.291609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.292289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.292606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.292884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.293606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:32.293914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.295360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.307683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 529/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:32.313130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:32.411670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef574626-923b-49be-b88f-2c1c9ac45835 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.445939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.446744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.447035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.447317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.454254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.455786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.469644 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:32.471104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 520/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:32.477178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:32.582282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281410d0-af4b-4ab0-918f-0e91e7b5d333 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.615714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.616372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.616689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.616971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.617747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:32.618058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.619477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0582dfa-cf64-41bb-8b8c-81c9d83067df None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.630703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 530/1050] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:32.636714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:32.732846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd7dc-7cb2-410d-9276-dbc1f6fcabf2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:32.763869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:32.764550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:32.764836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:32.765110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:32.765911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] RBAC: Adding query filter params (role.id=94db239e0e3e4ee3ad5f8b904d01e356, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:32.766218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:32.767619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfda45-c9fa-4a7f-90bf-58ffc45739b4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:32.780488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 521/1051] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:32 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=94db239e0e3e4ee3ad5f8b904d01e356 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:33.662385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93e38-c9be-4d69-a19a-188fefafd204 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:33.662997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93e38-c9be-4d69-a19a-188fefafd204 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:33.662997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93e38-c9be-4d69-a19a-188fefafd204 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:33.664770 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 531/1052] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:33.671789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:33.672214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:33.672385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:33.688819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:33.690067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:33.752356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 522/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:33.777614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93e38-c9be-4d69-a19a-188fefafd204 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:33.874559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93e38-c9be-4d69-a19a-188fefafd204 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:33.906916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:33.907706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:33.907983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:33.908253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:33.918601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:33.925477 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:37:33.926898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 532/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:33.932929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.034669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866bec2-4dd8-47b6-9d76-4b6a615479a7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.067864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.068556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.068838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.069106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.069836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:34.070253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.071601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.080142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 523/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:34.085854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.182220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a728-5abc-4bb8-9cc3-33caa53514a9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.214573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.215434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.215711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.216538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] PATH_INFO: `/v3/users/73207042c3fc49c2b13b3c60e08e2f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.229229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] RBAC: Authorizing `identity:get_user(user_id=73207042c3fc49c2b13b3c60e08e2f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.230667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd4e2a-ef73-4e02-bfce-19c03e2752be None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.232539 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 533/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/users/73207042c3fc49c2b13b3c60e08e2f9b => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:34.237962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.331064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362b2e1-b439-40c4-b042-12c9d36dfa4a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.362908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.363560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.363842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.364117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.429380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.430818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.524723 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 524/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:34.526880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055ca9-6849-49e2-94dd-c4d0da952d91 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.527250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055ca9-6849-49e2-94dd-c4d0da952d91 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.527606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19055ca9-6849-49e2-94dd-c4d0da952d91 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.532505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 534/1058] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:34.532653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.536599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.536894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.537173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.555001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:34.556181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:34.621294 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 535/1059] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:34.627705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee18c7-aff8-445c-bf4d-44ba21fde298 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.645568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.661071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.662064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.662394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.662673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.663843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.665314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.667060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 525/1060] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:34.673500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:34.745741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457a6a4-d770-4363-a929-2a10debf7f59 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.775675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857207e3-e998-4409-9cb8-1e24016f62b1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:34.780635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.781286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.781566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.781842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.808906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:34.810125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:34.810617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:34.810900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:34.811719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1, user.id=73207042c3fc49c2b13b3c60e08e2f9b) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:34.812220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.813559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.818986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 526/1061] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/role_assignments?user.id=73207042c3fc49c2b13b3c60e08e2f9b&scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:34.849482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:34.850971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df44ad8-7276-496f-909a-d3ea39a5e729 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:34.952336 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 536/1062] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:34.958638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.062870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac578b1-1590-40eb-84f7-3a41ae03e8ea None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.095454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.096260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.096574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.096852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.107127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:35.108589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:35.121545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c551a0-10a7-4fb0-8523-70cf9735ba37 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.121840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c551a0-10a7-4fb0-8523-70cf9735ba37 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.122161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c551a0-10a7-4fb0-8523-70cf9735ba37 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.124075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 537/1063] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:35.124980 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:35.126256 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 527/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:35.130499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.130832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.131060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.133394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.147904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:35.149144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:35.216721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 538/1065] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:35.229883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebb13-3095-4763-a83e-c105c11de69d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.240261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.262269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912b87-0382-4482-923d-f30980459843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.263615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912b87-0382-4482-923d-f30980459843 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.263906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912b87-0382-4482-923d-f30980459843 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.264184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912b87-0382-4482-923d-f30980459843 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.264945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0912b87-0382-4482-923d-f30980459843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:35.265253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0912b87-0382-4482-923d-f30980459843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:35.266620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0912b87-0382-4482-923d-f30980459843 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:35.288704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 528/1066] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:35.342493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe61c8-1576-4c2a-89d1-a91903992e73 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.377871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.378762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.379045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.379316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.391186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:35.398820 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:35.405645 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 539/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:35.407345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912b87-0382-4482-923d-f30980459843 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.523153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912b87-0382-4482-923d-f30980459843 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.556768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.557442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.557725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.558000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.558738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:35.559042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:35.560430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:35.568632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 529/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:35.574731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.672843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fe20-f4b3-405f-927e-9ad42c7c77b8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.709872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.710660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.710946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.711223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.721826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:35.723288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:35.739543 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:35.740734 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 540/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:35.746478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.839752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abb10d-c4ff-4700-a84e-06055b1fe0cf None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:35.872191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:35.872884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:35.873174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:35.873455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:35.874167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:35.874478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:35.875838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:35.887111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 530/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:35.892907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:35.989372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091414c1-2ebf-41d9-ad3b-e064eeceb25d None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.022632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.023424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.023707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.023981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.032227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.033703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.048274 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:37:36.049460 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 541/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:37:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:36.055153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.148697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efde99-2f70-46ed-8a3a-aeefdc314bc1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.180311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.180993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.181282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.181562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.182371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:36.182681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.184099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.200805 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 531/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:37:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:36.206121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.300052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd67e-e047-4766-be9d-99607db9c590 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.331898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.332715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.333259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.333544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.344077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.345552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.361801 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:36.362965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 542/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:36.368522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.466790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e5dc2-caf3-4abc-985d-7419da5f71fa None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.499090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.499745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.500026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.500298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.501039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:36.501343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.502688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.513966 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 532/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:36.519513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.619852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e25c27-1a96-42a8-8bbb-96156470d8a7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.651967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.652787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.653067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.653366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.659733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.661207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.674720 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:36.675872 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 543/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:36.681610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.777864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc510ed-0460-41ae-9547-d4694b043ec2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.812838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.813516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.813804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.814085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.814873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:36.815185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.816650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563507d-4127-453c-aa2a-e113deee315e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.830304 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 533/1076] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:36.836502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:36.940398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960219cf-8a4f-48e7-95c1-243eb1a44ae9 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:36.974563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:36.975441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:36.975725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:36.976005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/94db239e0e3e4ee3ad5f8b904d01e356` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:36.978220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=46f6dffd311b4df69ae3c89ab41e8738, role_id=94db239e0e3e4ee3ad5f8b904d01e356)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:36.979649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09b83-0567-41bb-b334-247f14482289 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:36.992463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 544/1077] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:37:36 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/46f6dffd311b4df69ae3c89ab41e8738/roles/94db239e0e3e4ee3ad5f8b904d01e356 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:37:37.180304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd870-2745-4c70-b6e9-fe38ada2fcab None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.180656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd870-2745-4c70-b6e9-fe38ada2fcab None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.180945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd870-2745-4c70-b6e9-fe38ada2fcab None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.182745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 534/1078] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:37.189472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.189766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.190044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.206344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:37.207539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:37.274025 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 545/1079] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:37.298662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd870-2745-4c70-b6e9-fe38ada2fcab None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:37.395029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd870-2745-4c70-b6e9-fe38ada2fcab None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:37.427286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:37.428073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.428360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.428816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.438668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:37.445506 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:37:37.446673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 535/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:37.453349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:37.546867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d681a-d9be-4320-8261-ca0a54b3bc47 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:37.578223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:37.578886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.579172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.579450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.580187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:37.580523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:37.581894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:37.590200 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 546/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:37.596607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:37.688915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7bf21-930f-4a9a-b5ec-0451375224d8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:37.721879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:37.722746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.723031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.723308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] PATH_INFO: `/v3/users/73207042c3fc49c2b13b3c60e08e2f9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.724542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] RBAC: Authorizing `identity:get_user(user_id=73207042c3fc49c2b13b3c60e08e2f9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:37.725985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:37.727624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 536/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:37 2022] GET /identity/v3/users/73207042c3fc49c2b13b3c60e08e2f9b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:37.733341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:37.827407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd980e9-70d6-46b5-a51e-b65d18452152 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:37.859322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:37.860171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.860448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.860784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.861940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:37.863383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6e261-665b-4db9-ba9c-2eb6dc8b0eb2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:37.865064 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 547/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:37 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:37.870845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:37.965666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec08fa-0a15-4c51-abb5-61c7edee4863 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:37.996049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:37.997494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:37.997771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:37.998041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1/users/73207042c3fc49c2b13b3c60e08e2f9b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:37.999967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] RBAC: Authorizing `identity:create_grant(project_id=517270ee0fc340d1a3e5a862b7dbbfb1, user_id=73207042c3fc49c2b13b3c60e08e2f9b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:38.001411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cef20-f467-4865-b3cc-72ee2700732b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:38.014281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 537/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:37:37 2022] PUT /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1/users/73207042c3fc49c2b13b3c60e08e2f9b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:37:39.323198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9041d-ca3a-4f54-b2d1-9c3c475431ed None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:39.323727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9041d-ca3a-4f54-b2d1-9c3c475431ed None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:39.323727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9041d-ca3a-4f54-b2d1-9c3c475431ed None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:39.325667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 548/1085] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:39.331911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:39.332316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:39.332483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:39.349645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:39.350821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:39.412841 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 538/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:39.437755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9041d-ca3a-4f54-b2d1-9c3c475431ed None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:39.534834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9041d-ca3a-4f54-b2d1-9c3c475431ed None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:39.567276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:39.568075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:39.568359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:39.568664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:39.578452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:39.586067 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 02 20:37:39.587433 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 549/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Apr 2 20:37:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:39.593608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:39.686365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0050a9c-f158-45f7-8305-13d6aab11c38 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:39.720951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:39.721622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:39.721906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:39.722182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:39.722916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:39.723227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:39.724604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:39.732483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 539/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:37:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:39.737890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:39.839419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bb8cf-bbad-4e47-9e3f-2e1c2c3863ed None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:39.871223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:39.872039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:39.872317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:39.872621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:39.882562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:39.884001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:39.900002 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:39.901185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 550/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:37:39.906814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.006954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ccb9-0f9e-4b48-943b-c4ef6e86cffa None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.038305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.038961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.039243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.039520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.040226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:40.040564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.041924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.053668 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 540/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:40.059175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.154694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a521f56-f101-4075-aa07-69e8c8ac12e4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.186123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.186902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.187180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.187455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.194596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.196017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.209531 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-57ca5842-c3cd-4ec8-9183-e5ad440ce536 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 02 20:37:40.210689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 551/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:40.216847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.309481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fee893-c557-4020-be7b-c7893a9c6a44 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.341501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.342162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.342440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.342712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.343529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:40.343836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.345294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.345658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894288-2fde-4a60-bb79-b9c73bc49085 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.346047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894288-2fde-4a60-bb79-b9c73bc49085 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.346208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894288-2fde-4a60-bb79-b9c73bc49085 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.347960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 552/1092] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:37:40.354189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.354472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.354745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.362558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 541/1093] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:40.368161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.371107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:40.372855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:40.434484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 553/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:40.460891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.463302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91b59a-78e9-4ed3-90d0-464863d86d15 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.495679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.496322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.496656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.496939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.552034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9ebec-c583-46f0-936a-f1c2bc8056a6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.559626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.561108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.584023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.584837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.585118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.585391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.595481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:37:40.602364 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:37:40.603596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 554/1095] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:40.609363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.654108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 542/1096] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 02 20:37:40.659617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.703422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf5-afec-4067-b224-1568f6ee567b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.735591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.736249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.736562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.736831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.737558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:40.737862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.739207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.746953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 555/1097] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:40.751997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faaef5-6984-478e-a7d0-70d59b11611a None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.752727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.784475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.785293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.785581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.785864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.795580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.797103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.814662 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:37:40.815811 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 543/1098] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:40.821307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.846750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f26c3-3902-4bd8-a253-915c71202c45 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.878257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.879125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.879409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.879683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] PATH_INFO: `/v3/users/73207042c3fc49c2b13b3c60e08e2f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.880899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] RBAC: Authorizing `identity:get_user(user_id=73207042c3fc49c2b13b3c60e08e2f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.882320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.883926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 556/1099] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/users/73207042c3fc49c2b13b3c60e08e2f9b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:40.890063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.915334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64228611-4837-45b0-8a33-2b8e66094f89 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:40.947515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:40.948177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:40.948487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:40.948764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:40.949468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:40.949808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:40.951227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:40.962277 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 544/1100] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:40.968277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:40.986194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a3300-00db-448a-87a3-4b98d0c94f2b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.018116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.018756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.019040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.019315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.063997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065c17e-ec4c-4373-9e92-eb9fc66cf1e3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.099059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.099872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.100156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.100431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.107971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.109455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.124241 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:37:41.125706 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 545/1101] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:37:41.131353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:41.206956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.208694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.225337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151eb5-f1d1-4aa3-8325-349604b06878 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.257913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.258564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.258854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.259124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.259893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:41.260200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.261670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.272693 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 546/1102] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:41.278648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:41.305273 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 557/1103] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 02 20:37:41.306548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:41.372684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bad51-80d5-4f9d-801d-cdc460fae601 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.396995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8662fc-cdbf-40d5-8cf4-7d800ad0aba6 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.404832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.405480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.405763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.406047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.406871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] RBAC: Adding query filter params (role.id=94db239e0e3e4ee3ad5f8b904d01e356, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=46f6dffd311b4df69ae3c89ab41e8738) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:41.407181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.408647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.414178 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 547/1104] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:41 2022] GET /identity/v3/role_assignments?user.id=46f6dffd311b4df69ae3c89ab41e8738&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=94db239e0e3e4ee3ad5f8b904d01e356 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:41.429074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.429947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.430223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.430493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.431735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.433226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254be744-f27b-4ab6-ba23-0ca1a7e2a48b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.435014 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 558/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:41 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:41.441435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:41.544366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5898-c998-4f53-a4c4-9ef03b33bfb6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:41.578391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:41.579060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:41.579342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:41.579613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:41.580431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1, user.id=73207042c3fc49c2b13b3c60e08e2f9b) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:41.580770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:41.582211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ced8a7-5071-40bf-8b29-79df3df43e4f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:41.588666 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 548/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:41 2022] GET /identity/v3/role_assignments?user.id=73207042c3fc49c2b13b3c60e08e2f9b&scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:44.029060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb099b-151b-4239-aed0-709c375c2321 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:44.029631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb099b-151b-4239-aed0-709c375c2321 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:44.029631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb099b-151b-4239-aed0-709c375c2321 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:44.031365 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 559/1107] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:44.037498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:44.037918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:44.038059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:44.056196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:44.057420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:44.120167 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 549/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:44.146020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb099b-151b-4239-aed0-709c375c2321 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:44.242520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb099b-151b-4239-aed0-709c375c2321 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:44.273938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:44.274713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:44.274998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:44.275278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:44.276443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:44.277882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b573-f080-4986-bac9-1d4224e2326a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:44.280005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 560/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:44.285584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:44.376853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf1035-17d8-40f4-9d0d-34e43b27a7bf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:44.408927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:44.409579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:44.409864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:44.410141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:44.410878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:44.412315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df705af-477e-4c6c-9dbc-64ecabb9e30c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:44.431653 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 550/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:37:44 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:46.815638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14f90-9528-4436-9107-544bf934fae0 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:46.816136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14f90-9528-4436-9107-544bf934fae0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:46.816136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14f90-9528-4436-9107-544bf934fae0 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:46.817903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 561/1111] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:46.824150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:46.824554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:46.824753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:46.841873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:46.843042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:46.905431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 551/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:46.930720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14f90-9528-4436-9107-544bf934fae0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:47.030720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14f90-9528-4436-9107-544bf934fae0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:47.062109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:47.062950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:47.063233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:47.063509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] PATH_INFO: `/v3/roles/274759295627427290199d61ae093512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:47.064989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] RBAC: Authorizing `identity:get_role(role_id=274759295627427290199d61ae093512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:47.066388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:47.067667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 562/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:46 2022] GET /identity/v3/roles/274759295627427290199d61ae093512 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:47.073448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:47.165553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a80ca-652a-4e35-80e1-5c7394de6bc2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:47.197170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:47.198024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:47.198306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:47.198582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] PATH_INFO: `/v3/users/8509484bdd924866ba0ad6bc5728249a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:47.211680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] RBAC: Authorizing `identity:get_user(user_id=8509484bdd924866ba0ad6bc5728249a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:47.213137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:47.214737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 552/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:47 2022] GET /identity/v3/users/8509484bdd924866ba0ad6bc5728249a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:47.221158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:47.318918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1e6cb-fe38-4e7a-bb80-22616e66e2f2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:47.351534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:47.352162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:47.352442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:47.352748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:47.414833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:47.416258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:47.506022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 563/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:47.511930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:47.607602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45492b1-f26c-465b-9bd2-692c8ffdbd9e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:47.639840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:47.640737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:47.641021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:47.641296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:47.642458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:47.643876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852e235-b139-469a-a39e-47acd25aed3a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:47.645580 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 553/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:47 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:47.651593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:47.741576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a432c-08a7-49ec-937e-e84f551db946 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:47.773023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:47.773645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:47.773923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:47.774194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:47.775019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1, user.id=8509484bdd924866ba0ad6bc5728249a) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:47.775324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:47.776742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c34753-38ba-4202-a9ad-0dc334cf3191 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:47.781889 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 564/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:47 2022] GET /identity/v3/role_assignments?user.id=8509484bdd924866ba0ad6bc5728249a&scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1&role.id=274759295627427290199d61ae093512 => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:50.094819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb2c-d49e-46d6-9f28-2b9c2b4f3ed4 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.095349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb2c-d49e-46d6-9f28-2b9c2b4f3ed4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.095349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dbb2c-d49e-46d6-9f28-2b9c2b4f3ed4 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.097166 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 554/1118] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:50.103379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.103821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.103925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.120222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:50.121420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:50.183718 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 565/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:50.208931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dbb2c-d49e-46d6-9f28-2b9c2b4f3ed4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:50.302460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dbb2c-d49e-46d6-9f28-2b9c2b4f3ed4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:50.335000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:50.335834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.336113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.336386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] PATH_INFO: `/v3/roles/274759295627427290199d61ae093512` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.337880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] RBAC: Authorizing `identity:get_role(role_id=274759295627427290199d61ae093512)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:50.339226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:50.340583 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 555/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:50 2022] GET /identity/v3/roles/274759295627427290199d61ae093512 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:37:50.346329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:50.437703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca1c47-c604-4f46-9b1d-793341ba1562 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:50.469995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:50.470853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.471137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.471416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] PATH_INFO: `/v3/users/8509484bdd924866ba0ad6bc5728249a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.472623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] RBAC: Authorizing `identity:get_user(user_id=8509484bdd924866ba0ad6bc5728249a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:50.474042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:50.475628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 566/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:50 2022] GET /identity/v3/users/8509484bdd924866ba0ad6bc5728249a => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:50.481904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:50.577045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baf961-2fcc-43a0-80bf-7001a3bb79a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:50.609517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:50.610305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.610592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.610871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.612032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:50.613474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b2234-09c6-489f-8fd6-3b016f05cd5a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:50.615134 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 556/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:50 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:50.621033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:50.712501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cff2-53a6-4648-90a3-367000c26d0e None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:50.744199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:50.745103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:50.745385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:50.745662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1/users/8509484bdd924866ba0ad6bc5728249a/roles/274759295627427290199d61ae093512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:50.747904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] RBAC: Authorizing `identity:create_grant(project_id=517270ee0fc340d1a3e5a862b7dbbfb1, user_id=8509484bdd924866ba0ad6bc5728249a, role_id=274759295627427290199d61ae093512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:50.749343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5fdc3-5ec6-47cd-ad2e-d78083b1ab79 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:50.761869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 567/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:37:50 2022] PUT /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1/users/8509484bdd924866ba0ad6bc5728249a/roles/274759295627427290199d61ae093512 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:37:53.089006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ff61-b060-4741-9865-236193c92a6f None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.089575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ff61-b060-4741-9865-236193c92a6f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.089575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ff61-b060-4741-9865-236193c92a6f None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.091864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 557/1124] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:53.098082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.098514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.098626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.115242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:53.116395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:53.178188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 568/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:37:53.202828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ff61-b060-4741-9865-236193c92a6f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:53.297746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ff61-b060-4741-9865-236193c92a6f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:53.328939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:53.329766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.330047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.330316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] PATH_INFO: `/v3/roles/274759295627427290199d61ae093512` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.331749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] RBAC: Authorizing `identity:get_role(role_id=274759295627427290199d61ae093512)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:53.333376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:53.334696 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 558/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:53 2022] GET /identity/v3/roles/274759295627427290199d61ae093512 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:53.340382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:53.430610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76121-3e93-4ed7-aaa0-120230ecfef6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:53.462582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:53.463460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.463736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.464004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] PATH_INFO: `/v3/users/8509484bdd924866ba0ad6bc5728249a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.465187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8509484bdd924866ba0ad6bc5728249a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:53.467167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:53.468779 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 569/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:37:53 2022] GET /identity/v3/users/8509484bdd924866ba0ad6bc5728249a => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:53.474444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:53.567502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662b90-8c7f-473e-a337-5531031ccf8e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:53.599648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:53.600226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.600542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.600823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.662849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:53.664276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:53.755202 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 559/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:37:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:37:53.761118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:53.854342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7585e-8d6f-4e0f-b7d5-7ca782c512b2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:53.885671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:53.886503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:53.886782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:53.887054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] PATH_INFO: `/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:53.888254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] RBAC: Authorizing `identity:get_project(project_id=517270ee0fc340d1a3e5a862b7dbbfb1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:53.889702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8429e45-2f00-4728-8432-b094fcd06d78 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:53.891317 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 570/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:37:53 2022] GET /identity/v3/projects/517270ee0fc340d1a3e5a862b7dbbfb1 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:53.897187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:53.990955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337553-ca68-47da-abd3-183028ddbe8d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:54.022956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:54.023607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:54.023888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:54.024161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:54.025005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] RBAC: Adding query filter params (role.id=274759295627427290199d61ae093512, scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1, user.id=8509484bdd924866ba0ad6bc5728249a) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:37:54.025317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:54.026737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287b892-aef2-45a8-bc26-8eb30f34fd1e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:54.032878 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 560/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:37:53 2022] GET /identity/v3/role_assignments?user.id=8509484bdd924866ba0ad6bc5728249a&scope.project.id=517270ee0fc340d1a3e5a862b7dbbfb1&role.id=274759295627427290199d61ae093512 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:56.398793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5f0b-6adf-4155-a589-d9e3edf16762 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:56.399352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5f0b-6adf-4155-a589-d9e3edf16762 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:56.399352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5f0b-6adf-4155-a589-d9e3edf16762 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:56.401124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 571/1131] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:56.407947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:56.408348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:56.408537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:56.425481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:56.426647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:56.488884 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 561/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:56.514034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e5f0b-6adf-4155-a589-d9e3edf16762 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:56.610690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e5f0b-6adf-4155-a589-d9e3edf16762 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:56.642633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:56.643406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:56.643692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:56.643970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:56.645152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:56.646568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db365b99-bf09-4ade-bcda-3ebc72a8d2ef None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:56.648128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 572/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:56.654017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:56.745400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b67cc-da72-4460-9a92-5ca739897a98 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:56.777705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:56.778349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:56.778630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:56.778905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:56.779603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:56.781039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41a5d9-2c7b-4d06-86a8-34cda23130f2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:56.805314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 562/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:37:56 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:37:59.175716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240597-5b26-4503-8519-6ebc0f3a5333 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:59.176274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240597-5b26-4503-8519-6ebc0f3a5333 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:59.176274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240597-5b26-4503-8519-6ebc0f3a5333 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:59.178018 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 573/1135] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:37:59.184476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:59.184881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:59.185065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:59.202009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:37:59.203189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:37:59.265896 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 563/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:37:59.291926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1240597-5b26-4503-8519-6ebc0f3a5333 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:59.385597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1240597-5b26-4503-8519-6ebc0f3a5333 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:59.417770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:59.418537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:59.418868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:59.419145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:59.420303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:59.421766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7b21-fad1-4dba-b13d-ced7f98b2376 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:59.423332 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 574/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:37:59.428943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:37:59.521482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0eeb-ecb2-423d-97f4-a9033b298c69 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:37:59.553177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:37:59.553840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:37:59.554125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:37:59.554405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:37:59.555106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:37:59.556543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64ee4-3f32-4463-b44d-fc63fba3806b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:37:59.576596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 564/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:37:59 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:38:01.963736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cb4f-6fca-459c-9d73-1aeb314fc955 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:01.964290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cb4f-6fca-459c-9d73-1aeb314fc955 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:01.964290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40cb4f-6fca-459c-9d73-1aeb314fc955 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:01.966625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 575/1139] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:01.973085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:01.973543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:01.973652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:01.996915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:01.998107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:02.063336 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 565/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:38:02.088566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40cb4f-6fca-459c-9d73-1aeb314fc955 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:02.183411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40cb4f-6fca-459c-9d73-1aeb314fc955 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:02.215393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:02.216143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:02.216422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:02.216723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:02.226224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:02.233484 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:02.234620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 576/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:02.240587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:02.342770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078155d3-61b0-40db-8945-87f1762d9f0c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:02.376063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:02.376753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:02.377038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:02.377314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:02.378051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:02.378358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:02.379719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:02.387533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 566/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:02.393325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:02.487856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c03db4-b2c8-4d2b-a22c-2710c21885ab None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:02.519267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:02.520109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:02.520390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:02.520692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] PATH_INFO: `/v3/users/68fa0bc601b24856ae980a86b9655a52` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:02.533517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] RBAC: Authorizing `identity:get_user(user_id=68fa0bc601b24856ae980a86b9655a52)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:02.534934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:02.536563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 577/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/users/68fa0bc601b24856ae980a86b9655a52 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:02.542313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:02.639887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cec47b-1093-44b1-8d4e-3eb3abe2f074 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:02.672107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:02.672785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:02.673075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:02.673357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:02.736020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:02.737482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:02.828684 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 567/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:38:02.834756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:02.926698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09595-5e29-4bbb-b0c3-6550d61e5d0f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:02.957886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:02.958981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:02.959259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:02.959531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] PATH_INFO: `/v3/projects/06a4784aa62e43d3830ecc0685581da8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:02.960727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] RBAC: Authorizing `identity:get_project(project_id=06a4784aa62e43d3830ecc0685581da8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:02.962132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe90fc0-c495-46ab-9911-e6169ef4d56e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:02.963742 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 578/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/projects/06a4784aa62e43d3830ecc0685581da8 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:02.970175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:03.062632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473e354-14d6-4e8f-91a9-a95d0abffe79 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:03.095179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:03.095796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:03.096078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:03.096350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:03.097193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=06a4784aa62e43d3830ecc0685581da8, user.id=68fa0bc601b24856ae980a86b9655a52) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:03.097506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:03.098918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36b803-2b4b-4c1a-97d5-12c81d9962cd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:03.104007 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 568/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:38:02 2022] GET /identity/v3/role_assignments?user.id=68fa0bc601b24856ae980a86b9655a52&scope.project.id=06a4784aa62e43d3830ecc0685581da8&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:05.449769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee942-3202-49dd-bf51-878115337a1a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:05.450893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee942-3202-49dd-bf51-878115337a1a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:05.451082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ee942-3202-49dd-bf51-878115337a1a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:05.452765 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 579/1147] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:05.459473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:05.459879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:05.460035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:05.477021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:05.478194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:05.540544 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 569/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:05.564910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ee942-3202-49dd-bf51-878115337a1a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:05.661151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ee942-3202-49dd-bf51-878115337a1a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:05.692869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:05.693643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:05.693931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:05.694207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:05.704355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:05.711413 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:05.712566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 580/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:05.718449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:05.810248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642d792-33d4-4d12-b9d9-c2076cb8e74f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:05.842345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:05.843003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:05.843290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:05.843566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:05.844303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:05.844645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:05.846002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:05.853760 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 570/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:05.859417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:05.954710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdbcfd-dcb0-4a10-9877-fe7e12443b00 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:05.986344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:05.987233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:05.987519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:05.987799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] PATH_INFO: `/v3/users/68fa0bc601b24856ae980a86b9655a52` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:05.988993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] RBAC: Authorizing `identity:get_user(user_id=68fa0bc601b24856ae980a86b9655a52)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:05.990415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:05.991998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 581/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:05 2022] GET /identity/v3/users/68fa0bc601b24856ae980a86b9655a52 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:05.998315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:06.092442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9baa4-b720-49b0-ac93-f26baae24ac6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:06.123811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:06.124679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:06.124964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:06.125238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] PATH_INFO: `/v3/projects/06a4784aa62e43d3830ecc0685581da8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:06.126392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] RBAC: Authorizing `identity:get_project(project_id=06a4784aa62e43d3830ecc0685581da8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:06.127798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a0f92-db9c-41f1-a0ff-d497a9c035d5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:06.129472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 571/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:05 2022] GET /identity/v3/projects/06a4784aa62e43d3830ecc0685581da8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:06.135401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:06.227992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532029f8-3b84-441f-b5f0-4fe21968d04a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:06.259077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:06.259946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:06.260229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:06.260530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] PATH_INFO: `/v3/projects/06a4784aa62e43d3830ecc0685581da8/users/68fa0bc601b24856ae980a86b9655a52/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:06.262461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] RBAC: Authorizing `identity:create_grant(project_id=06a4784aa62e43d3830ecc0685581da8, user_id=68fa0bc601b24856ae980a86b9655a52, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:06.264398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21ebe6-e081-4aa0-97f6-8d244e40938b None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:06.277373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 582/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:38:06 2022] PUT /identity/v3/projects/06a4784aa62e43d3830ecc0685581da8/users/68fa0bc601b24856ae980a86b9655a52/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:38:08.591762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317e39-11cd-44ff-bddc-904015bcef72 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:08.592292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317e39-11cd-44ff-bddc-904015bcef72 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:08.592292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317e39-11cd-44ff-bddc-904015bcef72 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:08.594111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 572/1154] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:08.600271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:08.600683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:08.600870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:08.619684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:08.620893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:08.682895 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 583/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:08.708320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317e39-11cd-44ff-bddc-904015bcef72 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:08.803803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317e39-11cd-44ff-bddc-904015bcef72 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:08.835757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:08.836563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:08.836851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:08.837127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:08.847086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:08.853813 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:08.854954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 573/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:08.860871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:08.953582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a97a-f7b5-462e-a8d4-52e8c7c9162c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:08.986029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:08.986618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:08.986900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:08.987189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:08.987905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:08.988209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:08.989597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:08.997847 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 584/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:09.003577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:09.098761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c19c39-6fc8-4430-8ea4-8d7af86109a4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:09.131465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e016f-9319-406e-8874-01095119a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:09.132315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e016f-9319-406e-8874-01095119a755 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:09.132626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e016f-9319-406e-8874-01095119a755 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:09.132901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e016f-9319-406e-8874-01095119a755 None admin] PATH_INFO: `/v3/users/68fa0bc601b24856ae980a86b9655a52` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:09.134059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e016f-9319-406e-8874-01095119a755 None admin] RBAC: Authorizing `identity:get_user(user_id=68fa0bc601b24856ae980a86b9655a52)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:09.135471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e016f-9319-406e-8874-01095119a755 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:09.137100 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 574/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:09 2022] GET /identity/v3/users/68fa0bc601b24856ae980a86b9655a52 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:09.143054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:09.236150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173952fa-3ee4-4ddc-b462-f0b6fbb3b6a1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:09.267198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:09.267831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:09.268113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:09.268384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:09.330639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:09.332073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:09.422101 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 585/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:38:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:38:09.428163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e016f-9319-406e-8874-01095119a755 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:09.522450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e016f-9319-406e-8874-01095119a755 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:09.553380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:09.554225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:09.554506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:09.554778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] PATH_INFO: `/v3/projects/06a4784aa62e43d3830ecc0685581da8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:09.555936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] RBAC: Authorizing `identity:get_project(project_id=06a4784aa62e43d3830ecc0685581da8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:09.557383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b16c5-16ea-4dc1-a16a-b56c6ee127db None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:09.559042 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 575/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:09 2022] GET /identity/v3/projects/06a4784aa62e43d3830ecc0685581da8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:09.565876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:09.661412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2340-77db-43a4-b150-cf3000d7ee6f None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:09.693755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:09.694392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:09.694675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:09.694952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:09.695761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=06a4784aa62e43d3830ecc0685581da8, user.id=68fa0bc601b24856ae980a86b9655a52) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:09.696069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:09.697512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c308-16b9-42b4-b556-01d19dd786bd None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:09.703028 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 586/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:38:09 2022] GET /identity/v3/role_assignments?user.id=68fa0bc601b24856ae980a86b9655a52&scope.project.id=06a4784aa62e43d3830ecc0685581da8&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:12.040955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cabc-2713-4571-aa9a-1d7fb9528a2a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:12.041510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cabc-2713-4571-aa9a-1d7fb9528a2a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:12.041510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cabc-2713-4571-aa9a-1d7fb9528a2a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:12.043295 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 576/1162] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:12.049498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:12.049934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:12.050060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:12.066343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:12.067512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:12.132374 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 587/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:12.156966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80cabc-2713-4571-aa9a-1d7fb9528a2a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:12.251160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80cabc-2713-4571-aa9a-1d7fb9528a2a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:12.282783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:12.283420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:12.283705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:12.283981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:12.346204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:12.347573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:12.439103 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 577/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:38:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:38:12.445124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:12.538093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbcd46-96d6-4d3f-92c9-31e0ffa64af2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:12.570451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:12.571229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:12.571509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:12.571783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:12.578707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:12.580124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:12.594084 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e3fc4497-c772-448d-9b70-65da415e7c28 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 02 20:38:12.595275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 588/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:38:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:12.606460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:12.703470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0601a06-d1a0-42da-bfb6-b1a4bb6de2c4 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:12.735172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:12.735826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:12.736108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:12.736382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:12.737116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:12.737421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:12.738769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6c71-c744-482a-90c3-b0451365f1b6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:12.745565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 578/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Apr 2 20:38:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:15.081988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f50b3-6ac1-4f41-9e32-0d62d7f8919b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:15.082519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f50b3-6ac1-4f41-9e32-0d62d7f8919b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:15.082519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f50b3-6ac1-4f41-9e32-0d62d7f8919b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:15.084605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 589/1167] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:15.091432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59970-3511-4578-96ed-e47eb3703ce2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:15.091861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59970-3511-4578-96ed-e47eb3703ce2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:15.092004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59970-3511-4578-96ed-e47eb3703ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:15.108253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-93d59970-3511-4578-96ed-e47eb3703ce2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:15.109457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-93d59970-3511-4578-96ed-e47eb3703ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:15.171511 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 579/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:15.194799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f50b3-6ac1-4f41-9e32-0d62d7f8919b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:15.292369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f50b3-6ac1-4f41-9e32-0d62d7f8919b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:15.324071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:15.324751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:15.325039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:15.325878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:15.326614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:15.327985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23121337-cbff-47ee-9e5a-243aeaae1f74 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:15.341838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 590/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Sat Apr 2 20:38:15 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:38:17.721091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4b4c-a568-4387-9476-fd22f9106ec5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:17.721640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4b4c-a568-4387-9476-fd22f9106ec5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:17.721640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4b4c-a568-4387-9476-fd22f9106ec5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:17.723332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 580/1170] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:17.729584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:17.729975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:17.730148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:17.746988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:17.748161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:17.809813 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 591/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:38:17.834017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb4b4c-a568-4387-9476-fd22f9106ec5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:17.934232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb4b4c-a568-4387-9476-fd22f9106ec5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:17.968992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:17.969844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:17.970125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:17.970396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] PATH_INFO: `/v3/domains/3ac12e4164914c4889cd93d7f2799ea0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:17.980393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] RBAC: Authorizing `identity:get_domain(domain_id=3ac12e4164914c4889cd93d7f2799ea0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:17.981794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80940bd-7026-4e15-a3a6-654474cc566b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:17.983398 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 581/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Sat Apr 2 20:38:17 2022] GET /identity/v3/domains/3ac12e4164914c4889cd93d7f2799ea0 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:17.989314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:18.081448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de95c6-ac57-4cbb-86a6-16782cee2b63 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:18.113217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:18.113862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:18.114148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:18.114427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:18.115116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:18.116567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f17b2-5169-416f-a47a-c3f05ce1c175 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:18.140951 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 592/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:38:17 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:38:20.511720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bde3a-0379-41c1-9467-17ee1775fedf None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:20.512223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bde3a-0379-41c1-9467-17ee1775fedf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:20.512325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bde3a-0379-41c1-9467-17ee1775fedf None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:20.514585 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 582/1174] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:20.520940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed297-def8-4a84-9a48-431826b36301 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:20.521405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed297-def8-4a84-9a48-431826b36301 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:20.521535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed297-def8-4a84-9a48-431826b36301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:20.538469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-74fed297-def8-4a84-9a48-431826b36301 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:20.539639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74fed297-def8-4a84-9a48-431826b36301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:20.601380 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 593/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:20.627808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bde3a-0379-41c1-9467-17ee1775fedf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:20.725402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bde3a-0379-41c1-9467-17ee1775fedf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:20.756368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:20.757239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:20.757523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:20.757799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] PATH_INFO: `/v3/domains/3ac12e4164914c4889cd93d7f2799ea0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:20.758954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] RBAC: Authorizing `identity:get_domain(domain_id=3ac12e4164914c4889cd93d7f2799ea0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:20.760373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dd9cc-c607-431d-a194-1ee75462707a None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:20.761982 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 583/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Sat Apr 2 20:38:20 2022] GET /identity/v3/domains/3ac12e4164914c4889cd93d7f2799ea0 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:20.768200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed297-def8-4a84-9a48-431826b36301 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:20.859196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed297-def8-4a84-9a48-431826b36301 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:20.890899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:20.891543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:20.891822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:20.892094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:20.892810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:20.894220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6d614-d386-4978-8c6d-1f656d6414c6 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:20.912826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 594/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:38:20 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:38:23.292756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ca93-f60c-4b36-99c1-c621c9c93f1a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.293334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ca93-f60c-4b36-99c1-c621c9c93f1a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.293334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930ca93-f60c-4b36-99c1-c621c9c93f1a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:23.295095 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 584/1178] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:23.301440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.301863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.301994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:23.318391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:23.319559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:23.382249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 595/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:23.407354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930ca93-f60c-4b36-99c1-c621c9c93f1a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:23.504198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930ca93-f60c-4b36-99c1-c621c9c93f1a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:23.536105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:23.536917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.537203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.537479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:23.547588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:23.554422 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:23.555573 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 585/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:23.562108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:23.654464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb38fb-ea58-4af0-8317-f5fe3cd3f67a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:23.685740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:23.686392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.686674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.686950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:23.687679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:23.687985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:23.689372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:23.696930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 596/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:23.702851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:23.797117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e7d09-1208-4361-8650-aa9efa0d50b0 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:23.827941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:23.828785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.829063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.829335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] PATH_INFO: `/v3/users/7c82e0bc92e147d08b5ce943c704bb17` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:23.842172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82e0bc92e147d08b5ce943c704bb17)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:23.843602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:23.845211 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 586/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:23 2022] GET /identity/v3/users/7c82e0bc92e147d08b5ce943c704bb17 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:23.850944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:23.943336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120396b-3de6-45cb-a1c5-717bbc0b5df4 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:23.975074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:23.975706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:23.975990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:23.976268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:24.039517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:24.041003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:24.130493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 597/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:38:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:38:24.136281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:24.229032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573901-f8a9-45a1-8452-014ba5a82947 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:24.259774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:24.260637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:24.260916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:24.261188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] PATH_INFO: `/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:24.262334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] RBAC: Authorizing `identity:get_project(project_id=1dba97e3419f4a0eb3a2b67390f5f133)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:24.264276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81225-043f-40c8-8437-a5436c29d90c None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:24.265941 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 587/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:24 2022] GET /identity/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:24.271903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:24.362957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccfde0-331f-49fe-8984-8c70556e9459 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:24.394976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:24.395611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:24.395895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:24.396172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:24.397002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=1dba97e3419f4a0eb3a2b67390f5f133, user.id=7c82e0bc92e147d08b5ce943c704bb17) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:24.397316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:24.398719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71998-3279-410f-93ba-0426b00e17e4 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:24.403828 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 598/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:38:24 2022] GET /identity/v3/role_assignments?user.id=7c82e0bc92e147d08b5ce943c704bb17&scope.project.id=1dba97e3419f4a0eb3a2b67390f5f133&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:26.729647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b320c1-0075-4c96-8770-8caf21d207ef None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:26.730246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b320c1-0075-4c96-8770-8caf21d207ef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:26.730246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b320c1-0075-4c96-8770-8caf21d207ef None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:26.731907 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 588/1186] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:26.738430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:26.738830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:26.738988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:26.755775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:26.756984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:26.819212 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 599/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:26.843574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b320c1-0075-4c96-8770-8caf21d207ef None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:26.945175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b320c1-0075-4c96-8770-8caf21d207ef None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:26.976104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:26.976900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:26.977179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:26.977451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:26.987422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:26.994166 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:26.995303 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 589/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:27.002012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:27.094532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb24f-f453-4c38-af38-e278ff5da10c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:27.126408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:27.127059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:27.127343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:27.127618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:27.128344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:27.128681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:27.130041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:27.137711 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 600/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:27.143571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:27.236714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12175aca-5c03-4eaa-a747-19d8b122a48f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:27.267768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:27.268588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:27.268870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:27.269145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] PATH_INFO: `/v3/users/7c82e0bc92e147d08b5ce943c704bb17` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:27.270303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82e0bc92e147d08b5ce943c704bb17)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:27.271713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:27.273313 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 590/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:27 2022] GET /identity/v3/users/7c82e0bc92e147d08b5ce943c704bb17 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:27.279446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:27.372075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd361-6831-4e8a-80e4-781a53a55af2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:27.402242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:27.403081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:27.403852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:27.404120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] PATH_INFO: `/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:27.405297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] RBAC: Authorizing `identity:get_project(project_id=1dba97e3419f4a0eb3a2b67390f5f133)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:27.406700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483c7c-624b-4ed0-bf55-bac78bca946e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:27.408304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 601/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:27 2022] GET /identity/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:27.413972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:27.507717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae907-a07f-4467-aeee-34dd911eed90 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:27.539045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:27.539869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:27.540151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:27.540427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] PATH_INFO: `/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133/users/7c82e0bc92e147d08b5ce943c704bb17/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:27.542394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] RBAC: Authorizing `identity:create_grant(project_id=1dba97e3419f4a0eb3a2b67390f5f133, user_id=7c82e0bc92e147d08b5ce943c704bb17, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:27.543815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad82f92-4248-487d-b4df-a8fe7503a00b None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:27.556519 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 591/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:38:27 2022] PUT /identity/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133/users/7c82e0bc92e147d08b5ce943c704bb17/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:38:29.880821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524d66-2434-4c40-a890-dd7299f18060 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:29.881336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524d66-2434-4c40-a890-dd7299f18060 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:29.881336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524d66-2434-4c40-a890-dd7299f18060 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:29.883073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 602/1193] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:38:29.889463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:29.889840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:29.890027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:29.906968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:38:29.908149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:38:29.973720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 592/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:38:29.997721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524d66-2434-4c40-a890-dd7299f18060 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:30.095585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524d66-2434-4c40-a890-dd7299f18060 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:30.126633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:30.127412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:30.127694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:30.127968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:30.138802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:38:30.145660 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:38:30.146819 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 603/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:38:30.152827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:30.368802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1423-3a69-4aa9-afa5-c19a070bdc93 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:30.399540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:30.400191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:30.400491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:30.400768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:30.401494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:30.401799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:30.403131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:30.411257 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 593/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:30.417076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:30.512290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4497134-87d4-468f-9b12-89299b479d3b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:30.549160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:30.550030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:30.550307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:30.550575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] PATH_INFO: `/v3/users/7c82e0bc92e147d08b5ce943c704bb17` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:30.551746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82e0bc92e147d08b5ce943c704bb17)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:30.553197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:30.554786 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 604/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Apr 2 20:38:30 2022] GET /identity/v3/users/7c82e0bc92e147d08b5ce943c704bb17 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:30.561194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:30.654206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35154da7-d681-4a5f-94a0-8bdd19984297 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:30.685836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:30.686466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:30.686749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:30.687025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:30.749703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:30.751062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:30.841221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 594/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:38:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:38:30.847049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:30.942136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42a7b4-05dc-4135-a566-8e500fb05270 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:30.975346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:30.976193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:30.976503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:30.976784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] PATH_INFO: `/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:30.977948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] RBAC: Authorizing `identity:get_project(project_id=1dba97e3419f4a0eb3a2b67390f5f133)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:30.979366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffa034-24f7-4da8-9f29-1df4bfd2a5fc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:30.981203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 605/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Apr 2 20:38:30 2022] GET /identity/v3/projects/1dba97e3419f4a0eb3a2b67390f5f133 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:38:30.987755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:38:31.080534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18f8e8-b6cb-444f-8a09-55285c04b6f3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:38:31.112617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:38:31.113263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:38:31.113548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:38:31.113825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:38:31.114620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=1dba97e3419f4a0eb3a2b67390f5f133, user.id=7c82e0bc92e147d08b5ce943c704bb17) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:38:31.114931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:38:31.116338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0e544-a2fa-448b-b60b-4455bcea5ba5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:38:31.121808 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 595/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:38:30 2022] GET /identity/v3/role_assignments?user.id=7c82e0bc92e147d08b5ce943c704bb17&scope.project.id=1dba97e3419f4a0eb3a2b67390f5f133&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:33.776221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187ff9-f5b6-43cb-9d91-10d58a6da7d2 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:33.776916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187ff9-f5b6-43cb-9d91-10d58a6da7d2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:33.776916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f187ff9-f5b6-43cb-9d91-10d58a6da7d2 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:33.778852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 606/1201] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:33.788878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:33.789442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:33.789747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:33.812714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:33.814359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:33.899458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 596/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 02 20:39:33.929390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f187ff9-f5b6-43cb-9d91-10d58a6da7d2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:34.061669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f187ff9-f5b6-43cb-9d91-10d58a6da7d2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:34.103260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:34.104110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:34.104448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:34.104855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:34.121054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:34.123049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:34.154317 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:34.155908 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 607/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:34.161938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:34.287786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9ee1b-6a36-4702-9970-75ed6cdc21ee None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:34.336487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:34.337204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:34.337647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:34.338164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:34.338925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:34.339630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:34.341356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b94f6-d85d-485e-91dd-fc056fc456b7 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:34.355119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 597/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:34.363975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:34.500111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f5ee-029a-4bdc-938b-14661087b897 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:34.538051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:34.538804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:34.539092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:34.539370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:34.540155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:34.542172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf274964-a18b-4e77-a886-8959aebb56f5 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:34.584980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 608/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Apr 2 20:39:34 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:39:37.287700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30f22-4560-47a9-9f5f-ea0cdb4d3d27 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:37.288362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30f22-4560-47a9-9f5f-ea0cdb4d3d27 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:37.288362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c30f22-4560-47a9-9f5f-ea0cdb4d3d27 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:37.290063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 598/1206] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:37.297646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:37.298296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:37.298296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:37.315198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:37.316391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:37.386149 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 609/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:39:37.411662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30f22-4560-47a9-9f5f-ea0cdb4d3d27 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:37.534264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c30f22-4560-47a9-9f5f-ea0cdb4d3d27 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:37.572816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:37.573524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:37.573919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:37.574106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:37.585847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:39:37.594325 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:39:37.595626 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 599/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:37.601833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:37.715553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20de09-e5f6-4b4b-b97c-c03f4d81e946 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:37.755873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:37.756591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:37.756876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:37.757155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:37.757922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:37.758221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:37.759769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:37.770489 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 610/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:37.776394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:37.885157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98eb29-77fe-45b5-b572-067ceeb0c35f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:37.922200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:37.923001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:37.923282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:37.923553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:37.934779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:37.936364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:37.955077 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:37.956435 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 600/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:37.962332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:38.074363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f053d7d-113d-4d42-b949-030bf959dc06 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:38.110232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:38.111014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:38.111305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:38.112132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:38.112801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:38.113141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:38.114571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:38.131670 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 611/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:38.132886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:38.235526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98364b-924c-4bc8-8da5-ca2fd57784fc None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:38.271069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:38.271917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:38.272223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:38.272537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:38.281669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:38.283097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:38.297727 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:39:38.299156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 601/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:39:38.305007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:38.406646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda9f43-850b-4803-9088-e1d2cc70cdcf None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:38.444780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:38.445455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:38.445733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:38.446007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:38.446827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:38.447175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:38.448661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:38.467139 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 612/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:39:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:38.472668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:38.578403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6fc97-f15c-4a9a-8f52-d6545d6c1777 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:38.616479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:38.617201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:38.617511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:38.617817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:38.690032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:38.691496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:38.796317 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 602/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:39:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:39:38.802335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:38.907037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431dfc1-60dd-4c58-8bce-3b10e5cada79 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:38.944697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:38.945494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:38.945855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:38.946169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:38.957443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:38.958882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:38.977325 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:38.978767 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 613/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:38.985247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:39.095666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8a08-1ffa-48a3-9ace-98ddcda6efc6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:39.135940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:39.136689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:39.137067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:39.137787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:39.138527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:39.138834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:39.140206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:39.158791 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 603/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:39.160273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:39.273133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd725dd5-9ca3-4c9e-8bfa-128420c6f3c1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:39.313344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:39.314407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:39.314606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:39.314884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:39.323023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:39.324784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:39.340104 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:39:39.341482 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 614/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:39.347829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:39.461578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def85ac-be9b-4751-bb1d-5f8de541aeeb None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:39.500890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:39.501647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:39.502000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:39.502333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:39.503126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:39.503438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:39.504877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0314b-fccc-4bad-942f-022cebe0d209 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:39.517974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 604/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:39.524498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:39.636265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b203f-241b-479c-a3e9-16b59e182fd7 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:39.675174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:39.675971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:39.676415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:39.676724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:39.677845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=31f96fae657d473483c67fd7175d398f) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:39.678199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:39.679854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ddb9-9b14-40b6-bf42-b48734919e19 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:39.685539 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 615/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:39:39 2022] GET /identity/v3/role_assignments?user.id=31f96fae657d473483c67fd7175d398f&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:42.054544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc324-240e-4b18-b54c-1ce14e6f2ca8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.055197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc324-240e-4b18-b54c-1ce14e6f2ca8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.055197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc324-240e-4b18-b54c-1ce14e6f2ca8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.057461 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 605/1220] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:42.064374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.064922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.065023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.084408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:42.085908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:42.158746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 616/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:39:42.183236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc324-240e-4b18-b54c-1ce14e6f2ca8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:42.292830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc324-240e-4b18-b54c-1ce14e6f2ca8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:42.328188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:42.328952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.329239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.329534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.342491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:39:42.351209 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:39:42.358050 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 606/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:42.359269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:42.466372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f163313-38b6-44e5-90a5-eb98e5e0cde0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:42.507286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:42.507949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.508228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.508525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.509258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] RBAC: Adding query filter params (name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:42.509564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:42.511092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:42.520513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 617/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:42.526814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:42.631319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69291b-957b-446f-bbbb-08307abd19ac None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:42.665740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:42.666536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.666853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.667135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.678750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:42.680537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:42.698411 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:42.699590 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 607/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:42.706000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:42.811097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435428a-949d-44ab-b49c-bb54e3308c9c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:42.847812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:42.848496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:42.848915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:42.849196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:42.850159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:42.850470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:42.851998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:42.863689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 618/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:42.869587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:42.974080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757141-3b30-49bf-9776-731ff9d4d139 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.014737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.015875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.016154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.016430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.024260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.025810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.040684 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:39:43.041895 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 608/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:39:43.048479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:43.159427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b61d5-69aa-4fcf-8a77-177503ee5778 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.193662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.194331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.194614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.194894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.195727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:43.196039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.197547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.215993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 619/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:39:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:43.221682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:43.335048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545ce0-76fb-436f-93ae-b4271cc88ad2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.373584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.374367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.374650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.374949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.385832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.387822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.404616 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:43.405792 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 609/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:43.411593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:43.516473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a186-f56f-4c3e-9fe1-bf10f1b604b1 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.554443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.555755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.556243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.556557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.557668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:43.558168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.560624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.575737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 620/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:43.582687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:43.689938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfe70-4b2a-47e6-b7aa-cbb74bdf3baf None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.723167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.723958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.724243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.724553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.731739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.733208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.747725 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:39:43.748926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 610/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:43.754860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:43.861872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2ee3e-37ad-4200-b8de-0f3cbf354f09 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:43.896815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:43.897477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:43.897763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:43.898040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:43.898819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:43.899128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:43.900581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3f9ad-260a-45e0-942e-d2620804704e None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:43.912770 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 621/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:43.920139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:44.032001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43849e-b697-4fe0-b554-923bfa30e2f3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:44.066870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:44.067764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:44.068075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:44.068352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/31f96fae657d473483c67fd7175d398f/roles/1853a9777d8f471f869d2081966ef729` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:44.082924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=31f96fae657d473483c67fd7175d398f, role_id=1853a9777d8f471f869d2081966ef729)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:44.084370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab813c2-13d0-46ab-af51-037edbdcde91 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:44.097535 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 611/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:39:43 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/31f96fae657d473483c67fd7175d398f/roles/1853a9777d8f471f869d2081966ef729 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:39:46.535415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab7f4-df25-4a8b-b920-2a3e31b275d5 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:46.535959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab7f4-df25-4a8b-b920-2a3e31b275d5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:46.535959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab7f4-df25-4a8b-b920-2a3e31b275d5 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:46.537566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 622/1233] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:46.544170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:46.544714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:46.544808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:46.564891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:46.566743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:46.640731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 612/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:39:46.666326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab7f4-df25-4a8b-b920-2a3e31b275d5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:46.772147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab7f4-df25-4a8b-b920-2a3e31b275d5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:46.805651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:46.806450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:46.806736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:46.807009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:46.817771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:39:46.825379 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 02 20:39:46.826585 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 623/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Apr 2 20:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:46.832528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:46.937978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93decd3-c287-45aa-98c9-8bfb3c90bd86 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:46.973383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:46.974066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:46.974355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:46.974633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:46.975382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] RBAC: Adding query filter params (name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:46.975690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:46.977094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:46.986446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 613/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Apr 2 20:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:46.992097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:47.103131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff3ec-27b4-4342-b61c-346258f75a27 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:47.138223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:47.139015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:47.139297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:47.139571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:47.149756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:47.151204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:47.167415 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:47.169117 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 624/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:47.176672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:47.283199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d8328-3051-4445-8d19-6f4256f49912 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:47.320653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:47.321508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:47.321876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:47.322234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:47.323066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:47.323375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:47.325414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:47.337700 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 614/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:47.343665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:47.447910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3efb60-dd33-4e0b-90ff-4bf145b49a29 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:47.486524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:47.487459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:47.487743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:47.488017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:47.496078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:47.498154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:47.513398 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:39:47.514580 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 625/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:47.520308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:47.623152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270949f-6297-46a1-b82a-472ad1600aaa None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:47.658658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:47.659334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:47.659661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:47.659976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:47.660828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:47.661133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:47.662542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:47.685006 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 615/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:47.686220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:47.794643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba507-d00f-4ecb-bbc8-bba334f2a611 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:47.831408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:47.832058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:47.832350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:47.832665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:47.904983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:47.906433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.019570 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 626/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:39:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 02 20:39:48.025773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:48.130785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b79c-8fab-4252-b48a-e36e245a5813 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:48.165616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:48.166489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:48.166831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:48.167108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:48.177966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:48.179403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.197188 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:48.198380 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 616/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 02 20:39:48.205008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:48.311333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e37dd8-d9ea-490f-93bd-5eb3dcb3fc7c None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:48.348752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:48.349476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:48.349704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:48.350023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:48.350805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:48.351113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:48.352499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.364977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 627/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:48.370840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:48.478000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327d67-d144-486a-acc2-a68adfad1be2 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:48.514112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:48.514915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:48.515199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:48.515476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:48.522512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:48.524124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.538284 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:39:48.539478 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 617/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:48.546789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:48.656794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6e295-1d50-4b1a-a38d-1afc72d7ccbe None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:48.690821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:48.691524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:48.691721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:48.692018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:48.692807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:48.693115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:48.694559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f0e04-d6bd-439c-8b85-ffed177fcb34 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.707280 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 628/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:48.714086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:48.817284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831d62-71b9-4ec2-ba26-4414b4eefb8d None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:48.859963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:48.860914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:48.861351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:48.861721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:48.862882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] RBAC: Adding query filter params (role.id=1853a9777d8f471f869d2081966ef729, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=31f96fae657d473483c67fd7175d398f) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:48.863296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:48.865230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5fb20-b626-415a-84b4-84344f0081a2 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:48.873162 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 618/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:39:48 2022] GET /identity/v3/role_assignments?user.id=31f96fae657d473483c67fd7175d398f&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=1853a9777d8f471f869d2081966ef729 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:51.632041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2950e3-6334-4bd8-b21e-fab11d02b0dd None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:51.632601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2950e3-6334-4bd8-b21e-fab11d02b0dd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:51.632601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2950e3-6334-4bd8-b21e-fab11d02b0dd None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:51.634605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 629/1247] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:51.641755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:51.642200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:51.642291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:51.659864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:51.661325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:51.737712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 619/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:39:51.763950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2950e3-6334-4bd8-b21e-fab11d02b0dd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:51.872884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2950e3-6334-4bd8-b21e-fab11d02b0dd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:51.920259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:51.921190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:51.921502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:51.921749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:51.932990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:39:51.940416 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:39:51.941982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 630/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:51.947967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.073082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844701-b55a-420d-88ee-a3c8cb4dd40a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.110523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.111210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.111493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.111770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.112554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:52.112862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.114251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:52.123265 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 620/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:52.129514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.234483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7e69-dd18-41c5-b3bc-26adb3db2b3b None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.270039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.270847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.271129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.271399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.284916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.287075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:52.304836 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:52.306114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 631/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:52.312891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.412614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76e41-b657-42a7-a3b1-d38da436c3c6 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.446273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.446941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.447231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.447506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.448221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:52.448562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.450476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:52.462440 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 621/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:52.468768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.566594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a792b5-d527-474f-9d6f-af6b94079e29 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.598752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.599550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.599931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.600114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.608067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.609549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:52.623375 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:39:52.624569 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 632/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:52.630396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.725283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdafe-153a-4f24-8caa-c1c9244349f5 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.757836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.758502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.758790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.759064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.759879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:52.760188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.761642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:52.778185 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 622/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:52.783979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:52.878267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887b6ae-03ee-4a49-8487-673023276446 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:52.909493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:52.910136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:52.910425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:52.910708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:52.975555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:52.977723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.076336 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 633/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:39:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:39:53.082053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:53.179694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e1c94-927b-4902-a49c-4ee05cc8e6a3 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:53.211508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:53.212291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:53.212603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:53.212878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:53.222455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:53.223883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.240523 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:53.241591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 623/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:53.247721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:53.338946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eafdf-d9a9-4873-b60b-8e03f699b625 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:53.370275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:53.370917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:53.371199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:53.371521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:53.372227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:53.372561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:53.373909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.384362 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 634/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:53.390201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:53.482961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbfdc5-d0f8-4834-9769-55e6d9008658 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:53.514525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:53.515242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:53.515521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:53.515790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:53.522089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:53.523519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.536536 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:39:53.537645 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 624/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:53.543353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:53.636991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415391cc-2e72-4479-a5e9-c2e31713cfa2 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:53.668643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:53.669291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:53.669586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:53.669868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:53.670636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:53.670948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:53.672369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f51caf-67df-4f91-8cd8-2dcc6ccd1b60 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.683757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 635/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:53.689942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:53.782302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dee0-550c-4330-86b0-4691b5418a86 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:53.813670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:53.814306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:53.814589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:53.814863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:53.815661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=31f96fae657d473483c67fd7175d398f) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:53.815975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:53.817410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93fb7b-db3d-4696-90b9-34afd04947bd None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:53.822605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 625/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:39:53 2022] GET /identity/v3/role_assignments?user.id=31f96fae657d473483c67fd7175d398f&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:56.173658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c00e2-88e9-414b-bcd5-aa1d7421b6de None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.174169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c00e2-88e9-414b-bcd5-aa1d7421b6de None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.174283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c00e2-88e9-414b-bcd5-aa1d7421b6de None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.175962 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 636/1261] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:39:56.182071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.182444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.182651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.198907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:39:56.200595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:39:56.262671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 626/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:39:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:39:56.286730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c00e2-88e9-414b-bcd5-aa1d7421b6de None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:56.385817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c00e2-88e9-414b-bcd5-aa1d7421b6de None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:56.416840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:56.417615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.417900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.418176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.428259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:39:56.435169 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:39:56.436315 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 637/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:56.442284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:56.535137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26828fa-ce79-4ee1-97eb-852744424875 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:56.566949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:56.567602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.567887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.568162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.568927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:56.569253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:56.570587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:56.578840 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 627/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:56.584963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:56.677020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cf49e-912e-4f8c-8b39-3ab95984b407 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:56.708325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:56.709062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.709342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.709615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.719650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:56.721109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:56.736500 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:56.737617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 638/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:56.743135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:56.835884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d228cd-f76d-4c96-ad74-44ac2e67af33 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:56.866228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35135537-c70b-483d-954b-94f12a91978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:56.866873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135537-c70b-483d-954b-94f12a91978f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:56.867152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135537-c70b-483d-954b-94f12a91978f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:56.867424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35135537-c70b-483d-954b-94f12a91978f None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:56.868122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35135537-c70b-483d-954b-94f12a91978f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:56.868423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35135537-c70b-483d-954b-94f12a91978f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:56.869797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35135537-c70b-483d-954b-94f12a91978f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:56.881513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 628/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:56.886957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:56.984676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ffc6-5b98-4c01-9586-0c5fa54837de None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.021171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.022125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.022448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.022759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] PATH_INFO: `/v3/users/placement` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.031553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.033425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.048758 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:39:57.050065 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 639/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:57.056618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35135537-c70b-483d-954b-94f12a91978f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.150249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35135537-c70b-483d-954b-94f12a91978f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.182732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.183447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.183666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.184558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.185382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:57.185693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.187114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.205587 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 629/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:39:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:57.211288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.305652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba37b-a2f3-430d-947c-398db17ca30a None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.338434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.339211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.339497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.339775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.349717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.351145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.366722 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:39:57.367858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 640/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:57.374024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.467093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec7992-99bd-4ce4-8064-ad41cd5a4386 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.498562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.499204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.499482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.499753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.500475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:57.500781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.502118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.513144 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 630/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:39:57.518660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.612732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b49c8-6743-411b-9398-662c2b57f8c8 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.645502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.646271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.646551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.646827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.653202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.654630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.667583 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:39:57.669239 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 641/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:39:57.675030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.766966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de602-9e6f-42eb-881a-bf3525ecfd41 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.797572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.798207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.798489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.798763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.799522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:39:57.799828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.801246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cca10-c692-41a7-b922-e475d2022b20 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.812940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 631/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:39:57.818603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:39:57.912000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d9ce1-168b-4954-bd37-127dfb87e907 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:39:57.944526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:39:57.945390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:39:57.945671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:39:57.945941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] PATH_INFO: `/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/31f96fae657d473483c67fd7175d398f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:39:57.947886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc74fe8a08da402d9cd82fd42d3f8f20, user_id=31f96fae657d473483c67fd7175d398f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:39:57.949340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd31e18-1f28-467c-b545-410a08e8f6d3 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:39:57.961687 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 642/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Apr 2 20:39:57 2022] PUT /identity/v3/projects/dc74fe8a08da402d9cd82fd42d3f8f20/users/31f96fae657d473483c67fd7175d398f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:40:00.288911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bcb74-12dc-4867-8a28-c2614de2640c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.289484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bcb74-12dc-4867-8a28-c2614de2640c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.289484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bcb74-12dc-4867-8a28-c2614de2640c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.291240 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 632/1274] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:40:00.297551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.297972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.298110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.316004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:40:00.317836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:40:00.379917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 643/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:40:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:40:00.404867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bcb74-12dc-4867-8a28-c2614de2640c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:00.498993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bcb74-12dc-4867-8a28-c2614de2640c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:00.530368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:00.531147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.531429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.531700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.541382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:40:00.548260 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 02 20:40:00.549432 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 633/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Apr 2 20:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:00.555307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:00.647779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd9817-2efb-45a4-8846-dc2569f56798 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:00.679391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:00.680043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.680327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.680637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.681369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:00.681680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:00.683068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:00.691251 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 644/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Apr 2 20:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:00.696673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:00.789218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0502455-587a-4735-a6b7-d7ed3e81a0a1 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:00.820959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:00.821649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.821932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.822209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.832173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:00.833636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:00.849522 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:40:00.850635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 634/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:00.856553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:00.949623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7cfbd-2bbc-4169-bfbc-0122c1774606 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:00.986732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:00.987707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:00.988094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:00.988441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:00.989284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:00.989696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:00.991507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.004892 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 645/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:01.011592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:01.113920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cff87-3110-4da1-8e13-779d5365f36e None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:01.144218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:01.145016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:01.145302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:01.145574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:01.154065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:01.155489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.168931 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 02 20:40:01.170039 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 635/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:01.175786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:01.273603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8369ead-f3ee-4cab-a30c-c5c0e7da7f62 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:01.306910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:01.307570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:01.307850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:01.308123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:01.309016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:01.309330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:01.310779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.327131 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 646/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:01.332827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:01.426604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933a56-4e12-4801-802b-51976c5d1a15 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:01.457926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:01.458563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:01.458848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:01.459124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:01.524968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:01.526403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.624409 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 636/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 02 20:40:01.630123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:01.722999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617aafd-795a-4ae7-ba10-5218b515c5f0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:01.753879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:01.754645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:01.754922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:01.755192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:01.765084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:01.766507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.782891 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 02 20:40:01.783998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 647/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:01.789550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:01.882660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92d43-eca3-4f95-b587-4eb351d83004 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:01.914685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:01.915328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:01.915613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:01.915888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:01.916623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:01.916931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:01.918311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:01.929138 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 637/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:01.935577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:02.038554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c0b5-87b7-4192-b331-cac9e429d786 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:02.071033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:02.071815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:02.072098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:02.072371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:02.079704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:02.081182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:02.094356 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 02 20:40:02.095507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 648/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Apr 2 20:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:02.101336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:02.194397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c350c77-05e4-4069-a2c6-19ebab63f94f None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:02.224913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:02.225553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:02.225832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:02.226105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:02.226860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:02.227165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:02.228587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffd430-fa7f-4d03-8f19-f6268e53584d None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:02.240544 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 638/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Apr 2 20:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:02.247088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:02.339890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c5987-c3c6-486e-9ffa-30f8c21999e0 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:02.371113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:02.371803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:02.372086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:02.372368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:02.373208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] RBAC: Adding query filter params (role.id=42bee24e8b3d4569a87041c383fcd39f, scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20, user.id=31f96fae657d473483c67fd7175d398f) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:02.373518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:02.374940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c59d3a-9f19-4c95-a47d-dc2c6b6cec49 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:02.380442 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 649/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Apr 2 20:40:02 2022] GET /identity/v3/role_assignments?user.id=31f96fae657d473483c67fd7175d398f&scope.project.id=dc74fe8a08da402d9cd82fd42d3f8f20&role.id=42bee24e8b3d4569a87041c383fcd39f => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:04.727440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11547ff7-3d1e-4cc3-8bd7-133211b816ee None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:04.727949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11547ff7-3d1e-4cc3-8bd7-133211b816ee None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:04.727949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11547ff7-3d1e-4cc3-8bd7-133211b816ee None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:04.729731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 639/1288] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:40:04.736560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:04.736947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:04.737120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:04.754077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:40:04.755244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:40:04.817324 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 650/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:40:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:40:04.841004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11547ff7-3d1e-4cc3-8bd7-133211b816ee None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:04.940158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11547ff7-3d1e-4cc3-8bd7-133211b816ee None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:04.976110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:04.977124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:04.977403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:04.977796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:04.978443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:04.979970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:04.993362 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 02 20:40:04.994668 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 640/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:40:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:05.001202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:05.097733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204941-9004-4ba9-b583-6f28326aa259 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:05.129811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:05.130459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:05.130737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:05.131007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:05.131698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:05.132002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:05.133374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953551ed-1b58-4f03-aafa-4fdf223c9b6f None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:05.137883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 651/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Apr 2 20:40:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:40:05.143612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:05.238827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefec5cf-0942-42c8-8837-52ef4b96e9c8 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:05.276750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:05.277410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:05.277701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:05.277978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:05.278671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] RBAC: Adding query filter params (type=placement) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:05.278979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:05.280994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ddf9-c6c0-48a1-a0a2-51e83c44bcef None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:05.285269 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 641/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Apr 2 20:40:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:07.602385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370faf-4f1c-40dc-879e-1225a9e62ada None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:07.602948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370faf-4f1c-40dc-879e-1225a9e62ada None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:07.602948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370faf-4f1c-40dc-879e-1225a9e62ada None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:07.604695 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 652/1293] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:40:07.610822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bc2-3d16-4f83-b227-693cccbd8c2b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:07.611217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bc2-3d16-4f83-b227-693cccbd8c2b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:07.611383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bc2-3d16-4f83-b227-693cccbd8c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:07.627683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7c3d2bc2-3d16-4f83-b227-693cccbd8c2b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:40:07.628893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7c3d2bc2-3d16-4f83-b227-693cccbd8c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:40:07.691552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 642/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:40:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:40:07.715887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370faf-4f1c-40dc-879e-1225a9e62ada None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:07.812195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370faf-4f1c-40dc-879e-1225a9e62ada None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:07.844396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:07.845076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:07.845361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:07.845639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:07.846357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:07.847714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73607-3a38-424d-8e4b-cf5f3be8c771 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:07.861285 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 653/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Apr 2 20:40:07 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:40:10.200127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bb83-1cdc-4cf0-946f-9ef7867e4813 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.200717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bb83-1cdc-4cf0-946f-9ef7867e4813 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.200717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bb83-1cdc-4cf0-946f-9ef7867e4813 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.202488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 643/1296] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:40:10.208575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.209012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.209112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.226069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:40:10.227221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:40:10.302048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 654/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:40:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:40:10.325462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bb83-1cdc-4cf0-946f-9ef7867e4813 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:10.420607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bb83-1cdc-4cf0-946f-9ef7867e4813 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:10.452144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:10.452907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.453193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.453471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.454115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:10.455472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:10.467051 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 02 20:40:10.468186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 644/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:40:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:10.474177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:10.565038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d765-dda8-4952-bd00-0ed10f1a35f6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:10.601025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:10.602090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.602579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.603054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.604343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:10.604916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:10.607469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:10.614493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 655/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Apr 2 20:40:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:10.620491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:10.715861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaded7a-8f74-4639-88f9-eadad7286c40 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:10.746177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:10.746818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.747098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.747373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.748136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=0887ae941be44d5a9d58d5f277957d9f, region_id=RegionOne) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:10.748445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:10.749811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0359-5c29-4305-828d-801351415ac1 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:10.754552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 645/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Apr 2 20:40:10 2022] GET /identity/v3/endpoints?service_id=0887ae941be44d5a9d58d5f277957d9f&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:10.760127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:10.852331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c461ca-8f61-4089-97eb-86c6f1f86c76 None admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:10.885156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:10.885796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:10.886077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:10.886351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:10.887562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:10.888942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a679cc0-7596-4ae2-a870-d5c394d383cc None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:10.895343 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 656/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Apr 2 20:40:10 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:40:13.212332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139d203-3075-46d7-a652-59400b08fdb8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:13.212921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139d203-3075-46d7-a652-59400b08fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:13.212921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139d203-3075-46d7-a652-59400b08fdb8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:13.214698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 646/1302] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:40:13.221563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:13.221955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:13.222118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:13.238925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:40:13.240083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:40:13.302038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 657/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:40:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 20:40:13.327251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139d203-3075-46d7-a652-59400b08fdb8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:13.422436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139d203-3075-46d7-a652-59400b08fdb8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:13.453659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:13.454447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:13.454733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:13.455008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:13.455646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:13.457042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:13.468598 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 02 20:40:13.469674 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 647/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Apr 2 20:40:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 20:40:13.475661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:13.566679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15625a-1845-42c3-b88f-6f6b323d4bd1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:13.599445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:13.600088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:13.600369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:13.600668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:13.601356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:40:13.601658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:13.603006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295202dd-ed22-4e51-92b9-963387fd0072 None admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:13.607889 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 658/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Apr 2 20:40:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:40:13.613332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:40:13.706515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f399-deda-4d2d-914f-5ded358d2953 None admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:40:13.738032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:40:13.738617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:40:13.738899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:40:13.739175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:40:13.739905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:40:13.741279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38408-5b06-4e39-a457-14c7779578f9 None admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:40:13.758706 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 648/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Apr 2 20:40:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:41:26.063629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827deeb5-b02a-4979-ba97-7fcb0aa38f91 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:26.064920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827deeb5-b02a-4979-ba97-7fcb0aa38f91 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:26.065215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827deeb5-b02a-4979-ba97-7fcb0aa38f91 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:26.067099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 659/1307] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:26.074669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a922859-c9c4-40be-b785-35b5df7328a1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:26.075679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a922859-c9c4-40be-b785-35b5df7328a1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:26.076389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a922859-c9c4-40be-b785-35b5df7328a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:26.182514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5a922859-c9c4-40be-b785-35b5df7328a1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:26.184013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a922859-c9c4-40be-b785-35b5df7328a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:26.393064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 649/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:26.470972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:26.471634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:26.472121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:26.476101 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 660/1309] 10.222.0.18 () {54 vars in 963 bytes} [Sat Apr 2 20:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:26.491828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e41-b85a-4979-9d5b-de95147c405e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:26.492117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e41-b85a-4979-9d5b-de95147c405e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:26.492633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e41-b85a-4979-9d5b-de95147c405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:26.586006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-159b5e41-b85a-4979-9d5b-de95147c405e None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:26.587577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-159b5e41-b85a-4979-9d5b-de95147c405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:26.674965 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 650/1310] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Apr 2 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:41:26.684439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:26.686490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:26.802984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd398e4-18db-4581-a0f9-a11ec309d800 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:26.879747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:26.880794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:26.881297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:26.881944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:26.883796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:27.003770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:27.005906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd105-f6ae-4821-811b-4b40362b1d57 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:27.027124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 661/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:29.754291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:29.754794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:29.754794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:29.756586 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 651/1312] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:29.763602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914e93-3042-4714-9a5f-8316c489d2f2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:29.764015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914e93-3042-4714-9a5f-8316c489d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:29.764158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914e93-3042-4714-9a5f-8316c489d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:29.832798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8a914e93-3042-4714-9a5f-8316c489d2f2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:29.834022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8a914e93-3042-4714-9a5f-8316c489d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:29.927876 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 662/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:29.966670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:29.968207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:30.068717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cfd8c-69da-4c44-a7a8-a56ef466e491 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:30.139760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:30.140413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:30.140730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:30.141010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:30.142638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:30.247584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:30.249133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f5043-c585-4233-a3eb-f30697647534 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:30.266969 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 652/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:32.920634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:32.921152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:32.921264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:32.922954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 663/1315] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:32.929173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486c46-2219-42eb-948f-965d4931da36 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:32.929600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486c46-2219-42eb-948f-965d4931da36 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:32.929716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a486c46-2219-42eb-948f-965d4931da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:32.992445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8a486c46-2219-42eb-948f-965d4931da36 None None] MFA Rules not processed for user `b5e0412457d94d2abe9a82b611f09230`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:32.993680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a486c46-2219-42eb-948f-965d4931da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:33.084838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 653/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:33.126102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:33.127624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:33.230909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1418e-e0e5-4c1d-8159-1aa9d2431ddf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:33.300405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:33.301087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:33.301372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:33.301648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:33.303569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:33.407911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:33.409366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1edf82-dbc3-4559-98c2-63d5d06300e7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:33.426331 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 664/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:36.291312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:36.292408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:36.292408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:36.294371 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 654/1318] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:36.300875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037968-d5ab-4032-829e-414585c649c1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:36.301261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037968-d5ab-4032-829e-414585c649c1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:36.301440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037968-d5ab-4032-829e-414585c649c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:36.364063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fd037968-d5ab-4032-829e-414585c649c1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:36.365273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd037968-d5ab-4032-829e-414585c649c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:36.458242 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 665/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:36.498437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:36.499977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:36.602705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f254-71c7-4c20-8da6-03f5e44ba292 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:36.673221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:36.673866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:36.674153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:36.674431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:36.676066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:36.779775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:36.781247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee04b40-ce36-466b-b986-eec51080d537 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:36.798371 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 655/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:39.797742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:39.798324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:39.798324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:39.799986 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 666/1321] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:39.806649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84817306-10a2-40f8-8f40-665946f44f8e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:39.807089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84817306-10a2-40f8-8f40-665946f44f8e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:39.807256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84817306-10a2-40f8-8f40-665946f44f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:39.885499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-84817306-10a2-40f8-8f40-665946f44f8e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:39.886701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-84817306-10a2-40f8-8f40-665946f44f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:39.978291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 656/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:41:40.018147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:40.019667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:40.122192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d14207-8bed-46ac-8d2d-5a464da5adad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:40.191938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:40.192613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:40.192897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:40.193176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:40.194785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:40.298654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:40.300012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fcd8-fe8f-4115-b1e8-5ff64ce24423 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:40.317842 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 667/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:41:42.721437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e866a-b34e-4c40-ba0b-823af7bdac97 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:42.721947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e866a-b34e-4c40-ba0b-823af7bdac97 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:42.721947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e866a-b34e-4c40-ba0b-823af7bdac97 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:42.723743 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 657/1324] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:42.730845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4159-3759-4ea7-8a8f-1017410d0542 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:42.731304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4159-3759-4ea7-8a8f-1017410d0542 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:42.731415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4159-3759-4ea7-8a8f-1017410d0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:42.796099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4eab4159-3759-4ea7-8a8f-1017410d0542 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:42.797542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4eab4159-3759-4ea7-8a8f-1017410d0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:42.890245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 668/1325] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:42.950813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:42.951107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:42.951386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:42.953196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 658/1326] 10.222.0.18 () {54 vars in 963 bytes} [Sat Apr 2 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:42.959488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ba11-59d2-4ba9-8d34-8f33ce8df399 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:42.959778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ba11-59d2-4ba9-8d34-8f33ce8df399 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:42.960059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ba11-59d2-4ba9-8d34-8f33ce8df399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:43.033726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42a7ba11-59d2-4ba9-8d34-8f33ce8df399 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:43.034828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42a7ba11-59d2-4ba9-8d34-8f33ce8df399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:43.108348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 669/1327] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Apr 2 20:41:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:41:43.117531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:43.119051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:43.225972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193a797-3b18-49c8-844f-ef66fb0d6b1e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:43.296578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:43.297161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:43.297579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:43.297953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:43.299345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:43.406235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:43.407678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c8f3e-8550-4241-87e3-af98e4995a02 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:43.425639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 659/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:46.030042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:46.030615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:46.030615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:46.032346 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 670/1329] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:46.038673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedce36-a680-4c64-bd94-59dfd5fc2834 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:46.039129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedce36-a680-4c64-bd94-59dfd5fc2834 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:46.039323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedce36-a680-4c64-bd94-59dfd5fc2834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:46.106525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6aedce36-a680-4c64-bd94-59dfd5fc2834 None None] MFA Rules not processed for user `b5e0412457d94d2abe9a82b611f09230`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:46.107764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6aedce36-a680-4c64-bd94-59dfd5fc2834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:46.198553 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 660/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:41:46.237013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:46.238539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:46.336204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45568-bdc6-4c4e-8ad0-9c5228b34bc4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:46.404591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:46.405232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:46.405512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:46.405785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:46.407381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:46.511501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:46.512972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2b412-ee3d-4d52-8669-4ff2ca9a0ecf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:46.530784 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 671/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:49.306427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:49.306911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:49.307113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:49.308903 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 661/1332] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:49.315660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d291c-64c4-47a8-9cd9-174b7df32d7e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:49.316156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d291c-64c4-47a8-9cd9-174b7df32d7e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:49.316259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d291c-64c4-47a8-9cd9-174b7df32d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:49.379177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e22d291c-64c4-47a8-9cd9-174b7df32d7e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:49.380277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e22d291c-64c4-47a8-9cd9-174b7df32d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:49.474230 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 672/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:49.512064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:49.513708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:49.613780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8d939-f262-48ae-8626-c8c03bbf8113 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:49.684075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:49.684756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:49.685042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:49.685320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:49.686939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:49.794296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:49.795726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4535d-d78c-470c-8c3a-5d875c97403d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:49.813674 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 662/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:52.234457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:52.234921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:52.235120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:52.236779 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 673/1335] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:52.243378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bcd7-c43e-4a71-b1d4-870f130ffb76 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:52.243812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bcd7-c43e-4a71-b1d4-870f130ffb76 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:52.244520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bcd7-c43e-4a71-b1d4-870f130ffb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:52.307012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b065bcd7-c43e-4a71-b1d4-870f130ffb76 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:52.308514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b065bcd7-c43e-4a71-b1d4-870f130ffb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:52.400378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 663/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:52.441117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:52.442841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:52.542829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24546819-a1f9-4804-ab03-8c849a55b155 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:52.611747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:52.612315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:52.612700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:52.612978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:52.614589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:52.717167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:52.718596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dc13e-187d-4e0a-a95b-fa522b639767 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:52.736071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 674/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:41:55.542267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:55.542778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:55.542900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:55.544606 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 664/1338] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:41:55.550899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257b9d-bc9f-4cb1-b9a4-4c2a8058481c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:55.551299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257b9d-bc9f-4cb1-b9a4-4c2a8058481c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:55.551466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce257b9d-bc9f-4cb1-b9a4-4c2a8058481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:55.613693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce257b9d-bc9f-4cb1-b9a4-4c2a8058481c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:41:55.614887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce257b9d-bc9f-4cb1-b9a4-4c2a8058481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:55.706429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 675/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:41:55.743527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:41:55.745134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:55.844940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e56776-32d5-4536-8b51-b6c3aaf4845e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:41:55.914765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:41:55.915415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:41:55.915727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:41:55.916009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:41:55.917682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:41:56.022700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:41:56.024071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec5cff-e9f6-409c-bbb7-94aef368223a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:41:56.041441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 665/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:41:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:00.489192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:00.489750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:00.489750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:00.491528 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 676/1341] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:00.498576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f06-5819-425c-ac67-1eecbac1f04c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:00.499004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f06-5819-425c-ac67-1eecbac1f04c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:00.499136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f06-5819-425c-ac67-1eecbac1f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:00.569046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1fd37f06-5819-425c-ac67-1eecbac1f04c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:00.570231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1fd37f06-5819-425c-ac67-1eecbac1f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:00.672232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 666/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:00.712275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:00.715063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:00.809865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a33d8-d341-457d-9788-5d8ad4d0c13a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:00.813475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:00.814125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:00.814412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:00.814690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:00.823750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:00.825219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b85d-ac90-47b9-8f06-f056fb354af7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:00.834816 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 677/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:03.786229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa81-67be-4108-87e1-2e9b80a6275a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:03.786784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa81-67be-4108-87e1-2e9b80a6275a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:03.786784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa81-67be-4108-87e1-2e9b80a6275a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:03.788592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 667/1344] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:03.795574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5471e5-c705-4388-9b0e-909aa1a5ab95 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:03.795988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5471e5-c705-4388-9b0e-909aa1a5ab95 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:03.796126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5471e5-c705-4388-9b0e-909aa1a5ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:03.824383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce5471e5-c705-4388-9b0e-909aa1a5ab95 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:03.825716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce5471e5-c705-4388-9b0e-909aa1a5ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:03.908727 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 678/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:03.947354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa81-67be-4108-87e1-2e9b80a6275a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:03.958575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa81-67be-4108-87e1-2e9b80a6275a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:03.962345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:03.963571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:03.963857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:03.964270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:03.973289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:03.974747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8043d8d-6603-4cd1-88f8-bd7e9344bdbc service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:03.985112 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 668/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:08.427420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15953da-925b-4d44-bb99-4e080ca2384f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:08.427963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15953da-925b-4d44-bb99-4e080ca2384f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:08.427963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15953da-925b-4d44-bb99-4e080ca2384f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:08.429803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 679/1347] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:08.436239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c9eb-8daa-47f3-9fb5-11128f5abf5e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:08.436699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c9eb-8daa-47f3-9fb5-11128f5abf5e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:08.436885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c9eb-8daa-47f3-9fb5-11128f5abf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:08.458142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2156c9eb-8daa-47f3-9fb5-11128f5abf5e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:08.459597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2156c9eb-8daa-47f3-9fb5-11128f5abf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:08.468159 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 669/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:42:08.506939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15953da-925b-4d44-bb99-4e080ca2384f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:08.517958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15953da-925b-4d44-bb99-4e080ca2384f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:08.521447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:08.522083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:08.522394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:08.522671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:08.532007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:08.533469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8cd0-d7c5-4f14-87d7-4abab63f9509 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:08.543017 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 680/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:13.893878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aead93-ae09-40b1-a084-a26047d8c819 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:13.894873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aead93-ae09-40b1-a084-a26047d8c819 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:13.895385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aead93-ae09-40b1-a084-a26047d8c819 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:13.897719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 670/1350] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:13.903171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec39bd-32ba-430d-8f9c-644f8a352920 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:13.904129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec39bd-32ba-430d-8f9c-644f8a352920 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:13.905769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec39bd-32ba-430d-8f9c-644f8a352920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:14.034178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b4ec39bd-32ba-430d-8f9c-644f8a352920 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:14.036081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b4ec39bd-32ba-430d-8f9c-644f8a352920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:14.156169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 681/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:18.634883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d078239-7da9-4e8d-b040-d71980f021d8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:18.635426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d078239-7da9-4e8d-b040-d71980f021d8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:18.635426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d078239-7da9-4e8d-b040-d71980f021d8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:18.637427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 671/1352] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:18.642443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4d0f-5397-4ef8-aa04-3cddb34f1da9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:18.642885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4d0f-5397-4ef8-aa04-3cddb34f1da9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:18.642991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4d0f-5397-4ef8-aa04-3cddb34f1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:18.661735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-285a4d0f-5397-4ef8-aa04-3cddb34f1da9 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:18.662930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-285a4d0f-5397-4ef8-aa04-3cddb34f1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:18.672248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 682/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:20.370354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7290-e8c6-4407-a870-faf3ef17bf81 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:20.370856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7290-e8c6-4407-a870-faf3ef17bf81 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:20.370856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c7290-e8c6-4407-a870-faf3ef17bf81 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:20.372808 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 672/1354] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:42:20.379923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b3ce-c869-469e-8dc6-a12f5310854c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:20.380379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b3ce-c869-469e-8dc6-a12f5310854c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:20.380532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7b3ce-c869-469e-8dc6-a12f5310854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:20.398685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-14b7b3ce-c869-469e-8dc6-a12f5310854c None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:20.400438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-14b7b3ce-c869-469e-8dc6-a12f5310854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:20.409007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 683/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:24.399812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b0f84-eda9-4b56-ac43-0b584135e634 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:24.400344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b0f84-eda9-4b56-ac43-0b584135e634 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:24.400661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b0f84-eda9-4b56-ac43-0b584135e634 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:24.402524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 673/1356] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:24.409131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fef24-557d-48f3-8f10-502e59016e58 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:24.409558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fef24-557d-48f3-8f10-502e59016e58 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:24.409879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fef24-557d-48f3-8f10-502e59016e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:24.427977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3f8fef24-557d-48f3-8f10-502e59016e58 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:24.429249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f8fef24-557d-48f3-8f10-502e59016e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:24.437073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 684/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:24.486878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89aaaf-3be5-4521-8021-6a9632843bb5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:24.487390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89aaaf-3be5-4521-8021-6a9632843bb5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:24.487733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89aaaf-3be5-4521-8021-6a9632843bb5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:24.489591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 674/1358] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:24.495027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73bbd-f3d7-49a7-9fb0-7a3cc3320fd2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:24.495424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73bbd-f3d7-49a7-9fb0-7a3cc3320fd2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:24.495706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73bbd-f3d7-49a7-9fb0-7a3cc3320fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:24.543621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-78a73bbd-f3d7-49a7-9fb0-7a3cc3320fd2 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:24.544905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-78a73bbd-f3d7-49a7-9fb0-7a3cc3320fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:24.631166 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 685/1359] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:24.639236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89aaaf-3be5-4521-8021-6a9632843bb5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:24.654223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89aaaf-3be5-4521-8021-6a9632843bb5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:24.659830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:24.660578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:24.660931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:24.661280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:24.669921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:24.671561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47ae52-b235-49f5-bff1-b71ed7f04737 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:24.687920 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 675/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:42:27.257513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8afd-9106-4f01-bb59-08f399f590a9 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:27.258406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8afd-9106-4f01-bb59-08f399f590a9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:27.258728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc8afd-9106-4f01-bb59-08f399f590a9 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:27.260527 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 686/1361] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:27.267430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112b9e-8ae2-4bee-b046-219bbe7ec80f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:27.267886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112b9e-8ae2-4bee-b046-219bbe7ec80f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:27.268033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0112b9e-8ae2-4bee-b046-219bbe7ec80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:27.292667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e0112b9e-8ae2-4bee-b046-219bbe7ec80f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:27.293930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e0112b9e-8ae2-4bee-b046-219bbe7ec80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:27.302308 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 676/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:27.347980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc8afd-9106-4f01-bb59-08f399f590a9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:27.363296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc8afd-9106-4f01-bb59-08f399f590a9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:27.369676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:27.370321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:27.370679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:27.371028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:27.380058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:27.381914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfb784-b052-42d5-bbba-e7ef921c67c0 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:27.392032 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 687/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:30.059691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba947-9e2c-4f9d-9ac1-fb8342faac6c None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:30.060214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba947-9e2c-4f9d-9ac1-fb8342faac6c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:30.060214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dba947-9e2c-4f9d-9ac1-fb8342faac6c None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:30.062011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 677/1364] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:30.068746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ee4b-b63a-47f1-98fd-38a472115f89 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:30.069161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ee4b-b63a-47f1-98fd-38a472115f89 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:30.069347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ee4b-b63a-47f1-98fd-38a472115f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:30.088337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dd63ee4b-b63a-47f1-98fd-38a472115f89 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:30.089465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dd63ee4b-b63a-47f1-98fd-38a472115f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:30.097344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 688/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:30.143655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614440-0aee-41c4-a2c2-9a29fba24eba None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:30.143948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614440-0aee-41c4-a2c2-9a29fba24eba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:30.144231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f614440-0aee-41c4-a2c2-9a29fba24eba None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:30.146150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 678/1366] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:30.152101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4710-dc0f-4121-854c-b39c4d5b434d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:30.152381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4710-dc0f-4121-854c-b39c4d5b434d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:30.152689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd4710-dc0f-4121-854c-b39c4d5b434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:30.170532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b5bd4710-dc0f-4121-854c-b39c4d5b434d None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:30.171699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b5bd4710-dc0f-4121-854c-b39c4d5b434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:30.180733 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 689/1367] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:42:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:42:30.188290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f614440-0aee-41c4-a2c2-9a29fba24eba None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:30.203264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f614440-0aee-41c4-a2c2-9a29fba24eba None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:30.209140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:30.209852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:30.210210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:30.210582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:30.219592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:30.221199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501e042-4817-4126-88a2-0ba4ca5d7a78 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:30.230984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 679/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:42:32.756753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904229c-50a2-4d2d-8966-cc03acd10e89 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:32.757564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904229c-50a2-4d2d-8966-cc03acd10e89 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:32.758018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904229c-50a2-4d2d-8966-cc03acd10e89 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:32.760280 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 690/1369] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:32.773170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5060e9-59a4-49b9-a0bd-96be713780fd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:32.774976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5060e9-59a4-49b9-a0bd-96be713780fd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:32.775410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5060e9-59a4-49b9-a0bd-96be713780fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:32.802048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4c5060e9-59a4-49b9-a0bd-96be713780fd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:32.804515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c5060e9-59a4-49b9-a0bd-96be713780fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:32.814818 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 680/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:32.872178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904229c-50a2-4d2d-8966-cc03acd10e89 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:32.887465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904229c-50a2-4d2d-8966-cc03acd10e89 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:32.893434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:32.894445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:32.894919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:32.895353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:32.905613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:32.907246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c39c-f0f5-4dc2-8b07-6d7ce1727145 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:32.937770 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 691/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:35.657692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b65e0-72fa-439d-b138-677c38d55099 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:35.658729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b65e0-72fa-439d-b138-677c38d55099 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:35.659241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b65e0-72fa-439d-b138-677c38d55099 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:35.666833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 681/1372] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:35.669005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d2fd-7ca6-4fe8-becf-d44a3206c902 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:35.669861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d2fd-7ca6-4fe8-becf-d44a3206c902 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:35.670356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89d2fd-7ca6-4fe8-becf-d44a3206c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:35.690105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1c89d2fd-7ca6-4fe8-becf-d44a3206c902 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:35.691538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1c89d2fd-7ca6-4fe8-becf-d44a3206c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:35.710536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 692/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:42:35.756626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b65e0-72fa-439d-b138-677c38d55099 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:35.773386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b65e0-72fa-439d-b138-677c38d55099 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:35.781121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:35.782254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:35.782744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:35.783401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:35.796826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:35.800376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009813bf-e335-4a05-90d9-2b2b6a9fbcc4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:35.824647 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 682/1374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:36.666643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a9-f9f7-4be2-8e2a-18eda8d39d1e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:36.676564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a9-f9f7-4be2-8e2a-18eda8d39d1e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:36.676564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5be3a9-f9f7-4be2-8e2a-18eda8d39d1e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:36.676564 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 693/1375] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:36.677265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776556-71d6-446e-a172-b3f53592cdbf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:36.677265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776556-71d6-446e-a172-b3f53592cdbf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:36.677265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776556-71d6-446e-a172-b3f53592cdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:36.694535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ea776556-71d6-446e-a172-b3f53592cdbf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:36.696406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ea776556-71d6-446e-a172-b3f53592cdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:36.704972 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 683/1376] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:36.993226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4543e5-7d18-41e9-baab-2b1ad105617a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:36.993788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4543e5-7d18-41e9-baab-2b1ad105617a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:36.994153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4543e5-7d18-41e9-baab-2b1ad105617a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:36.999099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 694/1377] 10.222.0.18 () {54 vars in 962 bytes} [Sat Apr 2 20:42:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:37.004668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a46-a7b4-4819-a077-61fec8ca1ee1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:37.004984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a46-a7b4-4819-a077-61fec8ca1ee1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:37.005283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a46-a7b4-4819-a077-61fec8ca1ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:37.054762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-41146a46-a7b4-4819-a077-61fec8ca1ee1 None None] MFA Rules not processed for user `64e876b0e0844090aa652c98af67ab8b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:37.056558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-41146a46-a7b4-4819-a077-61fec8ca1ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:37.116315 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 684/1378] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Apr 2 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:37.124505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4543e5-7d18-41e9-baab-2b1ad105617a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:37.136066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4543e5-7d18-41e9-baab-2b1ad105617a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:37.139679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:37.140395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:37.140780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:37.141131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:37.150675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:37.152178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cc60a-5b7d-45f1-825f-99aea1ee3e17 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:37.161651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 695/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:38.388132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cd5a-4ef9-436f-bc12-6556090c0962 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:38.388795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cd5a-4ef9-436f-bc12-6556090c0962 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:38.388795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19cd5a-4ef9-436f-bc12-6556090c0962 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:38.390412 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 685/1380] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:38.396942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31197-30e7-4911-b571-b4e8c0f8bf46 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:38.397758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31197-30e7-4911-b571-b4e8c0f8bf46 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:38.397758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31197-30e7-4911-b571-b4e8c0f8bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:38.429650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0fd31197-30e7-4911-b571-b4e8c0f8bf46 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:38.431245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0fd31197-30e7-4911-b571-b4e8c0f8bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:38.445385 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 696/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:38.494297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19cd5a-4ef9-436f-bc12-6556090c0962 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:38.509783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19cd5a-4ef9-436f-bc12-6556090c0962 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:38.515491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:38.516463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:38.516765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:38.517049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:38.526431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:38.528007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4b467-8f5e-4c27-b985-5dcf0ef07397 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:38.539277 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 686/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:41.085209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26b74-7a08-49cf-ac99-8b658cb030f3 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:41.085651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26b74-7a08-49cf-ac99-8b658cb030f3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:41.085771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26b74-7a08-49cf-ac99-8b658cb030f3 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:41.087597 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 697/1383] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:41.094594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376891a-b7a0-4e3b-8ccf-0c1ce412eb8d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:41.095066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376891a-b7a0-4e3b-8ccf-0c1ce412eb8d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:41.095159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376891a-b7a0-4e3b-8ccf-0c1ce412eb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:41.113012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8376891a-b7a0-4e3b-8ccf-0c1ce412eb8d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:41.114185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8376891a-b7a0-4e3b-8ccf-0c1ce412eb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:41.122553 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 687/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:42:41.180756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26b74-7a08-49cf-ac99-8b658cb030f3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:41.201515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26b74-7a08-49cf-ac99-8b658cb030f3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:41.207739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:41.208977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:41.209429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:41.210742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:41.220136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:41.222729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5506-05f4-48fe-a279-0f4af4e5faae service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:41.235299 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 698/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:42:43.640299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ca82-0cf8-4f1e-9b4f-cbfbd54902be None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:43.640958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ca82-0cf8-4f1e-9b4f-cbfbd54902be None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:43.640958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ca82-0cf8-4f1e-9b4f-cbfbd54902be None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:43.642613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 688/1386] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:43.649343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281c1c-5d26-4d4d-b30a-08d326096f05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:43.650211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281c1c-5d26-4d4d-b30a-08d326096f05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:43.650503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0281c1c-5d26-4d4d-b30a-08d326096f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:43.669138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b0281c1c-5d26-4d4d-b30a-08d326096f05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:43.670329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0281c1c-5d26-4d4d-b30a-08d326096f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:43.678817 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 699/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:43.724103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ca82-0cf8-4f1e-9b4f-cbfbd54902be None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:43.739188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ca82-0cf8-4f1e-9b4f-cbfbd54902be None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:43.745469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:43.746217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:43.746599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:43.746968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:43.755596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:43.757438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31568cc-805c-447d-a7c9-b859217fed1f service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:43.771644 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 689/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:46.478848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502dda-a21d-42c9-a79d-589ac53e42db None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:46.479466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502dda-a21d-42c9-a79d-589ac53e42db None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:46.479466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502dda-a21d-42c9-a79d-589ac53e42db None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:46.481193 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 700/1389] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:46.487698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002aef1-186d-41ef-bf51-cd62e52d1eef None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:46.488169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002aef1-186d-41ef-bf51-cd62e52d1eef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:46.488293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002aef1-186d-41ef-bf51-cd62e52d1eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:46.506870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7002aef1-186d-41ef-bf51-cd62e52d1eef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:46.508624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7002aef1-186d-41ef-bf51-cd62e52d1eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:46.516407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 690/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:46.561771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad502dda-a21d-42c9-a79d-589ac53e42db None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:46.577451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad502dda-a21d-42c9-a79d-589ac53e42db None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:46.583126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:46.584059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:46.584357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:46.584678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:46.593882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:46.595825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521231c-0dbb-4c12-be99-8a572dd20d22 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:46.605628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 701/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:49.062393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50627-d5ec-423e-a35d-60c84f4ec869 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:49.063056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50627-d5ec-423e-a35d-60c84f4ec869 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:49.063198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50627-d5ec-423e-a35d-60c84f4ec869 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:49.065407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 691/1392] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:49.072330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c691b2f-1d79-4c76-a38b-4f5674d639cc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:49.072862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c691b2f-1d79-4c76-a38b-4f5674d639cc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:49.072966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c691b2f-1d79-4c76-a38b-4f5674d639cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:49.094904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c691b2f-1d79-4c76-a38b-4f5674d639cc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:49.096514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c691b2f-1d79-4c76-a38b-4f5674d639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:49.107476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 702/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:49.154668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50627-d5ec-423e-a35d-60c84f4ec869 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:49.169959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50627-d5ec-423e-a35d-60c84f4ec869 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:49.175602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:49.176241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:49.176561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:49.176878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:49.185030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:49.186600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125779c-71f5-46c5-b271-3fae780aea2e service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:49.196194 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 692/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:51.698197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b46e2-1cbc-426c-b95a-ad3b79db1e93 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:51.699033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b46e2-1cbc-426c-b95a-ad3b79db1e93 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:51.699033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b46e2-1cbc-426c-b95a-ad3b79db1e93 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:51.700536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 703/1395] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:42:51.708823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cb6a-d829-43cd-a83b-afb5a2f11ecd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:51.709643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cb6a-d829-43cd-a83b-afb5a2f11ecd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:51.709643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cb6a-d829-43cd-a83b-afb5a2f11ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:51.728770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2124cb6a-d829-43cd-a83b-afb5a2f11ecd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:51.730496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2124cb6a-d829-43cd-a83b-afb5a2f11ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:51.738291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 693/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:51.783408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b46e2-1cbc-426c-b95a-ad3b79db1e93 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:51.798336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b46e2-1cbc-426c-b95a-ad3b79db1e93 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:51.803875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:51.804545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:51.805420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:51.805700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:51.814070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:51.815660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4814e-dd85-49f2-8f3f-656d9881567e service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:51.825197 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 704/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:53.977485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4660b4-9bc7-42ac-b29e-0cb1e3fe8cc9 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:53.978076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4660b4-9bc7-42ac-b29e-0cb1e3fe8cc9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:53.978076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4660b4-9bc7-42ac-b29e-0cb1e3fe8cc9 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:53.979781 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 694/1398] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:53.987167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892c61-b3f2-47c8-b76b-25ff6dfe3957 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:53.987823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892c61-b3f2-47c8-b76b-25ff6dfe3957 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:53.987823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892c61-b3f2-47c8-b76b-25ff6dfe3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.011120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-96892c61-b3f2-47c8-b76b-25ff6dfe3957 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:54.012314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-96892c61-b3f2-47c8-b76b-25ff6dfe3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:54.020317 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 705/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:54.077293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54634f-4e45-4969-859f-7b33c64bcac2 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.077582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54634f-4e45-4969-859f-7b33c64bcac2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.077864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54634f-4e45-4969-859f-7b33c64bcac2 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.079610 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 695/1400] 10.222.0.18 () {54 vars in 961 bytes} [Sat Apr 2 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:54.085004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6db3-4b52-49d9-9524-1ce884579ef5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.085302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6db3-4b52-49d9-9524-1ce884579ef5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.085582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6db3-4b52-49d9-9524-1ce884579ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.135923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-744c6db3-4b52-49d9-9524-1ce884579ef5 None None] MFA Rules not processed for user `a51bfe290bcb46ca8fbecbaed36d2044`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:54.137158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-744c6db3-4b52-49d9-9524-1ce884579ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:54.195687 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 706/1401] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Apr 2 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:54.203347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54634f-4e45-4969-859f-7b33c64bcac2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:54.213975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54634f-4e45-4969-859f-7b33c64bcac2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:54.217497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:54.218131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.218415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.218689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.223018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899a5a-a786-4ac9-a594-651eb6ddb614 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.223312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899a5a-a786-4ac9-a594-651eb6ddb614 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.223592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899a5a-a786-4ac9-a594-651eb6ddb614 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.225615 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 707/1402] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:42:54.228307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:54.229713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:54.232588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3296-3ccb-4c8f-a680-97dc84cafebb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.232891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3296-3ccb-4c8f-a680-97dc84cafebb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.233170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3296-3ccb-4c8f-a680-97dc84cafebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.240249 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 696/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:54.251537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f6bd3296-3ccb-4c8f-a680-97dc84cafebb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:54.252738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f6bd3296-3ccb-4c8f-a680-97dc84cafebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:54.260933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 708/1404] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:42:54.306391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:54.321401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf045-a157-418d-b374-9f58b08c5e93 service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:54.326962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:54.327612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.327898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.328175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.337053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:54.338615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7eb7a-47e9-464b-b189-9bd14b2556ff service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:54.347946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 697/1405] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:42:54.672881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1242e-eb77-4cfc-a2da-a3eef853ed4a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.673246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1242e-eb77-4cfc-a2da-a3eef853ed4a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.673538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1242e-eb77-4cfc-a2da-a3eef853ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.721119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-13a1242e-eb77-4cfc-a2da-a3eef853ed4a None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:54.722336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13a1242e-eb77-4cfc-a2da-a3eef853ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:54.800352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 709/1406] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:54.900874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc265a-a696-4737-9a78-f140eff345ae None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.901168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc265a-a696-4737-9a78-f140eff345ae None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.901449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc265a-a696-4737-9a78-f140eff345ae None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.903227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 698/1407] 10.222.0.18 () {54 vars in 942 bytes} [Sat Apr 2 20:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:42:54.908981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a276d-dc6f-4b17-b340-3702b0e3bbd2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:54.909295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a276d-dc6f-4b17-b340-3702b0e3bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:54.909571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a276d-dc6f-4b17-b340-3702b0e3bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:54.956726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b19a276d-dc6f-4b17-b340-3702b0e3bbd2 None None] MFA Rules not processed for user `46a7aa639ada47bd8cdf615e9a7a5961`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:42:54.957906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b19a276d-dc6f-4b17-b340-3702b0e3bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:42:55.027695 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 710/1408] 10.222.0.18 () {58 vars in 1039 bytes} [Sat Apr 2 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:42:55.036596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc265a-a696-4737-9a78-f140eff345ae None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:42:55.054758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc265a-a696-4737-9a78-f140eff345ae None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:42:55.061421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:42:55.062088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:42:55.062369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:42:55.062637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:42:55.071309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:42:55.073026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088b010-3746-4138-a148-49b5d9b20dfa service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:42:55.081572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 699/1409] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:43:18.477653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467fa9-b921-4053-a8c8-da1b2b39af7d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:18.478176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467fa9-b921-4053-a8c8-da1b2b39af7d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:18.478283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467fa9-b921-4053-a8c8-da1b2b39af7d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:18.479980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 711/1410] 10.222.0.18 () {54 vars in 918 bytes} [Sat Apr 2 20:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:18.485255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5f78-5489-43b1-8cef-1022ca89b627 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:18.485735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5f78-5489-43b1-8cef-1022ca89b627 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:18.485842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f5f78-5489-43b1-8cef-1022ca89b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:18.503211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bd6f5f78-5489-43b1-8cef-1022ca89b627 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:18.504397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd6f5f78-5489-43b1-8cef-1022ca89b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:18.512758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 700/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Apr 2 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:18.527100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f2af-7b96-472c-a48a-b41b33ec7a2a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:18.527389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f2af-7b96-472c-a48a-b41b33ec7a2a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:18.527690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f2af-7b96-472c-a48a-b41b33ec7a2a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:18.529839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 712/1412] 10.222.0.18 () {54 vars in 918 bytes} [Sat Apr 2 20:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:18.534427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88d77-da99-4783-846e-ac521f118cff None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:18.534787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88d77-da99-4783-846e-ac521f118cff None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:18.535072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae88d77-da99-4783-846e-ac521f118cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:18.553040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dae88d77-da99-4783-846e-ac521f118cff None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:18.554193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dae88d77-da99-4783-846e-ac521f118cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:18.563552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 701/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Apr 2 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:21.405487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c659-1340-46f7-ab12-67a7383a2578 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:21.406061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c659-1340-46f7-ab12-67a7383a2578 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:21.406061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c659-1340-46f7-ab12-67a7383a2578 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:21.407800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:21.414974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078809-7331-4b69-b9f1-64fe8134cc83 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:21.415397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078809-7331-4b69-b9f1-64fe8134cc83 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:21.415539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078809-7331-4b69-b9f1-64fe8134cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:21.432999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7f078809-7331-4b69-b9f1-64fe8134cc83 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:21.434220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f078809-7331-4b69-b9f1-64fe8134cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:21.442279 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:21.486457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595c659-1340-46f7-ab12-67a7383a2578 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:21.500444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595c659-1340-46f7-ab12-67a7383a2578 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:21.505788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:21.506448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:21.506732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:21.507006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:21.514895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:21.516496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c869a-b72f-4319-98ce-19ce7a16e550 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:21.526356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 714/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:22.979322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22172-fc1b-4ae9-9a2d-ab10186ac6e4 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:22.979901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22172-fc1b-4ae9-9a2d-ab10186ac6e4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:22.979901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22172-fc1b-4ae9-9a2d-ab10186ac6e4 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:22.981759 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:22.986787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1689d-5120-435e-a735-5c5ce00b5c5c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:22.987198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1689d-5120-435e-a735-5c5ce00b5c5c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:22.987347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1689d-5120-435e-a735-5c5ce00b5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:23.005362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3de1689d-5120-435e-a735-5c5ce00b5c5c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:23.006547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3de1689d-5120-435e-a735-5c5ce00b5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:23.015151 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:23.208666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22172-fc1b-4ae9-9a2d-ab10186ac6e4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:23.222684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22172-fc1b-4ae9-9a2d-ab10186ac6e4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:23.228506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:23.229135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:23.229467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:23.229692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:23.237492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:23.239035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5bd3-34bc-4a74-9174-7a92dce8d3a7 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:23.248783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 704/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:24.641015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31da3-e38c-4d4f-84cd-39f5070ec24f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:24.641543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31da3-e38c-4d4f-84cd-39f5070ec24f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:24.641543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31da3-e38c-4d4f-84cd-39f5070ec24f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:24.643381 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:24.648623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb134f0d-0342-43b6-9e14-26bf5a59a6f1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:24.649059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb134f0d-0342-43b6-9e14-26bf5a59a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:24.649171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb134f0d-0342-43b6-9e14-26bf5a59a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:24.667704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eb134f0d-0342-43b6-9e14-26bf5a59a6f1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:24.668952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb134f0d-0342-43b6-9e14-26bf5a59a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:24.676972 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:24.835640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31da3-e38c-4d4f-84cd-39f5070ec24f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:24.850312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31da3-e38c-4d4f-84cd-39f5070ec24f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:24.856136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:24.856799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:24.857081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:24.857352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:24.865345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:24.867537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234465f7-4214-45ea-ae4c-9b0fcee436b3 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:24.877029 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 717/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:26.262084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba69-b6e2-4f1f-9ee7-4e33695232c2 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:26.262619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba69-b6e2-4f1f-9ee7-4e33695232c2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:26.262713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba69-b6e2-4f1f-9ee7-4e33695232c2 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:26.264472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:26.269952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0dbf3-0c52-4188-8532-249867ffc644 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:26.270392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0dbf3-0c52-4188-8532-249867ffc644 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:26.270520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0dbf3-0c52-4188-8532-249867ffc644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:26.288879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a8e0dbf3-0c52-4188-8532-249867ffc644 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:26.290083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a8e0dbf3-0c52-4188-8532-249867ffc644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:26.298160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:26.459049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aba69-b6e2-4f1f-9ee7-4e33695232c2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:26.474296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aba69-b6e2-4f1f-9ee7-4e33695232c2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:26.479719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:26.480358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:26.480679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:26.480960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:26.488960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:26.490522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee92ce-547a-4a55-a1cb-c35ea8717904 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:26.499653 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 707/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:27.920630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850ab5-8cf2-4f9c-aa81-8e544d2d74a7 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:27.921171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850ab5-8cf2-4f9c-aa81-8e544d2d74a7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:27.921171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31850ab5-8cf2-4f9c-aa81-8e544d2d74a7 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:27.922931 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:27.927848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537cf4-d16d-4d22-8a0d-56c9245b0c5f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:27.928270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537cf4-d16d-4d22-8a0d-56c9245b0c5f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:27.928419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537cf4-d16d-4d22-8a0d-56c9245b0c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:27.946585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-df537cf4-d16d-4d22-8a0d-56c9245b0c5f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:27.947768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df537cf4-d16d-4d22-8a0d-56c9245b0c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:27.955527 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:28.114614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850ab5-8cf2-4f9c-aa81-8e544d2d74a7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:28.129144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31850ab5-8cf2-4f9c-aa81-8e544d2d74a7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:28.141289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:28.141929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:28.142211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:28.142485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:28.151276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:28.152889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea28c6-a09e-4342-9059-fca107bdc41f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:28.162119 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 720/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:29.490405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948926e-fa72-4427-acaa-93433ca1bde8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:29.490916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948926e-fa72-4427-acaa-93433ca1bde8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:29.491012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948926e-fa72-4427-acaa-93433ca1bde8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:29.492874 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:29.497780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa295-91a3-4b41-93c4-fda237143690 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:29.498200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa295-91a3-4b41-93c4-fda237143690 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:29.498355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fa295-91a3-4b41-93c4-fda237143690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:29.516683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-364fa295-91a3-4b41-93c4-fda237143690 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:29.517856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-364fa295-91a3-4b41-93c4-fda237143690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:29.526426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:29.685067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948926e-fa72-4427-acaa-93433ca1bde8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:29.700957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948926e-fa72-4427-acaa-93433ca1bde8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:29.706328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:29.706972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:29.707258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:29.707795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:29.715786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:29.717391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1281f-a156-4c77-9065-38b509c9efe9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:29.726663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 710/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:31.049350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e04c9-529b-423f-83fa-cb30d359f361 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:31.049932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e04c9-529b-423f-83fa-cb30d359f361 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:31.049932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e04c9-529b-423f-83fa-cb30d359f361 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:31.051702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:31.057344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702f14-276f-4a13-8057-8c846e01f876 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:31.057766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702f14-276f-4a13-8057-8c846e01f876 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:31.057938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702f14-276f-4a13-8057-8c846e01f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:31.076355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bb702f14-276f-4a13-8057-8c846e01f876 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:31.077672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bb702f14-276f-4a13-8057-8c846e01f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:31.085804 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:31.255878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e04c9-529b-423f-83fa-cb30d359f361 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:31.270750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e04c9-529b-423f-83fa-cb30d359f361 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:31.276502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:31.277248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:31.277562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:31.277869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:31.286326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:31.287940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74fadb-2f8f-4ccf-a2b3-d4017a7cc60f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:31.297351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 723/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:32.612805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82b0c-abe1-4f25-a84c-18434075d3b8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:32.613363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82b0c-abe1-4f25-a84c-18434075d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:32.613363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82b0c-abe1-4f25-a84c-18434075d3b8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:32.615128 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:32.620594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413851e4-f559-454d-9155-6551a98e7fb7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:32.621001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413851e4-f559-454d-9155-6551a98e7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:32.621161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413851e4-f559-454d-9155-6551a98e7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:32.639219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-413851e4-f559-454d-9155-6551a98e7fb7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:32.640402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-413851e4-f559-454d-9155-6551a98e7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:32.648102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:32.804035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82b0c-abe1-4f25-a84c-18434075d3b8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:32.818209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82b0c-abe1-4f25-a84c-18434075d3b8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:32.824074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:32.824742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:32.825027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:32.825304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:32.833684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:32.835272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c67f42-70bd-4315-b0b0-3ca8bd029c4c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:32.844738 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 713/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:34.148740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c2c-1d2a-471a-9659-0f719633a536 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:34.149154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c2c-1d2a-471a-9659-0f719633a536 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:34.149301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349c2c-1d2a-471a-9659-0f719633a536 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:34.151079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:34.156014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db4d-9962-4a1f-ba86-3b8378fa7303 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:34.156434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db4d-9962-4a1f-ba86-3b8378fa7303 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:34.156617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653db4d-9962-4a1f-ba86-3b8378fa7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:34.174683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0653db4d-9962-4a1f-ba86-3b8378fa7303 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:34.175885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0653db4d-9962-4a1f-ba86-3b8378fa7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:34.184472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:34.341898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d349c2c-1d2a-471a-9659-0f719633a536 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:34.356064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d349c2c-1d2a-471a-9659-0f719633a536 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:34.361648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:34.362351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:34.362661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:34.362933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:34.371597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:34.373195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061c170-420f-42f8-8cb4-f93652f54311 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:34.382898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 726/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:36.622464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920960-1999-44c4-ad07-11d5983d7b30 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:36.623022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920960-1999-44c4-ad07-11d5983d7b30 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:36.623022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8920960-1999-44c4-ad07-11d5983d7b30 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:36.624923 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:36.631448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7570f-03c9-477f-907e-025147cb637c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:36.631876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7570f-03c9-477f-907e-025147cb637c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:36.632024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7570f-03c9-477f-907e-025147cb637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:36.649853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a3a7570f-03c9-477f-907e-025147cb637c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:36.651043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3a7570f-03c9-477f-907e-025147cb637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:36.658719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:36.699001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920960-1999-44c4-ad07-11d5983d7b30 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:36.710523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8920960-1999-44c4-ad07-11d5983d7b30 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:36.714018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:36.714653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:36.714939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:36.715218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:36.724569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:36.726063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76c872-02cc-4cd0-93ed-506f8c412a92 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:36.735513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 716/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:39.225249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c098-d395-40be-9216-cf46e103281b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:39.225849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c098-d395-40be-9216-cf46e103281b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:39.225849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304c098-d395-40be-9216-cf46e103281b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:39.227576 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:39.234059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6423-036c-4fc5-a58b-898ae057356d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:39.234521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6423-036c-4fc5-a58b-898ae057356d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:39.234647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6423-036c-4fc5-a58b-898ae057356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:39.252035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4aab6423-036c-4fc5-a58b-898ae057356d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:39.253253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4aab6423-036c-4fc5-a58b-898ae057356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:39.261554 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:39.301213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304c098-d395-40be-9216-cf46e103281b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:39.302896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c304c098-d395-40be-9216-cf46e103281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:39.316044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304c098-d395-40be-9216-cf46e103281b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:39.320194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:39.320865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:39.321155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:39.321433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:39.330333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:39.331803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169938a-ddd4-4588-abc5-729cc6cbfce6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:39.341919 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 729/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:42.012363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05dd0-25bf-4c80-a54f-486d0ea31193 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:42.012947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05dd0-25bf-4c80-a54f-486d0ea31193 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:42.012947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c05dd0-25bf-4c80-a54f-486d0ea31193 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:42.014737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:42.021319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d9af-9b68-4cbe-bc3b-be4a005b3869 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:42.022350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d9af-9b68-4cbe-bc3b-be4a005b3869 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:42.022480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68d9af-9b68-4cbe-bc3b-be4a005b3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:42.039740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c68d9af-9b68-4cbe-bc3b-be4a005b3869 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:42.040963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c68d9af-9b68-4cbe-bc3b-be4a005b3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:42.048812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:42.088585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05dd0-25bf-4c80-a54f-486d0ea31193 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:42.098872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c05dd0-25bf-4c80-a54f-486d0ea31193 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:42.102355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:42.102989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:42.103292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:42.103549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:42.112160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:42.113604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930efb9-9d8e-4f16-8802-83a29555495b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:42.122764 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 719/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:43:44.607854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ef4-e8dc-4fe7-91e5-4ab06f1fb72e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:44.608425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ef4-e8dc-4fe7-91e5-4ab06f1fb72e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:44.608554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8ef4-e8dc-4fe7-91e5-4ab06f1fb72e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:44.610326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:44.617400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fecc4a-6214-43ff-96b6-ada132652972 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:44.617840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fecc4a-6214-43ff-96b6-ada132652972 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:44.617949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fecc4a-6214-43ff-96b6-ada132652972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:44.635943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f5fecc4a-6214-43ff-96b6-ada132652972 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:44.637166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f5fecc4a-6214-43ff-96b6-ada132652972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:44.645273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:43:44.684469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8ef4-e8dc-4fe7-91e5-4ab06f1fb72e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:44.695691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e8ef4-e8dc-4fe7-91e5-4ab06f1fb72e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:44.699193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:44.699825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:44.700116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:44.700395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:44.709494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:44.710865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c0c3f-e783-4ad9-bd59-bd9384dfa349 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:44.720038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 732/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:47.149855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1b15-cb2d-4428-91cd-ac1ac7a28a99 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:47.150439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1b15-cb2d-4428-91cd-ac1ac7a28a99 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:47.150439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1b15-cb2d-4428-91cd-ac1ac7a28a99 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:47.152186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:47.158562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7f32-5b3d-442f-ace6-df7ccbc0d5ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:47.158975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7f32-5b3d-442f-ace6-df7ccbc0d5ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:47.159142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7f32-5b3d-442f-ace6-df7ccbc0d5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:47.177252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f69b7f32-5b3d-442f-ace6-df7ccbc0d5ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:47.178492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f69b7f32-5b3d-442f-ace6-df7ccbc0d5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:47.186286 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:47.225898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d1b15-cb2d-4428-91cd-ac1ac7a28a99 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:47.236240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d1b15-cb2d-4428-91cd-ac1ac7a28a99 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:47.240289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:47.241053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:47.241479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:47.241787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:47.253645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:47.255143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b2f6b-3641-448e-8b5d-05f2f4d3b1bb service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:47.265764 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 722/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:49.695308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca95f-cffd-45c0-a759-8da645b478d3 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:49.695908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca95f-cffd-45c0-a759-8da645b478d3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:49.695908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ca95f-cffd-45c0-a759-8da645b478d3 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:49.697686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:49.704260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe57b4-8040-4d70-9ddd-b4c100b43d75 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:49.704718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe57b4-8040-4d70-9ddd-b4c100b43d75 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:49.704811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe57b4-8040-4d70-9ddd-b4c100b43d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:49.723043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ffbe57b4-8040-4d70-9ddd-b4c100b43d75 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:49.724238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffbe57b4-8040-4d70-9ddd-b4c100b43d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:49.732010 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:49.771095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ca95f-cffd-45c0-a759-8da645b478d3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:49.782169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ca95f-cffd-45c0-a759-8da645b478d3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:49.785571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:49.786196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:49.786479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:49.786756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:49.795580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:49.797030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad020bc-1784-410a-828d-63bb703d22f5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:49.806603 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 735/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:52.205758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf67-77d4-4f88-b5bb-3f914c0b9924 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:52.206267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf67-77d4-4f88-b5bb-3f914c0b9924 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:52.206365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3cf67-77d4-4f88-b5bb-3f914c0b9924 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:52.208388 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:52.215311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8fba-1852-4151-8d09-0f17768a1854 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:52.215819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8fba-1852-4151-8d09-0f17768a1854 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:52.215921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c8fba-1852-4151-8d09-0f17768a1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:52.234302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aa4c8fba-1852-4151-8d09-0f17768a1854 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:52.235506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa4c8fba-1852-4151-8d09-0f17768a1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:52.243484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:52.281471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cf67-77d4-4f88-b5bb-3f914c0b9924 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:52.292396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3cf67-77d4-4f88-b5bb-3f914c0b9924 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:52.295921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:52.296593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:52.296877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:52.297150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:52.305915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:52.307353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995ae6b-4eff-40a6-b8c8-93be6d0c3022 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:52.329337 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 725/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:54.736861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29120b-eb89-4498-8c70-c5573ba42397 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:54.737385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29120b-eb89-4498-8c70-c5573ba42397 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:54.737385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29120b-eb89-4498-8c70-c5573ba42397 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:54.739101 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:54.745590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf9a-d425-4b8f-afd0-62a5e059b5bd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:54.745991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf9a-d425-4b8f-afd0-62a5e059b5bd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:54.746157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5bf9a-d425-4b8f-afd0-62a5e059b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:54.764444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-02e5bf9a-d425-4b8f-afd0-62a5e059b5bd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:54.765655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-02e5bf9a-d425-4b8f-afd0-62a5e059b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:54.774196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:54.811508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29120b-eb89-4498-8c70-c5573ba42397 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:54.822717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29120b-eb89-4498-8c70-c5573ba42397 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:54.826286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:54.826945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:54.827232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:54.827511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:54.837195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:54.838620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0f24d-9852-4e5a-b617-83d49e8b1694 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:54.847701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 738/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:57.241133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7862e-79b7-4191-9567-2bbcd90b68f1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:57.241700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7862e-79b7-4191-9567-2bbcd90b68f1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:57.241811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7862e-79b7-4191-9567-2bbcd90b68f1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:57.243624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:43:57.251230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb391-7742-45c8-8975-fa07a1dfe090 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:57.251692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb391-7742-45c8-8975-fa07a1dfe090 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:57.251944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb391-7742-45c8-8975-fa07a1dfe090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:57.269800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4b5bb391-7742-45c8-8975-fa07a1dfe090 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:57.271007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b5bb391-7742-45c8-8975-fa07a1dfe090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:57.279304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:57.317537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7862e-79b7-4191-9567-2bbcd90b68f1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:57.328128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7862e-79b7-4191-9567-2bbcd90b68f1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:57.331616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:57.332556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:57.332844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:57.333121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:57.342266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:57.343679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23ea90-4f64-456c-9c9b-935924319399 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:57.353373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 728/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:43:59.725077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a6b8-12a0-4106-a3b2-5c2730846866 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:59.725617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a6b8-12a0-4106-a3b2-5c2730846866 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:59.725617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447a6b8-12a0-4106-a3b2-5c2730846866 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:59.727401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:43:59.734043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad80e4-493e-420e-b2fb-cb09378ec4de None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:59.734475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad80e4-493e-420e-b2fb-cb09378ec4de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:59.734589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad80e4-493e-420e-b2fb-cb09378ec4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:59.753356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c8ad80e4-493e-420e-b2fb-cb09378ec4de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:43:59.754573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c8ad80e4-493e-420e-b2fb-cb09378ec4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:43:59.763213 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:43:59.799232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a6b8-12a0-4106-a3b2-5c2730846866 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:43:59.810542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447a6b8-12a0-4106-a3b2-5c2730846866 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:43:59.814121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:43:59.814756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:43:59.815041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:43:59.815317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:43:59.824640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:43:59.826062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbee8c-5d7c-4d5b-8104-30c1fc14273a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:43:59.835464 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 741/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:21.569702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b57ba-b2d4-452d-bfcd-4ff5fbe0631b None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:21.570284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b57ba-b2d4-452d-bfcd-4ff5fbe0631b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:21.570284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b57ba-b2d4-452d-bfcd-4ff5fbe0631b None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:21.572014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 730/1471] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:21.577105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358503b-b63c-4e31-83db-d8d7d4b0cf70 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:21.577564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358503b-b63c-4e31-83db-d8d7d4b0cf70 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:21.577671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358503b-b63c-4e31-83db-d8d7d4b0cf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:21.596601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4358503b-b63c-4e31-83db-d8d7d4b0cf70 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:21.597781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4358503b-b63c-4e31-83db-d8d7d4b0cf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:21.606259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 742/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:21.653659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828d0b-9cc1-44b7-917a-f8960ad9d9b4 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:21.653942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828d0b-9cc1-44b7-917a-f8960ad9d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:21.654216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828d0b-9cc1-44b7-917a-f8960ad9d9b4 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:21.655986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 731/1473] 10.222.0.18 () {54 vars in 961 bytes} [Sat Apr 2 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:21.661600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19d46-6a4d-4d5f-9186-95ecf811a2a2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:21.661893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19d46-6a4d-4d5f-9186-95ecf811a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:21.662173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e19d46-6a4d-4d5f-9186-95ecf811a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:21.680102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-58e19d46-6a4d-4d5f-9186-95ecf811a2a2 None None] MFA Rules not processed for user `a51bfe290bcb46ca8fbecbaed36d2044`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:21.681183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58e19d46-6a4d-4d5f-9186-95ecf811a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:21.687735 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 743/1474] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Apr 2 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:21.695544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f828d0b-9cc1-44b7-917a-f8960ad9d9b4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:21.705851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f828d0b-9cc1-44b7-917a-f8960ad9d9b4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:21.710435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:21.711076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:21.711363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:21.711646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:21.720689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:21.722098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67a5a9-a2c7-4db6-94fa-301b11440b6f service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:21.731286 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 732/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:24.196303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337110-7cf8-4019-a7bd-d1c39d97e3c1 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:24.196808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337110-7cf8-4019-a7bd-d1c39d97e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:24.197113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337110-7cf8-4019-a7bd-d1c39d97e3c1 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:24.198889 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 744/1476] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:24.205792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdec58-7fe3-4bcc-b7ca-38ed780d16c2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:24.206222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdec58-7fe3-4bcc-b7ca-38ed780d16c2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:24.206635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdec58-7fe3-4bcc-b7ca-38ed780d16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:24.225374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-41bdec58-7fe3-4bcc-b7ca-38ed780d16c2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:24.226597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-41bdec58-7fe3-4bcc-b7ca-38ed780d16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:24.234225 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 733/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:24.259190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38337110-7cf8-4019-a7bd-d1c39d97e3c1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:24.272282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38337110-7cf8-4019-a7bd-d1c39d97e3c1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:24.276803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:24.277482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:24.277767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:24.278045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:24.278766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:24.280544 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:44:24.280544 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:44:24.280544 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:44:24.281690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba08b6-e1e4-4f37-866d-609ffc54b28d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:24.300207 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 745/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Apr 2 20:44:24 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:44:26.688204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121887-8494-4d41-b6ed-98e7f4329ac1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:26.688803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121887-8494-4d41-b6ed-98e7f4329ac1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:26.688803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6121887-8494-4d41-b6ed-98e7f4329ac1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:26.690611 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 734/1479] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:26.697779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df5d5-b9a9-4ab3-b279-2bcc1de7072b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:26.698221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df5d5-b9a9-4ab3-b279-2bcc1de7072b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:26.698333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4df5d5-b9a9-4ab3-b279-2bcc1de7072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:26.716231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4f4df5d5-b9a9-4ab3-b279-2bcc1de7072b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:26.717368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4f4df5d5-b9a9-4ab3-b279-2bcc1de7072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:26.725106 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 746/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:26.768204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6121887-8494-4d41-b6ed-98e7f4329ac1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:26.782246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6121887-8494-4d41-b6ed-98e7f4329ac1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:26.787587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:26.788223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:26.788538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:26.788820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:26.796838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:26.798409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3153af-1905-4348-b0e3-4e86c45c7cb6 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:26.808729 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 735/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:29.342268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6bb91-41ae-431a-86a5-3c94481f76af None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:29.342823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6bb91-41ae-431a-86a5-3c94481f76af None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:29.342823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6bb91-41ae-431a-86a5-3c94481f76af None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:29.344638 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 747/1482] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:29.352178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780af7-e785-47a8-9853-2bad2458c801 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:29.352658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780af7-e785-47a8-9853-2bad2458c801 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:29.352775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780af7-e785-47a8-9853-2bad2458c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:29.371214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-71780af7-e785-47a8-9853-2bad2458c801 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:29.372403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-71780af7-e785-47a8-9853-2bad2458c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:29.380288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 736/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:29.417858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6bb91-41ae-431a-86a5-3c94481f76af None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:29.429127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6bb91-41ae-431a-86a5-3c94481f76af None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:29.433167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:29.433848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:29.434139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:29.434420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:29.445249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:29.447289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206927e-df53-4f18-aa38-0b15221375da service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:29.457838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 748/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:31.855306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1ee7d-7eee-44ac-8e03-ab2eacbfcc2a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:31.855823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1ee7d-7eee-44ac-8e03-ab2eacbfcc2a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:31.855823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1ee7d-7eee-44ac-8e03-ab2eacbfcc2a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:31.857570 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 737/1485] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:31.865222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357fc1-fbb3-4ca7-8532-3b43d148637b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:31.865670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357fc1-fbb3-4ca7-8532-3b43d148637b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:31.865837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357fc1-fbb3-4ca7-8532-3b43d148637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:31.883441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0d357fc1-fbb3-4ca7-8532-3b43d148637b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:31.884682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d357fc1-fbb3-4ca7-8532-3b43d148637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:31.892319 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 749/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:31.931080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1ee7d-7eee-44ac-8e03-ab2eacbfcc2a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:31.941374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1ee7d-7eee-44ac-8e03-ab2eacbfcc2a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:31.944794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:31.945424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:31.945707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:31.945978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:31.954470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:31.955878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2cac8-308c-4d76-98f5-d0f73d4d9767 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:31.966016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 738/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:34.426576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f114-d0f2-4e7c-bc79-aea37b9cf611 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:34.427100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f114-d0f2-4e7c-bc79-aea37b9cf611 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:34.427100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f114-d0f2-4e7c-bc79-aea37b9cf611 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:34.428850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 750/1488] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:34.435583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6537-b65a-4986-ada4-7df591e4dd7c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:34.436040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6537-b65a-4986-ada4-7df591e4dd7c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:34.436140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa6537-b65a-4986-ada4-7df591e4dd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:34.453768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3eaa6537-b65a-4986-ada4-7df591e4dd7c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:34.454992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3eaa6537-b65a-4986-ada4-7df591e4dd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:34.463001 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 739/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:34.504932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f114-d0f2-4e7c-bc79-aea37b9cf611 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:34.515469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f114-d0f2-4e7c-bc79-aea37b9cf611 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:34.518981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:34.519626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:34.519886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:34.520158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:34.528920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:34.530329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6a522-b407-4b77-ad61-1046cded1b08 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:34.540205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 751/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:44:37.034414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b229e8-8199-448a-924c-4e5a8b8984aa None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:37.034951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b229e8-8199-448a-924c-4e5a8b8984aa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:37.035066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b229e8-8199-448a-924c-4e5a8b8984aa None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:37.036834 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 740/1491] 10.222.0.18 () {54 vars in 926 bytes} [Sat Apr 2 20:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:44:37.043282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc450-53a7-41a5-870d-1d7aac39fd2d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:37.043717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc450-53a7-41a5-870d-1d7aac39fd2d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:37.043843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc450-53a7-41a5-870d-1d7aac39fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:37.061972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3e2cc450-53a7-41a5-870d-1d7aac39fd2d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:44:37.063222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3e2cc450-53a7-41a5-870d-1d7aac39fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:44:37.071810 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 752/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Apr 2 20:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:44:37.110790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b229e8-8199-448a-924c-4e5a8b8984aa None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:44:37.126962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b229e8-8199-448a-924c-4e5a8b8984aa None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:44:37.131449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:44:37.132094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:44:37.132379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:44:37.132688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:44:37.142067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:44:37.143498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea30f3-d20e-443a-9a1b-ef88e7310240 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:44:37.152809 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 741/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:45:57.415759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.416358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.416358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.434381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:45:57.435835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:57.444245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 753/1494] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:45:57.453375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.453920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.454309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.471775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:45:57.473003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:57.480793 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 742/1495] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:45:57.485875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.495398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c0f7-539f-4459-8801-9e3331129d29 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.499821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.500503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.501337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.501616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.502372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:45:57.502675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.503723 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.503723 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:45:57.503723 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:45:57.504634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.515916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 754/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:45:57.523812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.532915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda0cc-3704-46b9-b89d-61fe91ffddca None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.537495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.538139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.538426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.538711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.539384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.541103 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.541103 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:45:57.541103 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:45:57.542301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.576695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 743/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:45:57 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:45:57.581019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.590736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d99fa1-342f-4740-a934-dfaea58b8e67 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.643483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.644203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.644514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.644938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.645618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.646623 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.646623 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:45:57.646623 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:45:57.647825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.667744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 755/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:45:57 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:45:57.671712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.682085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a52e-1285-4ffa-ae91-99c157364a2a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.686527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.687182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.687459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.687731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.688501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.689503 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.689503 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:45:57.689503 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:45:57.690379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.702899 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 744/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:45:57.707448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.717199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194570c2-2e8f-4dad-856f-16b51aff5079 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.722194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.722873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.723159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.723439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.724157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.725212 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.725212 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:45:57.725212 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:45:57.726103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d275c-6d4d-4592-9abf-fbb59707ab81 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.739531 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 756/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:45:57.743442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.753056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888bde7-193d-49f5-a438-e19d8bebb0bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.757498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.758358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.758634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.758904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] PATH_INFO: `/v3/projects/998bd6b0d1234a5ba2ae357e4d162ea6/users/8276790eddd94ecf99d6842b767655a6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.773114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=998bd6b0d1234a5ba2ae357e4d162ea6, user_id=8276790eddd94ecf99d6842b767655a6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.774157 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:57.774157 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:45:57.774157 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:45:57.776142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.789504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 745/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:45:57 2022] PUT /identity/v3/projects/998bd6b0d1234a5ba2ae357e4d162ea6/users/8276790eddd94ecf99d6842b767655a6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:45:57.801253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512c88-722c-4cf6-8800-c3f68857104d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.801542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512c88-722c-4cf6-8800-c3f68857104d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.801819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec512c88-722c-4cf6-8800-c3f68857104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.826592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ec512c88-722c-4cf6-8800-c3f68857104d None None] MFA Rules not processed for user `8276790eddd94ecf99d6842b767655a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:45:57.827767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec512c88-722c-4cf6-8800-c3f68857104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:57.888182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 757/1502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:45:57.899029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:57.965127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c690-28ae-4e1b-b342-ee7111d00eca admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:57.970984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:57.971618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:57.971906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:57.972184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:57.979624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:57.981246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:57.990325 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 746/1503] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:45:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:45:58.059971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190a52f-e5cf-4053-a59e-76cfa0e1f46b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:58.060267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190a52f-e5cf-4053-a59e-76cfa0e1f46b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:58.060601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190a52f-e5cf-4053-a59e-76cfa0e1f46b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:58.062289 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 758/1504] 10.222.0.18 () {52 vars in 829 bytes} [Sat Apr 2 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:45:58.066000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:58.125477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95a63-128f-4eb0-b12b-3a191828bbc4 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:58.130017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:58.130868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:58.131151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:58.131429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] PATH_INFO: `/v3/users/8276790eddd94ecf99d6842b767655a6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:58.132628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8276790eddd94ecf99d6842b767655a6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:58.133627 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:58.133627 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:45:58.133627 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:45:58.134827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:58.195840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8276790eddd94ecf99d6842b767655a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.213910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8276790eddd94ecf99d6842b767655a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.214561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8276790eddd94ecf99d6842b767655a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.225272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8276790eddd94ecf99d6842b767655a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.237398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8276790eddd94ecf99d6842b767655a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.243655 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 747/1505] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:45:58 2022] DELETE /identity/v3/users/8276790eddd94ecf99d6842b767655a6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:45:58.248108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:58.248398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:58.248709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:58.268842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:45:58.270034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:58.327259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 759/1506] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:45:58.337697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:58.339080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:58.393967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b38ff-cdc1-4d5e-bec6-981c7fc93bff admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:58.397534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:58.398172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:58.398457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:58.398734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:58.407933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:58.409411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb4128-60a9-4854-b0b3-113ab6d79a29 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:58.419352 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 748/1507] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:45:58.734020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:45:58.736051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:45:58.748082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7bea9-a1d1-4cdc-a6bb-f745716d36e5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:45:58.752925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:45:58.753783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:45:58.754064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:45:58.754338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] PATH_INFO: `/v3/projects/998bd6b0d1234a5ba2ae357e4d162ea6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:45:58.755507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998bd6b0d1234a5ba2ae357e4d162ea6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:45:58.756623 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:45:58.756623 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:45:58.756623 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:45:58.757827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:45:58.821326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998bd6b0d1234a5ba2ae357e4d162ea6', 'request_id': 'req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.836175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998bd6b0d1234a5ba2ae357e4d162ea6', 'request_id': 'req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.846696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998bd6b0d1234a5ba2ae357e4d162ea6', 'request_id': 'req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.857703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] The token cache is being invalidate because project 998bd6b0d1234a5ba2ae357e4d162ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:45:58.857986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.858751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2f5cb8d-aac7-4b8e-b0d6-b559ecdcd6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:45:58.860481 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 760/1508] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:45:58 2022] DELETE /identity/v3/projects/998bd6b0d1234a5ba2ae357e4d162ea6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:49:16.688651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c447-f811-4f69-bac8-5b86799bc564 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:16.689265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c447-f811-4f69-bac8-5b86799bc564 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:16.689265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c447-f811-4f69-bac8-5b86799bc564 None None] PATH_INFO: `/v3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:16.690475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 749/1509] 10.222.0.21 () {54 vars in 925 bytes} [Sat Apr 2 20:49:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:49:16.706386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829e1c-4fd7-44fd-bf36-525a0a3079e7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:16.706794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829e1c-4fd7-44fd-bf36-525a0a3079e7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:16.706937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829e1c-4fd7-44fd-bf36-525a0a3079e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:16.725064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d9829e1c-4fd7-44fd-bf36-525a0a3079e7 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:16.726257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9829e1c-4fd7-44fd-bf36-525a0a3079e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:16.790549 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 761/1510] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Apr 2 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:19.339477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eba70-8fe8-482e-bc1a-c912fd77f188 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:19.340071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eba70-8fe8-482e-bc1a-c912fd77f188 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:19.340071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eba70-8fe8-482e-bc1a-c912fd77f188 None None] PATH_INFO: `/v3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:19.341356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 750/1511] 10.222.0.15 () {54 vars in 925 bytes} [Sat Apr 2 20:49:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:49:19.359003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fb8b-72f5-45e6-9ed6-34547dedc5fb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:19.359407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fb8b-72f5-45e6-9ed6-34547dedc5fb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:19.359568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07fb8b-72f5-45e6-9ed6-34547dedc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:19.377168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c07fb8b-72f5-45e6-9ed6-34547dedc5fb None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:19.378361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c07fb8b-72f5-45e6-9ed6-34547dedc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:19.386771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 762/1512] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Apr 2 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:21.128758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40aa81-85b3-4177-b638-9754d8e20f75 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:21.129265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40aa81-85b3-4177-b638-9754d8e20f75 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:21.129265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40aa81-85b3-4177-b638-9754d8e20f75 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:21.131014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 751/1513] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:49:21.136114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc06b2-123d-4901-855d-0c6551499107 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:21.136561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc06b2-123d-4901-855d-0c6551499107 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:21.136713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc06b2-123d-4901-855d-0c6551499107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:21.154964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e3dc06b2-123d-4901-855d-0c6551499107 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:21.156145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3dc06b2-123d-4901-855d-0c6551499107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:21.164604 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 763/1514] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:21.172031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40aa81-85b3-4177-b638-9754d8e20f75 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:49:21.185142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40aa81-85b3-4177-b638-9754d8e20f75 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:49:21.190661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:49:21.191292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:21.191580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:21.191862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:21.200186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:49:21.201789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c4480-8e96-4947-b4ae-740ba3cdd84e service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:49:21.211928 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 752/1515] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:49:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:49:23.003424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dc92-a7a3-4fdf-aaac-6c1d38ad5f77 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:23.003841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dc92-a7a3-4fdf-aaac-6c1d38ad5f77 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:23.003992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dc92-a7a3-4fdf-aaac-6c1d38ad5f77 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:23.005828 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 764/1516] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:49:23.010963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955a5b-3a56-4e22-95c9-7aea1e71103c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:23.011386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955a5b-3a56-4e22-95c9-7aea1e71103c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:23.011548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955a5b-3a56-4e22-95c9-7aea1e71103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:23.029309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fd955a5b-3a56-4e22-95c9-7aea1e71103c None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:23.030503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fd955a5b-3a56-4e22-95c9-7aea1e71103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:23.039164 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 753/1517] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:23.047285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178dc92-a7a3-4fdf-aaac-6c1d38ad5f77 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:49:23.061678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178dc92-a7a3-4fdf-aaac-6c1d38ad5f77 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:49:23.067250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:49:23.067886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:23.068176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:23.068467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:23.076993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:49:23.078681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f257d-3e64-44ea-bdfd-3e60f563340c service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:49:23.088554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 765/1518] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:49:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:49:52.472260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:52.472818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:52.472932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:52.474620 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 754/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:49:52.479412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1538f-c36b-469b-86b0-1f4d75e8c3c5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:52.479840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1538f-c36b-469b-86b0-1f4d75e8c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:52.479970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1538f-c36b-469b-86b0-1f4d75e8c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:52.497313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-57a1538f-c36b-469b-86b0-1f4d75e8c3c5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:52.498477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-57a1538f-c36b-469b-86b0-1f4d75e8c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:52.553014 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 766/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:52.707814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:49:52.709485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:52.783739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15186bf3-121d-49e3-8d52-0d6188203565 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:49:52.789141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:49:52.789784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:52.790070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:52.790348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:52.798227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:49:52.799783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d93e-a8a3-4c0b-9a2e-74617d4d27c8 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:49:52.809411 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 755/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:49:54.144168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221791-8f50-4f8e-952e-5d0b68be8db5 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:54.144780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221791-8f50-4f8e-952e-5d0b68be8db5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:54.144780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221791-8f50-4f8e-952e-5d0b68be8db5 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:54.146509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 2 20:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:49:54.151338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c1a-2f7d-4bb7-aed2-6fbae92cf590 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:54.151742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c1a-2f7d-4bb7-aed2-6fbae92cf590 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:54.151925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c1a-2f7d-4bb7-aed2-6fbae92cf590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:54.169915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cb7b0c1a-2f7d-4bb7-aed2-6fbae92cf590 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:54.171101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cb7b0c1a-2f7d-4bb7-aed2-6fbae92cf590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:54.178735 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 2 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:54.334771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221791-8f50-4f8e-952e-5d0b68be8db5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:49:54.349358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221791-8f50-4f8e-952e-5d0b68be8db5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:49:54.355434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:49:54.356064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:54.356348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:54.356669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:54.364786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:49:54.366366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5717-833c-4f01-8125-e15cb0e205e6 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:49:54.375494 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 768/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:49:58.494698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:58.495247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:58.495339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:58.497125 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:49:58.502235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cacc9-7d3f-465f-8e7e-4f4e05527ec8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:58.502748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cacc9-7d3f-465f-8e7e-4f4e05527ec8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:58.502853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cacc9-7d3f-465f-8e7e-4f4e05527ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:58.521648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-256cacc9-7d3f-465f-8e7e-4f4e05527ec8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:49:58.522934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-256cacc9-7d3f-465f-8e7e-4f4e05527ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:58.531459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:49:58.568870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:49:58.570549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:49:58.627531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedcf5c-1515-4649-88a6-71100b718aee None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:49:58.630994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:49:58.631630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:49:58.631909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:49:58.632182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:49:58.640788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:49:58.642203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ae849-5a89-43a4-bb68-fbb73d00e3fd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:49:58.651486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 758/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:50:00.995438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ed52-dcd9-45c3-91f9-bc9f3dd8d8fe None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:50:00.995975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ed52-dcd9-45c3-91f9-bc9f3dd8d8fe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:50:00.995975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ed52-dcd9-45c3-91f9-bc9f3dd8d8fe None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:50:00.997774 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 2 20:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:50:01.004023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6fa7e-5b8c-47f6-b186-2eba98fa880b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:50:01.004595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6fa7e-5b8c-47f6-b186-2eba98fa880b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:50:01.004595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6fa7e-5b8c-47f6-b186-2eba98fa880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:50:01.022795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-75a6fa7e-5b8c-47f6-b186-2eba98fa880b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:50:01.024009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-75a6fa7e-5b8c-47f6-b186-2eba98fa880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:50:01.032883 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 2 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:50:01.069340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500ed52-dcd9-45c3-91f9-bc9f3dd8d8fe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:50:01.079857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500ed52-dcd9-45c3-91f9-bc9f3dd8d8fe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:50:01.083583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:50:01.084207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:50:01.084518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:50:01.084796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:50:01.094068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:50:01.095485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836ae6-5ef5-42b1-bc13-a15a33abdb41 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:50:01.105292 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 771/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:50:52.518885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae305-523c-4ece-82e4-a1229839426e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:50:52.519495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae305-523c-4ece-82e4-a1229839426e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:50:52.519609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ae305-523c-4ece-82e4-a1229839426e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:50:52.521361 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 760/1531] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:50:52.527761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904919-3458-4564-b295-f2984dfc3458 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:50:52.528273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904919-3458-4564-b295-f2984dfc3458 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:50:52.529054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904919-3458-4564-b295-f2984dfc3458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:50:52.549696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4a904919-3458-4564-b295-f2984dfc3458 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:50:52.551047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4a904919-3458-4564-b295-f2984dfc3458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:50:52.561206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 772/1532] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:28.476604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.477154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.477154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.504776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:28.505993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:28.518230 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 761/1533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:28.537246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.538923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.540520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.580089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:28.581676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:28.598943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 773/1534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:28.603860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:28.616714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcae12-94c7-4fae-8316-4420f8fcc5c9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:28.625135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:28.626015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.626461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.626877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.627835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:28.628279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:28.629515 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:28.629515 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:51:28.629515 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:51:28.630677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507886-8bdb-4cd5-82d4-15af97bd791b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:28.649443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 762/1535] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:28.659391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:28.671119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba539-b0a3-4b99-9448-2418279ce3dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:28.682410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550b18-4edf-430d-b9ad-2b3031495211 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.683018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550b18-4edf-430d-b9ad-2b3031495211 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.683543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550b18-4edf-430d-b9ad-2b3031495211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.687119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:28.687119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.687119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.687119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.687979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:28.689498 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:28.689498 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:51:28.689498 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:51:28.690873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:28.725735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-95550b18-4edf-430d-b9ad-2b3031495211 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:28.727423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-95550b18-4edf-430d-b9ad-2b3031495211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:28.750334 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 774/1536] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:28.751901 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 763/1537] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:28.755198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:28.763178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d6ab-421d-4225-86ec-9ee6b9e62b56 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.763784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d6ab-421d-4225-86ec-9ee6b9e62b56 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.764259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d6ab-421d-4225-86ec-9ee6b9e62b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.807299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f748d6ab-421d-4225-86ec-9ee6b9e62b56 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:28.808690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f748d6ab-421d-4225-86ec-9ee6b9e62b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:28.904647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80e44-49fb-4578-b7bd-9fd59c9baf81 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:28.913520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:28.916473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:28.916473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:28.916473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:28.916473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:28.918219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c9e90-337e-4d38-b8ff-873469b25763 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.004394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 775/1538] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.006081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.006382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.008246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.015745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 764/1539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:29.017316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.017812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.018288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.030817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.032642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.052493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 776/1540] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.052493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.066523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c6ee-8026-4bef-9063-4aea4ae0b07e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.077172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.078692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.081214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.081967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.082379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.082661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.083386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.085333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126fd31-6e4d-4ef1-9abc-d0d747589a3f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.093387 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 765/1541] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.094726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.097273 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 777/1542] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:29.098598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096319ec-31ed-492b-a840-675d9fe8876c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.098881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096319ec-31ed-492b-a840-675d9fe8876c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.099157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096319ec-31ed-492b-a840-675d9fe8876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.112174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75165a47-de94-4451-af88-c6d30f98ea7a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.128326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.129040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.129322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.129596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.130717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.131035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.132689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b954e-a643-45cf-9c00-7254a9bcaca2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.140485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-096319ec-31ed-492b-a840-675d9fe8876c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.141704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-096319ec-31ed-492b-a840-675d9fe8876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.154879 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 766/1543] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.156526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4ad4-6255-4bb0-b7a0-29278964c77f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.156991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4ad4-6255-4bb0-b7a0-29278964c77f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.157464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4ad4-6255-4bb0-b7a0-29278964c77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.158459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 778/1544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.162605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.162605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.162605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.178622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-214e4ad4-6255-4bb0-b7a0-29278964c77f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.180057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-214e4ad4-6255-4bb0-b7a0-29278964c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.180685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.181916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.190831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 779/1545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.191810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.192065 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 767/1546] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.193564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a8da-00f3-419f-82ed-4d5ea08c0299 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.194107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a8da-00f3-419f-82ed-4d5ea08c0299 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.194379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a8da-00f3-419f-82ed-4d5ea08c0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.212662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ad2c4-4ac7-4389-80bd-94d5f8a445e8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.215463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0212a8da-00f3-419f-82ed-4d5ea08c0299 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.216929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0212a8da-00f3-419f-82ed-4d5ea08c0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.219386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.220413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.220879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.221230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.222027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.223723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.225809 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 768/1547] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.227329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.227621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.227898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.235045 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 780/1548] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:29.236767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.248990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.249949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a92e74-af8e-4753-afae-ea4ee01ed5be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.250259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.254468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.255215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.255399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.256497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.256497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.258382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac8a0f-304a-414b-a0a1-303423b819bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.260325 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 769/1549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.262138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.271447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030ee0-4ea2-4c9e-bbc8-5fd548c82607 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.276516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.277206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.277492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.277797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.278510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.278817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.280481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0178a16-54bb-43e9-b035-4599fdb81a8f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.290389 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 781/1550] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.292006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.292298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.292621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.300381 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 770/1551] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.300381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712815-6962-40f9-8874-4d202583ae85 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.300381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712815-6962-40f9-8874-4d202583ae85 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.300381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712815-6962-40f9-8874-4d202583ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.313290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-46712815-6962-40f9-8874-4d202583ae85 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.314496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46712815-6962-40f9-8874-4d202583ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.318228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.319655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.375637 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 771/1552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.376956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.377246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.377532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.382999 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 782/1553] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.383881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.394017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874cb6a-49a5-4f33-8303-b40b26f27b48 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.396271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.397512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.398994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.399650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.399938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.400219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.400990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.401302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.402933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8f06-3593-4856-9c98-f28a96fb58fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.405441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 772/1554] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.406133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.415304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 783/1555] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.416232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660b91-4e99-418a-a799-c663a4606a67 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.416618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.416914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.417193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.426111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.427023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.427308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.427588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] PATH_INFO: `/v3/projects/77f55ac7e48c4634ba63ef1bec31a1de/users/f3407b4401294ecb8b01a81ef19dd474/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.435315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.436531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.442809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f55ac7e48c4634ba63ef1bec31a1de, user_id=f3407b4401294ecb8b01a81ef19dd474, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.445761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.448276 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 784/1556] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.449735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.459365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb3b37-ade6-436d-817a-8a32b9bf8d50 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.460305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 773/1557] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:29 2022] PUT /identity/v3/projects/77f55ac7e48c4634ba63ef1bec31a1de/users/f3407b4401294ecb8b01a81ef19dd474/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:29.461131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.519561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.520234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.520561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.520755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1b9b-030b-4658-bacb-d2e40809e587 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.521193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.521531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.523574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.525638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.526296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.526608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.527118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.527805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.529747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.543443 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 785/1558] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.544260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.558855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 774/1559] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.559044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f11b80-fcd4-434f-b132-7d5902fb823a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.559126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.615742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.616406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.616725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.616850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe54248-d566-4281-8513-2823d1887c9f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.617002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.617722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.618032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.619630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc21eb-35f4-4bb7-9f3a-df8dc4ac9579 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.622235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.622894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.623179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.623476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.624203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.624540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.626132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.631255 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 786/1560] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.632568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.632863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.633139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.640494 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 775/1561] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.640494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.648399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35654-8c09-41d0-83d5-0d771cef9cc8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.653085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.653717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.653999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.654269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.654934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.656939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54359535-a199-4f76-8e19-b5fcc2de2a8d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.660596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.661786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.670383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 787/1562] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.671169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.680933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df460-f18f-4f96-9d8c-e9998f075042 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.686668 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 776/1563] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.686668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.686668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.686668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.717638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] MFA Rules not processed for user `f3407b4401294ecb8b01a81ef19dd474`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:29.718849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:29.737746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.738432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.738720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.739000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.739713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.740023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.741661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.753168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 788/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.753961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.763283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b584dc-7234-4b3a-b9be-83e959fb404d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.767831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.768476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.768785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.769066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.769767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.771328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.785005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 789/1565] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:29.785005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.785213 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 777/1566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:29.785525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.795170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7727-4306-4f8c-a7ee-d928f74192e3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.797946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0f312-f852-4b59-89c0-489a5cfbbbb5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.799708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.800361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.800681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.800978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.801658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.802682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.803332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.803618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.803698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.803897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.804611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.806483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.824296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 790/1567] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.825279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.834922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9a74e-22ad-41b4-aac7-76ffd61b67f2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.836063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 778/1568] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.836919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.891982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.892686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.892975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.893257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.894894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.896833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.897238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e6503-c977-4748-a2f8-271109e30187 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.901726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.902375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.902655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.902926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.903633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:29.903939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.905552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.924878 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 779/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:29.924878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.925112 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 791/1570] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:29.925112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:29.930936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd057bb6-e1c1-4edf-ac60-13daa9723c14 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.982607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ee699-119f-40e0-8387-eee77afed9b7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:29.984618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.985284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.985570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.985847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.986521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.987204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:29.987531 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:29.987531 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:51:29.987531 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:51:29.987848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:29.988129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:29.988402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:29.988752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:29.989100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:29.990969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.009545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 780/1571] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.010471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.016890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 792/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:29 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.017691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.020812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9b4f5-e9bf-4970-91c3-e76ef3922b06 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.076299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ab2de-0c1e-4d8c-be5a-27138eeda366 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.076547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.077115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.077401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.077679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.078361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.080311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.080861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.081514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.081793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.082066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.082773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.084331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.094559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 793/1573] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.095746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.106418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 781/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.106653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13227-1c3e-4cf4-ba79-ad1eb3494ff7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.107807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.163033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.163699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.163988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.164271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.165055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.166684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.166887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded6c0-2936-4d3a-8221-27b63f8f20d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.172188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.172879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.173159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.173436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.174107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.176041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.177345 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 794/1575] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.178104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.187568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c14de-70d9-447b-a90b-fafb6527c926 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.192482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.193086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.193367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.193641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.194578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.196510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.199476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 782/1576] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.200293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.209630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af310541-5945-4832-9504-27eb13e0f50d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.214297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.215482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.215766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.216088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.216846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.218803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.225321 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 795/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.226284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.239263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 783/1578] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.240119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.249702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a54a1-306e-4ec4-984b-a6a16f4b2255 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.288987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7ea5-a2a7-4b99-880f-3e7fb6e49e37 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.294315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.295024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.295335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.295615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.296333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.298009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.304150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.304865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.305152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.305430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.306117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.307726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 796/1579] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.308006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.308744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.318417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8865b7-7853-4686-b940-97b04d4a1ce1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.323499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.324398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.324719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.325020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] PATH_INFO: `/v3/projects/b9fb7e0a29fc4b53825f8910b80bc992/users/61c0b07ac66748afbf2c5671b1adaf08/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.330248 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 784/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.330248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.337294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89f597-4a18-45ce-9245-26da412e481c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.342776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.342940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fb7e0a29fc4b53825f8910b80bc992, user_id=61c0b07ac66748afbf2c5671b1adaf08, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.343428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.343713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.343995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.344124 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:30.344124 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:51:30.344124 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:51:30.344706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.346148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.346593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.361002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 797/1581] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/b9fb7e0a29fc4b53825f8910b80bc992/users/61c0b07ac66748afbf2c5671b1adaf08/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:30.361849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.371620 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 785/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/users => generated 305 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.371620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.381607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446651fb-5b84-4fdd-9174-a3f58deb35f7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.429297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3db1-e02b-4364-9e48-ecc9fe7de30c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.434133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.434811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.435102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.435411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.436134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.436708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.437372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.437655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.437806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.437935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.438654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.440401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.447883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 798/1583] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.448707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.454093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 786/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.454093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.459326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370c08e-ab1c-4527-b168-21682ad75045 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.461985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf57c8-5855-4bfb-9e6e-c31ed623c397 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.463991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.465252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.465544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.465822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.466498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.467591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.468243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.468407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.468577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.468817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.469522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.471086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.481277 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 787/1585] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.482487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.488473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 799/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/users => generated 300 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.489291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.494193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232f2-0783-4c8f-830a-221eb1bf0b60 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.498859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea819-252c-49db-a585-14c96dd241d8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.498990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.499600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.499889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.500169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.500923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.502553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.503704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.504360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.504693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.504976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.505696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.507495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb535-28ac-4bb5-944f-7f93c815bb8e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.513576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 788/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.514449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.522545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 800/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.522545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.522545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.522545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.524321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11508d8-dbd3-4d5c-b219-871f3fd5a2f1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.529833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.530482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.530762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.531033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.531739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.533409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.543235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 789/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.543235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.548151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] MFA Rules not processed for user `61c0b07ac66748afbf2c5671b1adaf08`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:30.549388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:30.553417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3579e-3f20-4dfd-bdc1-ff6507d4068a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.558060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.558934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.559217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.559494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] PATH_INFO: `/v3/projects/65a0a62b97b54e7da98fb1453ad5c79a/users/8a051b383e084a5d85a0708fa2fe04f7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.573625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a0a62b97b54e7da98fb1453ad5c79a, user_id=8a051b383e084a5d85a0708fa2fe04f7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.576836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.590913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 790/1590] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/65a0a62b97b54e7da98fb1453ad5c79a/users/8a051b383e084a5d85a0708fa2fe04f7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:30.591780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.618314 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 801/1591] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:30.619147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.629311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4eac5-350a-434e-b7eb-36de7ac577ee None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.651791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0acd-6292-44d6-82ba-33ffc48ec4f5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.656927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.657603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.657889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.658174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.658930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.660549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.670229 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 791/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.671028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.680494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548915-7385-436d-97bb-287da7ba6f15 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.685030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.685667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.685956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.686241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.686942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.688501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.688653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.689211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.689496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.689770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.690594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.692167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.698475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 792/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.699779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.705880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 802/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.705880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.711741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17736bdd-a07d-4fb7-841a-15ae7579b759 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.713978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5429-a1fb-4276-b60e-76aa0f4e2fc5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.716959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.717839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.718119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.718396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] PATH_INFO: `/v3/projects/a23ce3f3e63240dfa5f2f6cef20a8f18/users/119b2d399fe14efebf869ca09be102f5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.719151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.719776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.720058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.720333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.721103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.722671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.732072 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 803/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.732851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.735966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ce3f3e63240dfa5f2f6cef20a8f18, user_id=119b2d399fe14efebf869ca09be102f5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.738745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbd61b-3ce0-405c-8332-ffceb058542b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.744477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353199a-5ef9-411f-a4c2-b62949c227c6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.749993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.750889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.751190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.751465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] PATH_INFO: `/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08/users/9db736445f7045cfbae7e481895d23a5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.752418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 793/1596] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/a23ce3f3e63240dfa5f2f6cef20a8f18/users/119b2d399fe14efebf869ca09be102f5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:30.753684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.753962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.754242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.775251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8a9be50ed245fba2aa19eee5c6ee08, user_id=9db736445f7045cfbae7e481895d23a5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.777983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.779650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] MFA Rules not processed for user `8a051b383e084a5d85a0708fa2fe04f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:30.780903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:30.790486 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 804/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08/users/9db736445f7045cfbae7e481895d23a5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:30.791486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.844752 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 794/1598] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:30.848259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.853450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5691-d947-46e6-b22f-024efe7175d6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.858222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.858907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.859194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.859475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.860154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.862119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.888490 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 805/1599] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:30 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:30.888490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.905705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70679804-c011-4c00-8da5-1c64438e4457 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.949955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e09e-5478-44bb-9bef-ffccdd5c7e72 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.954806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.955463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.955745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.956070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.956857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.958454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.959839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.960918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.961200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.961481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] PATH_INFO: `/v3/projects/162245b155e14a71bfc8d9d5250e4c78/users/2296e93e1a6941019126bc05a1c990be/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.968098 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 806/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:30.969128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:30.975922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162245b155e14a71bfc8d9d5250e4c78, user_id=2296e93e1a6941019126bc05a1c990be, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:30.978630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1ac8-b709-419b-a6a4-272282fc48ca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:30.978761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:30.983311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:30.984279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:30.984611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:30.984900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] PATH_INFO: `/v3/projects/e2256486ffe742f1bd7777b410610a88/users/d6343df3331040deaa106799798d583c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:30.991363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 795/1601] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/162245b155e14a71bfc8d9d5250e4c78/users/2296e93e1a6941019126bc05a1c990be/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:30.992267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.000693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2256486ffe742f1bd7777b410610a88, user_id=d6343df3331040deaa106799798d583c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.003448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42d882-4e40-4ddc-b049-7e6dd5d8054a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.016230 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 807/1602] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/e2256486ffe742f1bd7777b410610a88/users/d6343df3331040deaa106799798d583c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:31.025934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.025934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.025934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.050027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] MFA Rules not processed for user `119b2d399fe14efebf869ca09be102f5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.051259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.053788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f9904-7b26-4fca-9032-6734526eea98 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.108152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.109740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.110024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.110307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] PATH_INFO: `/v3/projects/fd4106d02c9d4298a582766c6d8c6e55/users/bd902cc59620409aa633df1d2772f812/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.113741 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 808/1603] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.113998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.124749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ab600-22cf-4953-afc9-1b36513c61c5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.126353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4106d02c9d4298a582766c6d8c6e55, user_id=bd902cc59620409aa633df1d2772f812, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.129082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.129238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.129895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.130176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.130452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.131195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.132842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.144005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 809/1604] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:31.153418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 796/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:30 2022] PUT /identity/v3/projects/fd4106d02c9d4298a582766c6d8c6e55/users/bd902cc59620409aa633df1d2772f812/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:31.153588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.153666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.154019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2665-8db5-4eae-870d-1b70f800d99c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.208622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.209205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.209486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.209756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.210429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.212340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.213083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7456be-d446-4c34-aaff-2b5d866c10c3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.217699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.218362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.218647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.218925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.219598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.221532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc092a95-9e63-4bf3-b073-8b0864e008c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.240639 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 810/1606] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:31.240639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.243784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 797/1607] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:31.245203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071e07-33ac-43d0-9c5a-e3b60dc7e661 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.245478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071e07-33ac-43d0-9c5a-e3b60dc7e661 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.245823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071e07-33ac-43d0-9c5a-e3b60dc7e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.262949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a0071e07-33ac-43d0-9c5a-e3b60dc7e661 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.264240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a0071e07-33ac-43d0-9c5a-e3b60dc7e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.298814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fdf8b-401d-4929-98a2-ba6d844d6e22 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.303463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.304352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.304666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.304949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] PATH_INFO: `/v3/projects/fde6bd005e3a4a25b63639832027ab85/users/c42119999e6f40b487a7174dc5a7d617/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.319976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6bd005e3a4a25b63639832027ab85, user_id=c42119999e6f40b487a7174dc5a7d617, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.322774 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 798/1608] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.322882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.323982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.324277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.324592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.339102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 811/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:31 2022] PUT /identity/v3/projects/fde6bd005e3a4a25b63639832027ab85/users/c42119999e6f40b487a7174dc5a7d617/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:31.339940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.352208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] MFA Rules not processed for user `d6343df3331040deaa106799798d583c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.353454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.391592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744020c-6662-4f48-805f-5e397dcaba34 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.395270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.395917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.396198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.396498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.415815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 799/1610] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.416760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.452357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.453881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51054-b85a-44b6-b187-c1282fc74a9b service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.462853 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 812/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:31.464050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.464340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.464823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.481254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b667b6-ea45-458f-bc95-f28a3e2f75b7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.486721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.487662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.488001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.488282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] PATH_INFO: `/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08/users/9db736445f7045cfbae7e481895d23a5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.490328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8a9be50ed245fba2aa19eee5c6ee08, user_id=9db736445f7045cfbae7e481895d23a5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.493371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] MFA Rules not processed for user `bd902cc59620409aa633df1d2772f812`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.493487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.494892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.506650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 800/1612] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:31 2022] PUT /identity/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08/users/9db736445f7045cfbae7e481895d23a5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:31.507487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.567835 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 813/1613] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.569359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.580981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a91f-11d1-47ad-aa03-8d0bd97c2e6c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.582100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d4ff-3998-40f9-9584-e59eeee4e7b8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.586137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.586812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.587097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.587184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.587371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.587826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.588052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.588143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.588377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.589132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.590562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aef786-e848-4a81-a68e-dc9c917de7a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.591286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.601696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 814/1614] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:31.602519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.614939 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 801/1615] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:31.616163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.616491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.616763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.640630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.642946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.654010 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 802/1616] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.654010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.662757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112728c-f560-4224-b188-b3a45c68b71e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.668710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.669445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.669797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.670468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.670936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.673048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.674007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89233-a2a5-47fb-aeae-ddeccabbb47b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.677869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.678543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.678831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.679112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.688866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.690306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee24bd-4a68-41fb-a687-08ea7ed0d0ff service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.701349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 815/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:31.705492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 803/1618] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:31.705604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.705604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.705604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.705798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.731698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] MFA Rules not processed for user `9db736445f7045cfbae7e481895d23a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:31.732860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:31.770339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ecbd-c48d-4d4b-86a7-011adf44dc11 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.775171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.775913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.776277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.776690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.778137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.780176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.809573 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 816/1619] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:31.810540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.812011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 804/1620] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:31.813258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.827949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228bc7b-4f2e-4359-908d-0462f88104c9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.888186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.889244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.889537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.889833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] PATH_INFO: `/v3/projects/9904a696bbb043e4bafd415933961394/users/9305cf7e03bc4388aab4c8c1255ae476/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.890077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e3683-3029-45a1-b8e8-864f6d870439 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:31.899636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:31.900391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:31.900683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:31.900964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:31.902871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.905220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.910740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9904a696bbb043e4bafd415933961394, user_id=9305cf7e03bc4388aab4c8c1255ae476, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:31.913671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:31.921101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 805/1621] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:31.921101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.933901 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 817/1622] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:31 2022] PUT /identity/v3/projects/9904a696bbb043e4bafd415933961394/users/9305cf7e03bc4388aab4c8c1255ae476/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:31.934762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:31.980969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c02f-a31f-4f7f-979c-33e401e14a03 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.006870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dd997-f4fc-43c9-97f7-dc9b57ac5a55 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.012721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.013641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.013917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.014360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.015057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.017025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.032098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.032808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.033096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.033372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.041188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 818/1623] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:31 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:32.042191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.046634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.048523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5edc4-64b6-4901-8329-5cb147715d21 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.053306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e87fd-2415-448a-b16b-1a467acafe76 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.058825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.059785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.059962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.060333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.060430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 806/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:32.061134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.061561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca1f5a-91ad-40ab-bb26-bb7dffb7b7f6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.061878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca1f5a-91ad-40ab-bb26-bb7dffb7b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.062193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca1f5a-91ad-40ab-bb26-bb7dffb7b7f6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.062946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.064363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 807/1625] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:32.069366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca1f5a-91ad-40ab-bb26-bb7dffb7b7f6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.084732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca1f5a-91ad-40ab-bb26-bb7dffb7b7f6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.090445 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 819/1626] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:32 2022] POST /identity/v3/users => generated 300 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:32.091304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.092040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.093135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.093471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.093919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] PATH_INFO: `/v3/users/119b2d399fe14efebf869ca09be102f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.095485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=119b2d399fe14efebf869ca09be102f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.098219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.102128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a311740-d7fb-428b-b62e-101039591de5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.109053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.110065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.110388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.111164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] PATH_INFO: `/v3/projects/29ce96a670a64da8a7b56c28a2801d24/users/2410dd7bc0fe422baa892c40a83c48ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.129819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ce96a670a64da8a7b56c28a2801d24, user_id=2410dd7bc0fe422baa892c40a83c48ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.132927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.147233 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 820/1627] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:32 2022] PUT /identity/v3/projects/29ce96a670a64da8a7b56c28a2801d24/users/2410dd7bc0fe422baa892c40a83c48ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.148352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.148547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119b2d399fe14efebf869ca09be102f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:32.165478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119b2d399fe14efebf869ca09be102f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:32.166306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119b2d399fe14efebf869ca09be102f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:32.177224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119b2d399fe14efebf869ca09be102f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:32.188132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119b2d399fe14efebf869ca09be102f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:32.196898 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 808/1628] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:32 2022] DELETE /identity/v3/users/119b2d399fe14efebf869ca09be102f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.197828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.200507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.225848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1a6f1-fd8a-44aa-9db5-442c548e7d66 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.278705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c0a0-2869-4e81-bb07-3bc5051ecdfb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.287601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.288666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.289088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.289500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.290618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.293671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb571a-4a98-4a05-a45e-af30982f6a73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.293896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.294815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.295189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.295918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.296830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.298608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.311591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 809/1629] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:32.313186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3f34-524e-4a6e-acf7-63960576893d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.313476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3f34-524e-4a6e-acf7-63960576893d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.313814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3f34-524e-4a6e-acf7-63960576893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.320554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 821/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:32.320554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.328318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.342199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-544c3f34-524e-4a6e-acf7-63960576893d None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:32.343933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-544c3f34-524e-4a6e-acf7-63960576893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.352247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6117d2-642a-4b80-a53c-324235cb7969 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.360229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.361210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.361210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.361580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.362405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.371510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.386403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 822/1631] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:32.388910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.391030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.417045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a28ab-3635-4b62-8143-88b5d84e2e17 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.428151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.430284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.430578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.432157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.434181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.439194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.455862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 810/1632] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:32.456740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.457013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.457290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.477871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:32.479403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.485248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 823/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:32.486683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.492504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 811/1634] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:32.492504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.497196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.510963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b818-41ca-4936-8a68-ffeeb7e72d0e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.517149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad762b22-a33b-4dc6-b821-4582c55eeace None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.519452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.520420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.520833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.521161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] PATH_INFO: `/v3/projects/5fbdabfd7e35449c833c59dffcdd1128/users/8c0c08042204498b8277d43ad8e46e3c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.526607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.528285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.528688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.529067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] PATH_INFO: `/v3/projects/9904a696bbb043e4bafd415933961394/users/9305cf7e03bc4388aab4c8c1255ae476/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.532249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9904a696bbb043e4bafd415933961394, user_id=9305cf7e03bc4388aab4c8c1255ae476, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.536200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.541708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbdabfd7e35449c833c59dffcdd1128, user_id=8c0c08042204498b8277d43ad8e46e3c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.552626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.571132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 824/1635] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:32 2022] PUT /identity/v3/projects/5fbdabfd7e35449c833c59dffcdd1128/users/8c0c08042204498b8277d43ad8e46e3c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.571132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.590413 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 812/1636] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:32 2022] PUT /identity/v3/projects/9904a696bbb043e4bafd415933961394/users/9305cf7e03bc4388aab4c8c1255ae476/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.591459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.672356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7518-6b9b-4de3-90c1-75f36cc91015 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.684644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce8b1-54fe-4e60-84fe-739e7245d893 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.690807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.691778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.692217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.692636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.699335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.762502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.764182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.764597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.764990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] PATH_INFO: `/v3/projects/911a87539a0d4e949350e9514b7b821b/users/3c0e299a1b85404caab07234ca847192/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.783437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.785631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.787067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a87539a0d4e949350e9514b7b821b, user_id=3c0e299a1b85404caab07234ca847192, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.795125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.800055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 813/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:32.805619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.823863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 825/1638] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:32 2022] PUT /identity/v3/projects/911a87539a0d4e949350e9514b7b821b/users/3c0e299a1b85404caab07234ca847192/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.824811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.827618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:32.833559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed48dcf-6c2d-4382-a4f2-254765f5976f service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:32.927135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:32.928411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:32.929082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:32.929585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] PATH_INFO: `/v3/projects/29ce96a670a64da8a7b56c28a2801d24/users/2410dd7bc0fe422baa892c40a83c48ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:32.932353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ce96a670a64da8a7b56c28a2801d24, user_id=2410dd7bc0fe422baa892c40a83c48ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:32.937155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:32.953150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 814/1639] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:32 2022] PUT /identity/v3/projects/29ce96a670a64da8a7b56c28a2801d24/users/2410dd7bc0fe422baa892c40a83c48ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:32.954287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:32.964601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776420-d324-4d55-8010-c840ea508041 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.050890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.051561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.051848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.052130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.068937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824626-5731-481f-8277-b4e4300aad9f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.072684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.074554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb07b7-e304-4959-b171-c009c6cd7638 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.083045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.083752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.084087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.084377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.085125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.086741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885de82-369c-420c-ac5f-120680b68f32 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.097326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 826/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:33.098663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.098959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.099241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.111746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 815/1641] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:33.113323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1234-92ad-4d69-a689-b87c681bf095 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.113619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1234-92ad-4d69-a689-b87c681bf095 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.113900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b1234-92ad-4d69-a689-b87c681bf095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.156580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] MFA Rules not processed for user `9305cf7e03bc4388aab4c8c1255ae476`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:33.157823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.165037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-095b1234-92ad-4d69-a689-b87c681bf095 None None] MFA Rules not processed for user `2296e93e1a6941019126bc05a1c990be`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:33.168919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-095b1234-92ad-4d69-a689-b87c681bf095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.294170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 827/1642] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:33.294865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.298190 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 816/1643] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:33.299427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.299724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.300081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.314813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5941-38d1-4e02-b0c4-5f42e882fcbd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.327158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.327392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.327688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.327968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.328772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.332398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.347219 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 828/1644] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:33.351441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.357432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] MFA Rules not processed for user `2410dd7bc0fe422baa892c40a83c48ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:33.358665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.363758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b19625-c938-4adf-b16f-e2ddc493e6e1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.368785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.369837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.370135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.370418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] PATH_INFO: `/v3/projects/5fbdabfd7e35449c833c59dffcdd1128/users/8c0c08042204498b8277d43ad8e46e3c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.372998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbdabfd7e35449c833c59dffcdd1128, user_id=8c0c08042204498b8277d43ad8e46e3c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.375905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.388552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 829/1645] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:33 2022] PUT /identity/v3/projects/5fbdabfd7e35449c833c59dffcdd1128/users/8c0c08042204498b8277d43ad8e46e3c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:33.389501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.391394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.534725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c42bfe-02ea-4548-b0bb-41915d144844 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.539873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 817/1646] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:33.540890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.543766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.544486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.544766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.545050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.545894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.547823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.612429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 830/1647] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/projects => generated 403 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:33.612429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.661574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2d70a-f164-4c82-8d2d-485fa91b3be8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.698291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61ca37-ba15-4a17-9292-782320b147f7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:33.704958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.706035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.706321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.706655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] PATH_INFO: `/v3/projects/911a87539a0d4e949350e9514b7b821b/users/3c0e299a1b85404caab07234ca847192/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.708954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a87539a0d4e949350e9514b7b821b, user_id=3c0e299a1b85404caab07234ca847192, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.711648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13cf1-83d6-42fa-be77-34d39f482654 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.732548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 831/1648] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:33 2022] PUT /identity/v3/projects/911a87539a0d4e949350e9514b7b821b/users/3c0e299a1b85404caab07234ca847192/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:33.735419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.736912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.737532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.764335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:33.765097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.765386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.765667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.792634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] MFA Rules not processed for user `8c0c08042204498b8277d43ad8e46e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:33.793951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.849283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:33.851357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fb573-6fdf-459e-99d0-f331074f6c40 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:33.868900 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 818/1649] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:33.871147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:33.871717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:33.872009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:33.874326 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 819/1650] 10.222.0.18 () {54 vars in 960 bytes} [Sat Apr 2 20:51:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:33.875094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:33.892525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 832/1651] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:33.892664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:33.892741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.014739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e786e87-94da-4e06-9deb-6b63d09913f0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.020233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.021091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.021517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.021785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.022750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.024928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8386962-3153-4b31-aaae-82238b3d39ea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.039782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9997c4b-2c07-43f5-bfb0-2c0a96f08f11 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.047205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.048551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.049011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.049531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] PATH_INFO: `/v3/projects/a23ce3f3e63240dfa5f2f6cef20a8f18` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.051620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23ce3f3e63240dfa5f2f6cef20a8f18)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.055917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 833/1652] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:33 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:34.055917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.055917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.055917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.057409 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:34.057409 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:51:34.057409 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:51:34.059993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.093003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] MFA Rules not processed for user `3c0e299a1b85404caab07234ca847192`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:34.094983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.148664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23ce3f3e63240dfa5f2f6cef20a8f18', 'request_id': 'req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:34.168260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23ce3f3e63240dfa5f2f6cef20a8f18', 'request_id': 'req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:34.175059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23ce3f3e63240dfa5f2f6cef20a8f18', 'request_id': 'req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:34.190765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] The token cache is being invalidate because project a23ce3f3e63240dfa5f2f6cef20a8f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:34.191170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:34.192691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-900441f5-ffa3-49cf-b6c8-8eb3b7a2fd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:34.201454 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 820/1653] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:33 2022] DELETE /identity/v3/projects/a23ce3f3e63240dfa5f2f6cef20a8f18 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:34.205571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f3e8-08d0-4d23-9609-b82f228e8266 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.206890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f3e8-08d0-4d23-9609-b82f228e8266 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.207345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348f3e8-08d0-4d23-9609-b82f228e8266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.230482 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 834/1654] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:34.232775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.243682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8348f3e8-08d0-4d23-9609-b82f228e8266 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:34.244828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f5f3-50b2-4788-bfc2-869e09aef419 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.255068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8348f3e8-08d0-4d23-9609-b82f228e8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.312143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.313228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.313759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.314146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.315133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.316980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40753f3-432d-402f-97de-3c490fc7fd4e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.328596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 835/1655] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:34.330042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc0d2-12e3-4871-9127-9ffaf5193ac0 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.330339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc0d2-12e3-4871-9127-9ffaf5193ac0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.330616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cc0d2-12e3-4871-9127-9ffaf5193ac0 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.332837 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 836/1656] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:34.334183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.334473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.334753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.360027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:34.361273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.372751 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 837/1657] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:34.373289 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 821/1658] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:34.375245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.375830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.376259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.382530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.383988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.396712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fba5d-d6fa-4cbb-a13e-e9479a77d372 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.402570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.402968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:34.403563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.403857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.404131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] PATH_INFO: `/v3/projects/9d20400b6e624c6aa61a142f4c6a012c/users/d8cb1920ebb44b978d8016aafee4be6e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.404910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.420738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d20400b6e624c6aa61a142f4c6a012c, user_id=d8cb1920ebb44b978d8016aafee4be6e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.424077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853a4d-e17e-46a8-8319-9bc0ea72d810 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.448250 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 838/1659] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:34 2022] PUT /identity/v3/projects/9d20400b6e624c6aa61a142f4c6a012c/users/d8cb1920ebb44b978d8016aafee4be6e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:34.451263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.451263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.451263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.472068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:34.473897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.519156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 822/1660] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:34.520294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.536839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3395f-651d-46f8-bf0a-d730fed495d5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.582471 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 839/1661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:34.583674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.595398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d633270-0ade-4f15-8f30-1feec2918ab0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.607227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.607761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.608010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.608212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.608560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.608660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.608849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.609131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.610188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.611161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.611880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.627099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 840/1662] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:34.628700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.631526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:34.688970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.690611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.707648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 823/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:34.708995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.725325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774df5-b90f-4d73-8cd3-832beb0a20a4 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.738139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.738836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.739128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.739798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.740405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:34.740811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.742507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.756927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcca533-c693-44d1-adeb-35204c69de22 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.763508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 824/1664] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:34.775987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.791405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.792083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.792370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.792771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.796126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d111e9b-0594-4f72-b3a3-13f43732b9f7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.807958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.809438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.809727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.810005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] PATH_INFO: `/v3/projects/9d20400b6e624c6aa61a142f4c6a012c/users/d8cb1920ebb44b978d8016aafee4be6e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.811620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.813295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.818012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d20400b6e624c6aa61a142f4c6a012c, user_id=d8cb1920ebb44b978d8016aafee4be6e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:34.821003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:34.832977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 841/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:34.833722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.848831 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 825/1666] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:34 2022] PUT /identity/v3/projects/9d20400b6e624c6aa61a142f4c6a012c/users/d8cb1920ebb44b978d8016aafee4be6e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:34.863481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:34.865157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699a50a-bcff-4bd1-92ac-4e6b6914298d service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.977171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07f1ce-1a73-42e2-8f43-986c67368fcd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:34.987265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:34.988156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:34.988653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:34.989506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:34.998896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.032536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.033364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.033633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.034017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.035636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.039114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.085031 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 842/1667] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:35.085031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.085250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.134680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.137142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.154789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 826/1668] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:51:35.156274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.182257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f2a1b-89a9-4d1f-b54f-7cb3eb7eb82d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.200639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d086045-223b-43cb-b7bb-f504bbe466a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.211216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.212511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.212849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.213169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.215224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.301065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.301758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.302913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.302913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.303510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.308832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.371166 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 827/1669] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:35 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:35.371166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.371527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.371527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.375803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.397777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 843/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:35.399579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.419880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b066cc-99b6-4dd5-b10f-a3c846685259 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.436838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.437537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.437701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a19-afc0-468b-85d2-045298bf49fc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.437806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.438083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.442781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.444712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.463859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.465476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.465742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.466017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] PATH_INFO: `/v3/users/8a051b383e084a5d85a0708fa2fe04f7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.474910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 844/1671] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:35.475064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a051b383e084a5d85a0708fa2fe04f7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.475926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.482776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.486881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c98b01-57e2-48eb-b61b-696f35e2b214 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.508508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.509214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.509457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.509739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.511052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.512751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dd503-d7fd-4ed4-8f24-f0da638f805f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.537716 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 845/1672] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:51:35.550544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f80c9-efb3-4131-b3ff-3590dbe9e108 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.551996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f80c9-efb3-4131-b3ff-3590dbe9e108 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.552363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f80c9-efb3-4131-b3ff-3590dbe9e108 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.554874 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 846/1673] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:35 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:35.555703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f80c9-efb3-4131-b3ff-3590dbe9e108 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.564670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a051b383e084a5d85a0708fa2fe04f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:35.572848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f80c9-efb3-4131-b3ff-3590dbe9e108 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.577312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a051b383e084a5d85a0708fa2fe04f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:35.577784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.578027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a051b383e084a5d85a0708fa2fe04f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:35.578821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.579292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.579659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] PATH_INFO: `/v3/projects/384de584a4f0454689b4e93a98080f19/users/85115da6a8a843c48e4b8a58e3b9c52f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.587325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a051b383e084a5d85a0708fa2fe04f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:35.596000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-856468b8-990b-4e39-91e7-6a87e3fa9cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a051b383e084a5d85a0708fa2fe04f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:35.604698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384de584a4f0454689b4e93a98080f19, user_id=85115da6a8a843c48e4b8a58e3b9c52f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.607737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 828/1674] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:35 2022] DELETE /identity/v3/users/8a051b383e084a5d85a0708fa2fe04f7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:35.608642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec45eb-8918-43a7-a215-b075dc9e8a21 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.609192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.609531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.609923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.632341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:35.633840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.638146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 847/1675] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:35 2022] PUT /identity/v3/projects/384de584a4f0454689b4e93a98080f19/users/85115da6a8a843c48e4b8a58e3b9c52f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:35.640842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03933f3-28ad-4a7f-b9ab-f73231ef67ec None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.641359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03933f3-28ad-4a7f-b9ab-f73231ef67ec None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.641804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03933f3-28ad-4a7f-b9ab-f73231ef67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.668871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b03933f3-28ad-4a7f-b9ab-f73231ef67ec None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:35.670084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b03933f3-28ad-4a7f-b9ab-f73231ef67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.748603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 829/1676] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:35.749493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.750818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.778015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 848/1677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:35.779395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.779691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.780251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.823304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] MFA Rules not processed for user `85115da6a8a843c48e4b8a58e3b9c52f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:35.826546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.849786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d27ff-971f-41dc-89b7-4ff75ed6c546 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.856755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.857574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.858389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.858685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.861233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.921766 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 849/1678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:35.922715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.924152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.927124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.928798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:35.952721 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 830/1679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:35.955332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:35.956826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:35.974201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534436-d205-4778-a8a3-0b6a884279c7 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:35.982155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:35.983166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:35.983272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:35.983702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:35.996313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:35.997988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.016872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 831/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:36.018331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.020231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:36.039507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c226e0-87ab-4c55-b8a8-f8b69f59ab06 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.050467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f4c10-fddb-4926-8bbe-4b32d7efad05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.066897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.067590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.067881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.068161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.073475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.074733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.075020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.076338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.077091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.081026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.082775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.096346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.097708 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 850/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:36.161479 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 832/1682] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:36 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:36.163772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.184742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed519c-f307-46b1-bf2b-b4197a9d1b2b service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.300439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.309336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.310371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.310781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.311312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.312032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.314904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.373596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 851/1683] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:36 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:36.376217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.395409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78140-58b9-40a8-b753-172f2600ebca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.422910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.425582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.427329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.428357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.432142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.436848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.459098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4943e7-9107-406b-bf00-555602e8f3a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.467701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 852/1684] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:36.471994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.478497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.478497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.478497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.478497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.491530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:36.508977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f763c9-1db8-404d-a916-4a4e03eeb235 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.535427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.538217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.539051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.539051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] PATH_INFO: `/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb/users/267d275d14eb4aabb59c5becdae6fe33/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.579789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d64caca1dd4076b5e69cb361e4fdbb, user_id=267d275d14eb4aabb59c5becdae6fe33, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.583766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399acdc6-ab28-4788-9903-86f9efdda437 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.615249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 853/1685] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:36 2022] PUT /identity/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb/users/267d275d14eb4aabb59c5becdae6fe33/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:36.618328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.618611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.618892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.676897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] MFA Rules not processed for user `d8cb1920ebb44b978d8016aafee4be6e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:36.678120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:36.678798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.686006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.710101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 833/1686] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:51:36.724160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.727135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:36.757780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d60b9-a2bf-4495-a7da-aefbf9e1575d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.840629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:36.841812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:36.841923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:36.842225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] PATH_INFO: `/v3/projects/65a0a62b97b54e7da98fb1453ad5c79a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:36.843577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a0a62b97b54e7da98fb1453ad5c79a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:36.846259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:36.889292 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 854/1687] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:36.896257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:36.923590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f71bf3-d0f4-407d-b832-8109953520ac None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:36.960262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a0a62b97b54e7da98fb1453ad5c79a', 'request_id': 'req-acbea653-5d94-4b27-aa9b-3e1368270d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:36.995523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a0a62b97b54e7da98fb1453ad5c79a', 'request_id': 'req-acbea653-5d94-4b27-aa9b-3e1368270d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.015791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a0a62b97b54e7da98fb1453ad5c79a', 'request_id': 'req-acbea653-5d94-4b27-aa9b-3e1368270d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.041608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] The token cache is being invalidate because project 65a0a62b97b54e7da98fb1453ad5c79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:37.042040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.045458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-acbea653-5d94-4b27-aa9b-3e1368270d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.050736 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 834/1688] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:36 2022] DELETE /identity/v3/projects/65a0a62b97b54e7da98fb1453ad5c79a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:37.050736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.050736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.050736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.079454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] MFA Rules not processed for user `61c0b07ac66748afbf2c5671b1adaf08`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:37.080756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.097378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:37.099317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.099884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.100176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.101356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:37.104672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:37.156773 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 855/1689] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:37.157665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:37.167956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.188606 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 835/1690] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:37.190663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:37.197011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.210392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a04288-11c5-4c73-9215-70278bdc1a5e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:37.227495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355007b-0045-49ab-977c-eda6ffa8d190 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:37.228335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:37.231226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.232872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.234708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] PATH_INFO: `/v3/users/2410dd7bc0fe422baa892c40a83c48ac` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.236690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2410dd7bc0fe422baa892c40a83c48ac)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:37.239728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:37.240487 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.240487 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:51:37.240487 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:51:37.240771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.241147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.241433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] PATH_INFO: `/v3/users/bd902cc59620409aa633df1d2772f812` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.243424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:37.244138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd902cc59620409aa633df1d2772f812)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:37.250176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:37.362860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd902cc59620409aa633df1d2772f812'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.402850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd902cc59620409aa633df1d2772f812'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.404392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd902cc59620409aa633df1d2772f812'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.405035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2410dd7bc0fe422baa892c40a83c48ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.422011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2410dd7bc0fe422baa892c40a83c48ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.422676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2410dd7bc0fe422baa892c40a83c48ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.424486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd902cc59620409aa633df1d2772f812'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.426907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2410dd7bc0fe422baa892c40a83c48ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.448087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd902cc59620409aa633df1d2772f812'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.461746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2410dd7bc0fe422baa892c40a83c48ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:37.466070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 836/1691] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:37 2022] DELETE /identity/v3/users/bd902cc59620409aa633df1d2772f812 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:37.468370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:37.475078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.534259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 856/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:37 2022] DELETE /identity/v3/users/2410dd7bc0fe422baa892c40a83c48ac => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:37.534259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:37.537263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.607875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734381-7126-4496-b238-a40fb9c9bf75 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:37.723999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb014-0af3-46c4-81af-be134687b262 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:37.737408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:37.738074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.738362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.739130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.745968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:37.747678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.751216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.751216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.752170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] PATH_INFO: `/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb/users/267d275d14eb4aabb59c5becdae6fe33/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.758937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d64caca1dd4076b5e69cb361e4fdbb, user_id=267d275d14eb4aabb59c5becdae6fe33, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:37.768395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c063f-5277-4ffc-84bd-1dccfd1f7f7e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:37.795750 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 837/1693] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:37 2022] PUT /identity/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb/users/267d275d14eb4aabb59c5becdae6fe33/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:37.799308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.799605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.799889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:37.854187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:37.859229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:37.912974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:37.918787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c04e-078d-47a8-bbb3-6b95945f61c3 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:37.950061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 857/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:37.952161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf52b-3fe5-44a6-ae1c-2575bc690219 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:37.955652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf52b-3fe5-44a6-ae1c-2575bc690219 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:37.956222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edf52b-3fe5-44a6-ae1c-2575bc690219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.016890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 838/1695] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:38.041813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:38.044501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.055445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-73edf52b-3fe5-44a6-ae1c-2575bc690219 None None] MFA Rules not processed for user `267d275d14eb4aabb59c5becdae6fe33`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:38.062290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-73edf52b-3fe5-44a6-ae1c-2575bc690219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.190172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36ed8a-b33d-4902-bc8c-f8232cb93bb1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:38.201278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:38.201961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.202246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.202523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.216772 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 858/1696] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:38.218606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.218997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.219425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.222476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:38.223964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef24d1b-fc11-4b62-a390-9e9d569b307a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:38.229689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 859/1697] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:38.231199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:38.233455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.246648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 839/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:38.248246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.248562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.248842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.291608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:38.293479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.351046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c71a1-69a4-42b4-9716-cda2d2aabf8a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:38.357662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:38.358334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.358628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.358910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.360796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.426950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 840/1699] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:38.427954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:38.429493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.481040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:38.482877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:38.498667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08eed5-8e55-4091-a357-0e8bb824e58b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:38.502778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:38.503599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.504058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.504503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.508975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 860/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:38.518336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:38.519773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218051ac-cf99-4287-8924-494cafbf9f76 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:38.529784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:38.531818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.533365 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 841/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:38.552122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4d6d-1584-4789-9ac2-29b00c6a2d03 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:38.565341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:38.566233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.566513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.566786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] PATH_INFO: `/v3/users/85115da6a8a843c48e4b8a58e3b9c52f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.570143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85115da6a8a843c48e4b8a58e3b9c52f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:38.572316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:38.650215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85115da6a8a843c48e4b8a58e3b9c52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:38.661836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85115da6a8a843c48e4b8a58e3b9c52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:38.662953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85115da6a8a843c48e4b8a58e3b9c52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:38.664250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85115da6a8a843c48e4b8a58e3b9c52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:38.674318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85115da6a8a843c48e4b8a58e3b9c52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:38.701706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 861/1702] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:38 2022] DELETE /identity/v3/users/85115da6a8a843c48e4b8a58e3b9c52f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:38.702224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:38.702519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:38.702850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:38.726099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:38.727623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:38.840606 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 842/1703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:38.879322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:38.888555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.023468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac930ec7-618e-4aea-84fe-0b16394640b6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:39.031911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:39.032854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.033213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.033618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.048331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:39.050015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:39.063449 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 862/1704] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:39.255269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:39.256958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.276183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633eb4-a4e0-47fa-93ac-00594fc7dcb3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:39.289967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:39.291674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.292265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.293611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] PATH_INFO: `/v3/projects/fd4106d02c9d4298a582766c6d8c6e55` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.295128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4106d02c9d4298a582766c6d8c6e55)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:39.297317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:39.375984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4106d02c9d4298a582766c6d8c6e55', 'request_id': 'req-c51be6a9-96ac-46d3-9c01-2cffb124a144'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.384010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4106d02c9d4298a582766c6d8c6e55', 'request_id': 'req-c51be6a9-96ac-46d3-9c01-2cffb124a144'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.393935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4106d02c9d4298a582766c6d8c6e55', 'request_id': 'req-c51be6a9-96ac-46d3-9c01-2cffb124a144'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.416543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] The token cache is being invalidate because project fd4106d02c9d4298a582766c6d8c6e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:39.418460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.420401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51be6a9-96ac-46d3-9c01-2cffb124a144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.422911 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 843/1705] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:39 2022] DELETE /identity/v3/projects/fd4106d02c9d4298a582766c6d8c6e55 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:39.426741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:39.439786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349ea92-60b3-4e6d-91f1-f24e8d3b25a1 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:39.505339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028025d-a975-4da4-9f9f-dfd91a39b62a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.505723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028025d-a975-4da4-9f9f-dfd91a39b62a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.505895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028025d-a975-4da4-9f9f-dfd91a39b62a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.507864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 844/1706] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:51:39.515603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.515907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.516193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.553508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:39.554762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.562716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:39.563836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.564401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.564589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] PATH_INFO: `/v3/users/3c0e299a1b85404caab07234ca847192` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.565881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0e299a1b85404caab07234ca847192)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:39.568245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:39.631928 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 845/1707] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:39.633052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:39.634600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.676913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0e299a1b85404caab07234ca847192'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.690500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0e299a1b85404caab07234ca847192'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.697354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0e299a1b85404caab07234ca847192'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.698098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0e299a1b85404caab07234ca847192'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.729730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0e299a1b85404caab07234ca847192'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:39.759951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89948353-9cdb-400a-be37-a82eedb8657c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:39.771976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:39.773117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:39.773631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:39.773932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:39.776154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.789886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:39.791506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:39.802650 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 863/1708] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:39 2022] DELETE /identity/v3/users/3c0e299a1b85404caab07234ca847192 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:39.803783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:39.805362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 846/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:39.807472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:39.810212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.810811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:39.915067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83600909-ea72-498f-b832-5d799aee1b53 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:39.978627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909961b-4c75-46b5-a95c-37040011cc29 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.008471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.009409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.009700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.009982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] PATH_INFO: `/v3/projects/29ce96a670a64da8a7b56c28a2801d24` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.013676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ce96a670a64da8a7b56c28a2801d24)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.015668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.056729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.057607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.058589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.058976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.065523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.083569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ce96a670a64da8a7b56c28a2801d24', 'request_id': 'req-359db036-8983-4cb9-87d9-27b57a070143'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.091139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ce96a670a64da8a7b56c28a2801d24', 'request_id': 'req-359db036-8983-4cb9-87d9-27b57a070143'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.101362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ce96a670a64da8a7b56c28a2801d24', 'request_id': 'req-359db036-8983-4cb9-87d9-27b57a070143'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.152447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] The token cache is being invalidate because project 29ce96a670a64da8a7b56c28a2801d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:40.153005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.153858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-359db036-8983-4cb9-87d9-27b57a070143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.163711 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 864/1710] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:39 2022] DELETE /identity/v3/projects/29ce96a670a64da8a7b56c28a2801d24 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:40.165182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.165554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.165749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.209944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] MFA Rules not processed for user `c42119999e6f40b487a7174dc5a7d617`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:40.211633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.236501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.238451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ad7b-5182-4143-8240-5a81de6cca4a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.252910 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 847/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:40.254900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949a1e-73e4-47f0-a6a2-388cd1dbe852 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.255343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949a1e-73e4-47f0-a6a2-388cd1dbe852 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.256131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949a1e-73e4-47f0-a6a2-388cd1dbe852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.279171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bc949a1e-73e4-47f0-a6a2-388cd1dbe852 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:40.283176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc949a1e-73e4-47f0-a6a2-388cd1dbe852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.305430 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 865/1712] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:40.306956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.309585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.375909 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 848/1713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:40.378954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.379255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.379544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.424779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:40.424779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.447220 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 849/1714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:40.457070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.469011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31af917-f489-48ce-bd75-fc5b85749569 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.474243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.474839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.475232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.475386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.476119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:40.476429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.478245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.482301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b617-a254-407a-bcfa-c62f0920adca None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.493203 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 850/1715] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:40.494502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.497334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.497555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.498252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.498520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.498790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.499477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.502042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.534108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867139a-892e-48b1-a77d-95885cb068a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.546873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.550335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.550797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.551092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] PATH_INFO: `/v3/projects/384de584a4f0454689b4e93a98080f19` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.554761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384de584a4f0454689b4e93a98080f19)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.561587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 866/1716] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/projects => generated 403 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:40.561587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.561803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.669374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384de584a4f0454689b4e93a98080f19', 'request_id': 'req-3939730f-1414-4476-949c-b678b254c158'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.681998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384de584a4f0454689b4e93a98080f19', 'request_id': 'req-3939730f-1414-4476-949c-b678b254c158'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.697217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384de584a4f0454689b4e93a98080f19', 'request_id': 'req-3939730f-1414-4476-949c-b678b254c158'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.722382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408c03f-2060-46c6-94da-818495b6c71f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.733648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] The token cache is being invalidate because project 384de584a4f0454689b4e93a98080f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:40.733959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.734867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:40.739151 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 851/1717] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:40 2022] DELETE /identity/v3/projects/384de584a4f0454689b4e93a98080f19 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:40.739151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.739361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.817932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.819145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.819663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.820154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.821403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.824892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.841203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939730f-1414-4476-949c-b678b254c158 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.857058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.857946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.858339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.858724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.859747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.862309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.864414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 867/1718] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/projects => generated 393 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:40.865742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.868042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.910876 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 852/1719] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:40 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:40.910876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:40.910876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:40.926069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6731f3-9a7f-417a-ab0d-d21964f2d65f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.967080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3927f-ede3-4e72-8241-e211ab6969ae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:40.972855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.973741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.974029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.974444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] PATH_INFO: `/v3/projects/911a87539a0d4e949350e9514b7b821b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.975646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911a87539a0d4e949350e9514b7b821b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.978752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:40.993015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:40.993906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:40.994234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:40.994542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] PATH_INFO: `/v3/users/2296e93e1a6941019126bc05a1c990be` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:40.996378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2296e93e1a6941019126bc05a1c990be)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:40.998435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.040280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911a87539a0d4e949350e9514b7b821b', 'request_id': 'req-ba0cbfc6-ab64-45fd-b493-824e2c381be1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.050539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911a87539a0d4e949350e9514b7b821b', 'request_id': 'req-ba0cbfc6-ab64-45fd-b493-824e2c381be1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.059648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911a87539a0d4e949350e9514b7b821b', 'request_id': 'req-ba0cbfc6-ab64-45fd-b493-824e2c381be1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.061485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2296e93e1a6941019126bc05a1c990be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.071623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] The token cache is being invalidate because project 911a87539a0d4e949350e9514b7b821b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:41.072096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.072808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.073903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2296e93e1a6941019126bc05a1c990be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.074752 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 868/1720] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:40 2022] DELETE /identity/v3/projects/911a87539a0d4e949350e9514b7b821b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.074876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2296e93e1a6941019126bc05a1c990be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.078931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.080390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.082182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2296e93e1a6941019126bc05a1c990be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.092412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2296e93e1a6941019126bc05a1c990be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.099472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 853/1721] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:40 2022] DELETE /identity/v3/users/2296e93e1a6941019126bc05a1c990be => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.100346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.101917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.212384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37534-fba5-4582-a206-88e5b707f94e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.217423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.218275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.218587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.218867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.219970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.220932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cbfc6-ab64-45fd-b493-824e2c381be1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.221961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.236772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.238066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.238351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.238832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] PATH_INFO: `/v3/users/267d275d14eb4aabb59c5becdae6fe33` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.242114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267d275d14eb4aabb59c5becdae6fe33)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.249518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.259924 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 854/1722] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:41 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:41.261279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.263360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.277227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb67-912a-4d1f-a43c-ac3020342225 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.282664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.283400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.283687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.283962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.284729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.286383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5d24f-3c57-44df-8805-7d7f5f2fd177 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.298557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 855/1723] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:41.300247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.300563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.300842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.324941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:41.326313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.337533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 856/1724] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:41.338484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.358705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4fb07-2358-4c16-9778-9b1a7bebeb0e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.365177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.366140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.366603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.366882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.367622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.367973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267d275d14eb4aabb59c5becdae6fe33'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.369297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.382547 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 857/1725] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:41.384541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267d275d14eb4aabb59c5becdae6fe33'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.385562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267d275d14eb4aabb59c5becdae6fe33'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.386431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.386592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267d275d14eb4aabb59c5becdae6fe33'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.388318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.397385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267d275d14eb4aabb59c5becdae6fe33'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.403695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4841b-e1a8-4451-9c1f-b9415e8495ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.408438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.409441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.409729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.410012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] PATH_INFO: `/v3/projects/14673cb7d0f940cabbca0f8510bf3545/users/f60ddc5315644283a9f9f5b8dfa67a0f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.429737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14673cb7d0f940cabbca0f8510bf3545, user_id=f60ddc5315644283a9f9f5b8dfa67a0f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.432789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d9407-9cc1-4cbe-8513-2ad367100fcc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.444117 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 869/1726] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:41 2022] DELETE /identity/v3/users/267d275d14eb4aabb59c5becdae6fe33 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.444117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.458817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.459782 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 858/1727] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:41 2022] PUT /identity/v3/projects/14673cb7d0f940cabbca0f8510bf3545/users/f60ddc5315644283a9f9f5b8dfa67a0f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.464626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.464986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.465274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.485376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:41.487087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.560719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 859/1728] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:41.561852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.565327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.582418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093bb8-412e-4f2f-9cd1-c9c00ae0d28c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.587803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.589302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.589779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.590067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.591163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.592927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.595491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15e38-d9db-49f5-9f6f-69b9b84e4f04 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.602264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.603727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.604118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.607591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] PATH_INFO: `/v3/projects/162245b155e14a71bfc8d9d5250e4c78` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.607730 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 860/1729] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:41.607730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.607872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162245b155e14a71bfc8d9d5250e4c78)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.609890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.620000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a552f-dc0d-4049-bff6-581b49895b6b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.625947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.626636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.627382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.627673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.628411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.630082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.643265 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 861/1730] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:41.648938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.660538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682af95d-db56-4255-87bd-ea56c8a86948 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.683399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162245b155e14a71bfc8d9d5250e4c78', 'request_id': 'req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.692679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162245b155e14a71bfc8d9d5250e4c78', 'request_id': 'req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.717549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162245b155e14a71bfc8d9d5250e4c78', 'request_id': 'req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.739881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] The token cache is being invalidate because project 162245b155e14a71bfc8d9d5250e4c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:41.741223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.744751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:41.751790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 870/1731] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:41 2022] DELETE /identity/v3/projects/162245b155e14a71bfc8d9d5250e4c78 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.755522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.761426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.762769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.763349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.763814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.764706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:41.765153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.767736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.773271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.787022 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 862/1732] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:41.787022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.787022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.800129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0718e-dc37-4d55-9e37-98cbaef544c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.805339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.806250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.806585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.806871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] PATH_INFO: `/v3/projects/14673cb7d0f940cabbca0f8510bf3545/users/f60ddc5315644283a9f9f5b8dfa67a0f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.809697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14673cb7d0f940cabbca0f8510bf3545, user_id=f60ddc5315644283a9f9f5b8dfa67a0f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.812720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.819651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4e53-5b29-4ad9-8e4c-3ecc1fb20716 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:41.832375 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 863/1733] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:41 2022] PUT /identity/v3/projects/14673cb7d0f940cabbca0f8510bf3545/users/f60ddc5315644283a9f9f5b8dfa67a0f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.833411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.835536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:41.922408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:41.926680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:41.926680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:41.926680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] PATH_INFO: `/v3/projects/d5e73c0b10434dd19a90d5687673ff8b/users/0f684f6de9dc47a58e06f5ea0d0ec468/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:41.942266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e73c0b10434dd19a90d5687673ff8b, user_id=0f684f6de9dc47a58e06f5ea0d0ec468, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:41.946404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:41.969526 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 871/1734] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:41 2022] PUT /identity/v3/projects/d5e73c0b10434dd19a90d5687673ff8b/users/0f684f6de9dc47a58e06f5ea0d0ec468/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:41.979556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:41.983552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.012405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255d44-fd3a-4012-b316-6c0006f99a2c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:42.154462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:42.155369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.155657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.155935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] PATH_INFO: `/v3/users/d8cb1920ebb44b978d8016aafee4be6e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.160099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8cb1920ebb44b978d8016aafee4be6e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:42.164571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb54146-5d30-4978-b0da-46d311dc3b39 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:42.165911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:42.181420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:42.183595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.184036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.184495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.185196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:42.187843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefadac-e72b-450d-9bc2-c50611edb022 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:42.225040 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 872/1735] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:41 2022] POST /identity/v3/projects => generated 403 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:42.226430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.226720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.226996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.240420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8cb1920ebb44b978d8016aafee4be6e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.256132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8cb1920ebb44b978d8016aafee4be6e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.256981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8cb1920ebb44b978d8016aafee4be6e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.267821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8cb1920ebb44b978d8016aafee4be6e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.272140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] MFA Rules not processed for user `0f684f6de9dc47a58e06f5ea0d0ec468`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:42.274241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.283834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8cb1920ebb44b978d8016aafee4be6e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.293982 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 864/1736] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:41 2022] DELETE /identity/v3/users/d8cb1920ebb44b978d8016aafee4be6e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:42.295020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:42.296656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.437277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa20d5-1907-4875-ab9e-8da2a3deb639 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:42.457150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:42.458057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.458342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.458621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] PATH_INFO: `/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.460461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d64caca1dd4076b5e69cb361e4fdbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:42.461726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 873/1737] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:42.462833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:42.466117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:42.469665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.566051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d64caca1dd4076b5e69cb361e4fdbb', 'request_id': 'req-80794ecb-1515-46d6-bc8e-985f369ac207'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.582364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d64caca1dd4076b5e69cb361e4fdbb', 'request_id': 'req-80794ecb-1515-46d6-bc8e-985f369ac207'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.592244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d64caca1dd4076b5e69cb361e4fdbb', 'request_id': 'req-80794ecb-1515-46d6-bc8e-985f369ac207'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.626201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] The token cache is being invalidate because project c9d64caca1dd4076b5e69cb361e4fdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:42.626510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.627088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589efd-b789-454f-963d-dab43e54e26b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:42.627339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80794ecb-1515-46d6-bc8e-985f369ac207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:42.630641 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 865/1738] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:42 2022] DELETE /identity/v3/projects/c9d64caca1dd4076b5e69cb361e4fdbb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:42.633084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.633418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.633706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.665673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:42.666996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.759357 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 866/1739] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:42.761216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:42.762001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.762359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.763319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.764097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:42.767519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab67d19-9556-4dd3-9aed-7d408e1d7f6f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:42.782619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:42.784852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.820483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c312c6-4759-4909-a894-121b8ea2f8ba None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:42.828498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:42.829970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.831335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.831335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.833026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:42.838373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:42.843210 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 874/1740] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/users => generated 302 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:42.849520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:42.850918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:42.851209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:42.882770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:42.884394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.896246 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 867/1741] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:42.897144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:42.900664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:42.913484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 875/1742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:42.914611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:42.942459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94fd27-76e1-4190-8db4-1bae5f4f5b43 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.093817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c194b-f68b-4b92-b30f-b9f3fc865965 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.098371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.098843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.098926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.099203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.100146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.102245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56bf70-63e0-4a17-9f2e-483adf504f62 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.106751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.107842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.110983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.111404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.116343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.120498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.146740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 876/1743] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:42 2022] POST /identity/v3/users => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:43.146740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.146740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.149161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.149746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 868/1744] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:43.155687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.161513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:43.185530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:43.186885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:43.215825 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 877/1745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:43.217720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.248338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b2431-2896-492f-bf18-38c301a8afa6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.272882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.274049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.277385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.280625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.282267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.288189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.318116 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 878/1746] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:43.319271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9179075-5d77-4016-ba4f-0f1a5b18b876 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.322774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.332907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.333557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.333849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.334684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d0ba7-5caa-402c-b23c-a2603ca4d7b2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.336004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.340538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.341318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.342768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.343065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.344042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.345887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.362161 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 879/1747] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:43.363691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.375440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4600-efda-4074-8225-a582105a1921 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.389776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.391896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.392282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.398661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.399496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:43.402459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.404166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.450797 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 880/1748] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:43.452682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.455171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.456755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.478836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf663-5c29-4de2-9683-47e1c5a633e7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.492791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.493724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.494107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.494472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] PATH_INFO: `/v3/projects/dc804c9aaef94c409c0c1a956db631c4/users/e8de9b7583e5423a8c81ad23e9e08377/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.500645 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 869/1749] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:43.501760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.504235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:43.521784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc804c9aaef94c409c0c1a956db631c4, user_id=e8de9b7583e5423a8c81ad23e9e08377, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.525839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.564229 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 881/1750] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:43 2022] PUT /identity/v3/projects/dc804c9aaef94c409c0c1a956db631c4/users/e8de9b7583e5423a8c81ad23e9e08377/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:43.566468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.586150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d523c-e713-4fea-a198-50d18104a813 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.687535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab5808-69ba-447b-bae1-e3fef615bed9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.687535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.688666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.689024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.689305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] PATH_INFO: `/v3/projects/167ee9fd69c34fbb9d0ba713458b21d3/users/cd58307e3a4d45b3bc5f6385dee44c76/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.709621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167ee9fd69c34fbb9d0ba713458b21d3, user_id=cd58307e3a4d45b3bc5f6385dee44c76, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.712502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.747848 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 882/1751] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:43 2022] PUT /identity/v3/projects/167ee9fd69c34fbb9d0ba713458b21d3/users/cd58307e3a4d45b3bc5f6385dee44c76/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:43.749898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.750103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:43.751390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:43.751817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:43.752339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] PATH_INFO: `/v3/projects/9d20400b6e624c6aa61a142f4c6a012c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:43.754803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d20400b6e624c6aa61a142f4c6a012c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:43.757055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:43.890162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d20400b6e624c6aa61a142f4c6a012c', 'request_id': 'req-a6e63b7e-81e8-4f3e-a406-31236f9ec204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:43.904870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d20400b6e624c6aa61a142f4c6a012c', 'request_id': 'req-a6e63b7e-81e8-4f3e-a406-31236f9ec204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:43.921978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d20400b6e624c6aa61a142f4c6a012c', 'request_id': 'req-a6e63b7e-81e8-4f3e-a406-31236f9ec204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:43.929415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe0df7-00c0-48f1-bbf8-061530b599f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:43.954835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] The token cache is being invalidate because project 9d20400b6e624c6aa61a142f4c6a012c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:43.955971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:43.957067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:43.961530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 870/1752] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:43 2022] DELETE /identity/v3/projects/9d20400b6e624c6aa61a142f4c6a012c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:43.965001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:43.967874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.091958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.092671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.092948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.093240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.096866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.105433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7714310-4f78-408d-b133-98c2663b8078 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.140907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e63b7e-81e8-4f3e-a406-31236f9ec204 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.150448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.153121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.153941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.154857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.156088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.158287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2b360-274f-4ea7-9af2-38dfa38b4f65 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.176108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 871/1753] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:44.178562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.179090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.179618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.205584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 883/1754] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:43 2022] POST /identity/v3/projects => generated 395 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:44.206488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.206675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.206903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.225058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] MFA Rules not processed for user `cd58307e3a4d45b3bc5f6385dee44c76`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:44.227418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.261945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:44.263334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.400117 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 872/1755] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:44.401540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:44.433245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 884/1756] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:44.434632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:44.436624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.469967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9175-1a88-49bd-ba7f-84aae4efd7b5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.483805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.484653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.485007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.485350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.486416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.494311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.550965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 885/1757] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:44.551810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:44.558619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.613207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbffc5-0ad3-49e2-8c9d-7afd8d2e226d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.628628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c141d-7d4d-49ea-933a-cfc1b1a8c363 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.634329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.636428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.640164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.641092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.642056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.647635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.650408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.653005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.653331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.653671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] PATH_INFO: `/v3/projects/dc804c9aaef94c409c0c1a956db631c4/users/e8de9b7583e5423a8c81ad23e9e08377/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.656106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc804c9aaef94c409c0c1a956db631c4, user_id=e8de9b7583e5423a8c81ad23e9e08377, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.662520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3fc01-f11a-4bb8-b460-933e95f339cd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.689838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 873/1758] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:44 2022] PUT /identity/v3/projects/dc804c9aaef94c409c0c1a956db631c4/users/e8de9b7583e5423a8c81ad23e9e08377/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:44.689838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09ec7-2d7e-4840-a107-bddc73d7c285 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.689838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09ec7-2d7e-4840-a107-bddc73d7c285 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.689838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09ec7-2d7e-4840-a107-bddc73d7c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.706988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c6b09ec7-2d7e-4840-a107-bddc73d7c285 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:44.707978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6b09ec7-2d7e-4840-a107-bddc73d7c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.730911 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 886/1759] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:44.732379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:44.832563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 874/1760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:44.832563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.832563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.833157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.873599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] MFA Rules not processed for user `e8de9b7583e5423a8c81ad23e9e08377`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:44.875141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:44.896623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4eef-a54b-4719-8072-3deeb19bed75 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.912625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.913958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.919615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.920700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.921827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.924238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:44.952619 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 887/1761] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:44.955923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:44.974615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcbeaf-6601-400a-a43f-923dabe1e02c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:44.983662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:44.985529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:44.986850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:44.987869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:44.988965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:44.992198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546c1c-c371-4f17-b1ce-5af77dbb6557 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.036249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 888/1762] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/users => generated 307 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:45.038948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.040028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.040741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.075901 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 875/1763] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:45.076946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.104703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6075f1-97d3-4201-8501-2c555f70232c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.112655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.113377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.113671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.113948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.114836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:45.115510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.118956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.155401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 876/1764] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:45.157635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:45.158005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.158895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:45.180549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378f261-ca99-4a83-8cf9-363ad464495c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.201774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.204992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.205409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.206420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.208834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.212423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.249375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 889/1765] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Apr 2 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:45.250927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.257637 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 877/1766] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:45.257637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.273825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deeae-08f4-401e-a4aa-7fa2b26cfc65 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.276052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28367a6-2e12-446e-b447-0eba84074199 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.282296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.283358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.283582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.283860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] PATH_INFO: `/v3/users/0f684f6de9dc47a58e06f5ea0d0ec468` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.287090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.287330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f684f6de9dc47a58e06f5ea0d0ec468)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.288438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.289001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.289541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.290842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.291532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.294192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.337437 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 890/1767] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:45.337634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.354016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf17f-fc18-42eb-8485-fdac3d2cdc56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.365620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.366818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.367662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.368205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.369481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.378868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.421575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f684f6de9dc47a58e06f5ea0d0ec468'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:45.480793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 891/1768] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:45 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:45.482409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.513602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f684f6de9dc47a58e06f5ea0d0ec468'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:45.516015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f684f6de9dc47a58e06f5ea0d0ec468'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:45.532581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f684f6de9dc47a58e06f5ea0d0ec468'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:45.549801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f684f6de9dc47a58e06f5ea0d0ec468'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:45.563621 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 878/1769] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:45 2022] DELETE /identity/v3/users/0f684f6de9dc47a58e06f5ea0d0ec468 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:45.564850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.567677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:45.674645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03bf89-ab1b-492a-b35b-f48efd2284a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.711201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89e2ee-0673-4141-b329-9073c1ee7cf2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:45.717261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.717926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.718305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.718589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.720646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:45.762324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.765254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.779097 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 879/1770] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:45.780270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.781937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:45.858749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:45.860067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:45.860546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:45.860985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558/users/9bd45d73ee784b2d88712ec65d16d62c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:45.911488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8633aa0dea5440d9a9a03f23a9a8a558, user_id=9bd45d73ee784b2d88712ec65d16d62c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:45.914522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:45.942249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 892/1771] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:45 2022] PUT /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558/users/9bd45d73ee784b2d88712ec65d16d62c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:45.943696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:45.946026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:45.960739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbd0e-b0c8-44c8-bbd7-181591e416c1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.040591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e0dc-e367-4054-86b9-b75787686154 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.052086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.053385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.053675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.063023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.066473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.075281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4764-6c00-4afd-919f-1825f145dd6c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.155930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.157012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.157200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.157478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] PATH_INFO: `/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba/users/4d77e4cae4824c6a9c33551cbcb7f11d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.158345 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 893/1772] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:45 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:46.160509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.165717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.166280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.193760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef11d0b549f464d80a2db1b605bc2ba, user_id=4d77e4cae4824c6a9c33551cbcb7f11d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.203632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5d50-e17f-4390-ac82-3e5b69200451 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.242250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 880/1773] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:45 2022] PUT /identity/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba/users/4d77e4cae4824c6a9c33551cbcb7f11d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:46.242250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.242250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.242250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.246982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:46.248543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:46.274475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] MFA Rules not processed for user `9bd45d73ee784b2d88712ec65d16d62c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:46.276954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:46.432372 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 894/1774] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:46.432372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.453890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 881/1775] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:46.455400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.475210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591ce8b-4cab-4209-96ea-0553619e1d57 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.480607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c2fb2-395a-41ea-84a7-446c847b56e0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.489107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.489760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.490450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.490731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.490890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.491026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.491228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.491797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.491976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.493456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.496725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.501697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.511623 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 895/1776] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:46.512521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.519164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:46.525081 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 882/1777] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:46.540351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.544633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:46.551594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd20c3-264d-420b-9f29-99bd759e040f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.569499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.570790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.571293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.571934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.574039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.576664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.638909 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 896/1778] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:46 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:46.638909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.703121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d6dc4-c3aa-4fc7-b2f9-f76f30d15bc9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.803391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45209-7333-48bb-bda6-a072ef6dffb0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.816400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.818715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.819869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.820787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.822136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.825795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.834382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.835409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.835835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.836251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.850209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.852075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.856830 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 897/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:46.864286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.865850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 883/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:46.867550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.882277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f15fd-83b9-4df9-bb83-b58e1f2ff098 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.899622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395eb3-c4ab-4344-bb2a-5132b5eefb00 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:46.899830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.900645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.900995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.901539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.902476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.906317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8c86-e7c8-4eb5-9085-7ebd19ff7668 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.911041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:46.912198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.912507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.912803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] PATH_INFO: `/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba/users/4d77e4cae4824c6a9c33551cbcb7f11d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:46.921189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef11d0b549f464d80a2db1b605bc2ba, user_id=4d77e4cae4824c6a9c33551cbcb7f11d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:46.924073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:46.956590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 898/1781] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:46 2022] PUT /identity/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba/users/4d77e4cae4824c6a9c33551cbcb7f11d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:46.967353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:46.980887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 884/1782] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:46 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:46.980887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:46.980887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:46.980887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.035873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] MFA Rules not processed for user `4d77e4cae4824c6a9c33551cbcb7f11d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:47.045203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:47.162695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cabd1-f4c5-4833-b607-2030d7c2aa87 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:47.175788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:47.176959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:47.177242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:47.177514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] PATH_INFO: `/v3/projects/493bc8b0b32f4804a5694c0bf34cdeb4/users/b68e4ad966924cf98c972f0fc0704fc1/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.230396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=493bc8b0b32f4804a5694c0bf34cdeb4, user_id=b68e4ad966924cf98c972f0fc0704fc1, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:47.241104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:47.280142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 885/1783] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:47.282580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:47.287531 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 899/1784] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:46 2022] PUT /identity/v3/projects/493bc8b0b32f4804a5694c0bf34cdeb4/users/b68e4ad966924cf98c972f0fc0704fc1/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:47.293951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:47.299020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:47.332756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d879387-b1ae-4f09-8057-4f2ad50f8beb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:47.584089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:47.584819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:47.585113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:47.590629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.591508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:47.597983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624b92f-21e0-48dc-98c3-a05acb253ab2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:47.598331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101b75-53a5-463d-a6fc-d3ff617837ca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:47.642104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 886/1785] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:47.642104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:47.642104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:47.642104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.646139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:47.647049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:47.651795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:47.652811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.782229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] MFA Rules not processed for user `b68e4ad966924cf98c972f0fc0704fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:47.785389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:47.805443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:47.811923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:47.833968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 900/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:47.833968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:47.856727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87b92-cee3-4579-8209-7e73fe4ae11e service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:47.862838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:47.865294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:47.866236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:47.866729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] PATH_INFO: `/v3/projects/822cb58660c8461fb50d6b3d8c93782b/users/cc321b8e04e049c4827b6d42f8c531b7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:47.885161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822cb58660c8461fb50d6b3d8c93782b, user_id=cc321b8e04e049c4827b6d42f8c531b7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:47.889963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:47.914495 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 901/1787] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:47 2022] PUT /identity/v3/projects/822cb58660c8461fb50d6b3d8c93782b/users/cc321b8e04e049c4827b6d42f8c531b7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:47.919603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:47.994881 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 887/1788] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:47.994881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:48.024840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca130cb2-3185-4600-b481-a940bb8b9b45 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.092493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caf18e-33ef-4d83-a011-998f468430f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.106552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.107699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.108219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.108769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.110243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.113434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.149524 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 902/1789] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:48.150721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:48.156705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.158075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.158787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.159012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.171352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:48.181197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ea1c7-af3f-4c92-89e2-2b52e65558fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.192824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.194181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.194883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.197127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.198612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.201873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.277011 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 903/1790] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:48 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:48.278856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:48.368713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.370372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.421943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 888/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:48.422919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:48.467766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e92cf8-fdca-4320-8c67-a7e066380bd2 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.489521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f9d2-9b5a-478e-a5a3-24a1a281ba90 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.492115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.493872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.493872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.493872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.493872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.505883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51cf98-e6ec-4b3d-9f0a-bf7cac208eaa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.513937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.514858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.515215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.515409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] PATH_INFO: `/v3/projects/822cb58660c8461fb50d6b3d8c93782b/users/cc321b8e04e049c4827b6d42f8c531b7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.539046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822cb58660c8461fb50d6b3d8c93782b, user_id=cc321b8e04e049c4827b6d42f8c531b7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.551901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0812b8-a5b1-4936-8cd4-530803793c64 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.594734 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 904/1792] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:48 2022] PUT /identity/v3/projects/822cb58660c8461fb50d6b3d8c93782b/users/cc321b8e04e049c4827b6d42f8c531b7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:48.594734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81ef80-5a97-4feb-b1a8-3e1f6b52d49b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.594734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81ef80-5a97-4feb-b1a8-3e1f6b52d49b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.594734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81ef80-5a97-4feb-b1a8-3e1f6b52d49b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.595994 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 905/1793] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:51:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:48.596667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81ef80-5a97-4feb-b1a8-3e1f6b52d49b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:48.599165 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 889/1794] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:48 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:48.616822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.617187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.617482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.701264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] MFA Rules not processed for user `cc321b8e04e049c4827b6d42f8c531b7`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:48.702706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:48.852707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81ef80-5a97-4feb-b1a8-3e1f6b52d49b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:48.866644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:48.867423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.867766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.868047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:48.868811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:48.872540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbe65f-03a7-4104-90fb-aa8979382d42 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:48.916422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 906/1795] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:48.934490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:48.944639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:48.951381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.027887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 890/1796] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:49.028525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.039451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:49.040789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:49.072870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f866-ea1d-45c5-990d-30cbb632e08c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.108732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.117836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.118621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.119006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] PATH_INFO: `/v3/projects/302dda741e3141789056831e28cf1bfc/users/7808ec6392d14c469918b8ccd562712c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.197363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=302dda741e3141789056831e28cf1bfc, user_id=7808ec6392d14c469918b8ccd562712c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.199390 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 907/1797] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:49.200367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.200532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.213715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a69e-817a-402b-83f3-a19f9ca51d2c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.220934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.221790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.222195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.222577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.223410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.225824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.248068 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 891/1798] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:49 2022] PUT /identity/v3/projects/302dda741e3141789056831e28cf1bfc/users/7808ec6392d14c469918b8ccd562712c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:49.249148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.277597 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 908/1799] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:49 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:49.281543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.411728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4f9c-7812-4554-a4e0-acc2830d8bae admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.453137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0b31-85d3-4301-be52-0376a8694d59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.466002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.469366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.470192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.470746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.473172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.477933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.505019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 909/1800] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:49.506309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.520736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010054ad-6f32-40ea-84fc-98b6da7c22f8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.531658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.532409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.532828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.533205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.534241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.536715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.573233 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 910/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:49 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:49.574329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.579223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.582051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.586215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.586627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] PATH_INFO: `/v3/users/cd58307e3a4d45b3bc5f6385dee44c76` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.591346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd58307e3a4d45b3bc5f6385dee44c76)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.594872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.688488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd58307e3a4d45b3bc5f6385dee44c76'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:49.718832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd58307e3a4d45b3bc5f6385dee44c76'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:49.721811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd58307e3a4d45b3bc5f6385dee44c76'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:49.732786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0e6d-0cd3-418a-b158-14c2af3845c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.734013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd58307e3a4d45b3bc5f6385dee44c76'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:49.739978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.741002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.741525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.742179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.744522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:49.744970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd58307e3a4d45b3bc5f6385dee44c76'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:49.759539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.761636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.762679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 892/1802] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:49 2022] DELETE /identity/v3/users/cd58307e3a4d45b3bc5f6385dee44c76 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:49.767768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.769599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:49.776967 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 911/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:49.778396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.780251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:49.808227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a2e9-d47c-4941-8f70-e5aa0bd7cde4 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.871983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.873108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.873625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.874113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.875041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.877075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.883632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df9039-b4e3-4b8e-bcab-02943e430a5c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.890444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:49.891673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.892026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.892358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] PATH_INFO: `/v3/projects/302dda741e3141789056831e28cf1bfc/users/7808ec6392d14c469918b8ccd562712c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.893421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 912/1804] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:49.894670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:49.895192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] RBAC: Authorizing `identity:create_grant(project_id=302dda741e3141789056831e28cf1bfc, user_id=7808ec6392d14c469918b8ccd562712c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:49.897623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:49.898623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4e6ed-df73-480a-b3f3-5a6b8597619c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:49.913996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd363da-32d0-40c6-801c-e26cac0ab1f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:49.924353 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 893/1805] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:49 2022] PUT /identity/v3/projects/302dda741e3141789056831e28cf1bfc/users/7808ec6392d14c469918b8ccd562712c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:49.926261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:49.926561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:49.926934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:49.957951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:49.959521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.001658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:50.003548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.004292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.004981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] PATH_INFO: `/v3/projects/d5e73c0b10434dd19a90d5687673ff8b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.007167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e73c0b10434dd19a90d5687673ff8b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:50.011638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:50.085131 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 894/1806] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:50.085131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:50.095657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e975-5ea3-425c-8ac4-53d4123a6274 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:50.110497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e73c0b10434dd19a90d5687673ff8b', 'request_id': 'req-e32508d1-967f-4719-adde-d2438a7b4b0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.123779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e73c0b10434dd19a90d5687673ff8b', 'request_id': 'req-e32508d1-967f-4719-adde-d2438a7b4b0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.146897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e73c0b10434dd19a90d5687673ff8b', 'request_id': 'req-e32508d1-967f-4719-adde-d2438a7b4b0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.172610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] The token cache is being invalidate because project d5e73c0b10434dd19a90d5687673ff8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:50.172903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.186552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e32508d1-967f-4719-adde-d2438a7b4b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.188699 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 913/1807] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:49 2022] DELETE /identity/v3/projects/d5e73c0b10434dd19a90d5687673ff8b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:50.190053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.190344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.191183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.224803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:50.226371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.226994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.227814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.234333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:50.236218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:50.258864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] MFA Rules not processed for user `7808ec6392d14c469918b8ccd562712c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:50.260097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.268602 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 895/1808] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:50.268602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:50.275158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.410023 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 914/1809] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:50.419505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:50.422145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.447082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5efcc-de22-46eb-afa4-0d692a41f0f5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:50.461439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:50.462554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.462939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.463816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] PATH_INFO: `/v3/users/e8de9b7583e5423a8c81ad23e9e08377` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.465000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8de9b7583e5423a8c81ad23e9e08377)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:50.467194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:50.482443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6724f-4bc6-496c-be0d-a72cf8efcd53 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:50.499964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:50.500884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.501190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.501655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.513849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.545617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:50.547107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:50.578809 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 896/1810] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:50.579690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:50.583492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8de9b7583e5423a8c81ad23e9e08377'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.588026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.607577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8de9b7583e5423a8c81ad23e9e08377'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.608262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8de9b7583e5423a8c81ad23e9e08377'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.608960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8de9b7583e5423a8c81ad23e9e08377'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.627374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644e1d-ae62-4cea-8347-bf1a2296a53a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:50.647534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ff7e4f7-e056-4e60-89a3-28396b79f769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8de9b7583e5423a8c81ad23e9e08377'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:50.662068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:50.663131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.663724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.663949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] PATH_INFO: `/v3/projects/5c8862ffa283462ca3bc634c79f45ba6/users/c3a5a9846c7145bc8ca1ba0d8b28b635/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.708646 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 915/1811] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:50 2022] DELETE /identity/v3/users/e8de9b7583e5423a8c81ad23e9e08377 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:50.709871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6e57-2408-4234-8436-f52184098db7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.710089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6e57-2408-4234-8436-f52184098db7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.710308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f6e57-2408-4234-8436-f52184098db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.729798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f20f6e57-2408-4234-8436-f52184098db7 None None] MFA Rules not processed for user `b68e4ad966924cf98c972f0fc0704fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:50.730948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f20f6e57-2408-4234-8436-f52184098db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.764370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8862ffa283462ca3bc634c79f45ba6, user_id=c3a5a9846c7145bc8ca1ba0d8b28b635, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:50.767237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:50.815670 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 916/1812] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:50.826977 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 897/1813] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:50 2022] PUT /identity/v3/projects/5c8862ffa283462ca3bc634c79f45ba6/users/c3a5a9846c7145bc8ca1ba0d8b28b635/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:50.827966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:50.828323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:50.828648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:50.828949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:50.838547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:50.919213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] MFA Rules not processed for user `c3a5a9846c7145bc8ca1ba0d8b28b635`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:50.920465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:51.057106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf75d1-7d3e-4dff-94f6-58122043da51 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:51.082963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:51.083589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:51.083878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:51.084163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:51.090279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:51.118070 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 917/1814] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:51.281157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:51.282802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2fac2-4209-4b03-b3b8-ce6875ae08b7 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:51.313729 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 898/1815] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:51.439767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:51.442931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:51.473976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d04538-f21d-4501-b8e0-4a07a01fd00b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:51.488614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:51.489294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:51.489578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:51.489857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:51.500485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:51.691490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:51.694596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:51.709814 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 918/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:51:51.793584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:51.794146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:51.794146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:51.795859 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 899/1817] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:51.805134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:51.829767 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 02 20:51:51.831204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:51.849329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c98912-82ea-4fba-a59e-ee623140464f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:51.857965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:51.859585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:51.860506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:51.861501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:51.864408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:51.869447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a762253-c1ec-42c5-81e1-f182354f8fab tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:51.874016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 919/1818] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:51 2022] GET /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 395 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:52.001740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:52.003526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:52.017863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.018153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.018438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.022697 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 920/1819] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:52.030157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:52.085086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:52.110334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43264ec-ac84-4e64-b740-0418d40235d8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:52.124162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:52.125622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.126059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.126503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.128506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:52.130910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979dcaf-39e1-43df-9898-ded10b9114ea tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:52.134113 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 921/1820] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:52 2022] GET /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 395 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:51:52.143278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce2088-c79f-4001-bb53-0d426e01fcc3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:52.155098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:52.157920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.158342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.159311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] PATH_INFO: `/v3/projects/167ee9fd69c34fbb9d0ba713458b21d3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.162111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167ee9fd69c34fbb9d0ba713458b21d3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:52.168205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:52.218582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.218869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.219152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.221941 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 922/1821] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:52.232146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:52.273006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:52.297947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167ee9fd69c34fbb9d0ba713458b21d3', 'request_id': 'req-7b50bb40-5265-43f2-8047-72a1215f37a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.309547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830329-d6c1-4056-be43-84cf21570a06 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:52.318946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167ee9fd69c34fbb9d0ba713458b21d3', 'request_id': 'req-7b50bb40-5265-43f2-8047-72a1215f37a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.340685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167ee9fd69c34fbb9d0ba713458b21d3', 'request_id': 'req-7b50bb40-5265-43f2-8047-72a1215f37a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.364405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] The token cache is being invalidate because project 167ee9fd69c34fbb9d0ba713458b21d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:52.366424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.368448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.399324 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 900/1822] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:52 2022] DELETE /identity/v3/projects/167ee9fd69c34fbb9d0ba713458b21d3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:52.403909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:52.412730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:52.455605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:52.456827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.457179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.457480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.458783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:52.461322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:52.463505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 923/1823] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:52 2022] GET /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 395 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:51:52.533659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:52.537303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:52.693438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50bb40-5265-43f2-8047-72a1215f37a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:52.706221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5be00-f61c-42b2-a666-e4bd259b04c0 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:52.709376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:52.711076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.713405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.714471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] PATH_INFO: `/v3/users/4d77e4cae4824c6a9c33551cbcb7f11d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.715731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:52.718162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d77e4cae4824c6a9c33551cbcb7f11d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:52.721148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:52.724115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.725276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.725276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] PATH_INFO: `/v3/projects/dc804c9aaef94c409c0c1a956db631c4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.726225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc804c9aaef94c409c0c1a956db631c4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:52.730014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:52.836198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc804c9aaef94c409c0c1a956db631c4', 'request_id': 'req-f88dee7f-2d9c-466c-b9c0-0716d31adeec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.851504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d77e4cae4824c6a9c33551cbcb7f11d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.858627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc804c9aaef94c409c0c1a956db631c4', 'request_id': 'req-f88dee7f-2d9c-466c-b9c0-0716d31adeec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.874440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc804c9aaef94c409c0c1a956db631c4', 'request_id': 'req-f88dee7f-2d9c-466c-b9c0-0716d31adeec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.874940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d77e4cae4824c6a9c33551cbcb7f11d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.876742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d77e4cae4824c6a9c33551cbcb7f11d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.894451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] The token cache is being invalidate because project dc804c9aaef94c409c0c1a956db631c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:52.894798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d77e4cae4824c6a9c33551cbcb7f11d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.895064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.896702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f88dee7f-2d9c-466c-b9c0-0716d31adeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.899187 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 924/1824] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:52 2022] DELETE /identity/v3/projects/dc804c9aaef94c409c0c1a956db631c4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:52.909254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:52.909756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:52.910146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:52.916332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a0609b67-39f6-430e-8c34-d4ada6230314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d77e4cae4824c6a9c33551cbcb7f11d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:52.932603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 901/1825] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:52 2022] DELETE /identity/v3/users/4d77e4cae4824c6a9c33551cbcb7f11d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:51:52.962745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:52.966513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:53.097927 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 925/1826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:53.105526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.105856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.106083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.153314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:53.157386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:53.184940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 902/1827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:53.186389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.205696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e523b-25a6-4069-936b-fc03f9243f28 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.219324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.222556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.222978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.226234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.227238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:53.227883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:53.235099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:53.272202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 926/1828] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:53.276901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.295289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d542b-92cf-4c19-bdea-9139dc3b3e10 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.312953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.314842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.317107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.318872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.327763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:53.336348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:53.429048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 903/1829] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:53 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:53.450516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.489561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c976-cbe2-428d-aa1c-31a97d5c71da admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.642796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.643803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.644390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.645008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.656374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:53.662693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:53.755173 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 927/1830] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:53 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:53.755592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.783267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678fe03-555e-4ccc-b3f0-33920e8d72da admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.798822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.803622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.804126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.804541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.809647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:53.819642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:53.849540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.851483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:53.859177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 904/1831] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:51:53.860844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.895980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef423d54-8bd3-488e-a7b9-b405cdeb04c1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.907849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.909477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.911800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.912204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:53.913890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:53.924129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:53.970907 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 905/1832] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:53.972355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:53.991019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad7361-3799-450c-af40-373deed67144 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:53.997278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:53.998415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:53.998847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:53.999354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] PATH_INFO: `/v3/projects/45eb276d740649e99bb0bbf1ac0ac989/users/d4d9bbdefa7a48028aa4104a7148bf7c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.036593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45eb276d740649e99bb0bbf1ac0ac989, user_id=d4d9bbdefa7a48028aa4104a7148bf7c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:54.044843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb43c6-f061-4c1a-8d5a-e0ce6c4f0994 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:54.071830 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 906/1833] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:53 2022] PUT /identity/v3/projects/45eb276d740649e99bb0bbf1ac0ac989/users/d4d9bbdefa7a48028aa4104a7148bf7c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:51:54.073673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:54.074244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:54.074532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.094767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287787e-d846-4b47-b570-7f715002fdb8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:54.113803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] MFA Rules not processed for user `d4d9bbdefa7a48028aa4104a7148bf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:54.115400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:54.238509 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 907/1834] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:54.240653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:54.296475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:54.299030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:54.301884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:54.303003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.313562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:54.458858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c664f0-dcf5-4bd7-92b4-d936d1c1b251 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:54.488321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:54.489218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:54.489512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:54.489795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.491389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:54.495387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:54.522763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:54.524687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331af64-55da-426a-b5c2-a3b5131625f2 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:54.551161 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 928/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:51:54.552745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:54.553077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:54.553319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.579280 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 908/1836] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:54 2022] POST /identity/v3/projects => generated 383 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:54.580917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:54.585066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:54.649635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] MFA Rules not processed for user `f60ddc5315644283a9f9f5b8dfa67a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:54.660036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:54.779703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8a853-03fa-4012-824c-bc08ac95baf9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:54.804042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:54.809904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:54.810718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:54.818232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] PATH_INFO: `/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:54.822108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef11d0b549f464d80a2db1b605bc2ba)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:54.828075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:54.900302 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 929/1837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:54.901361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:54.946040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554439d-dd4b-41e6-a45c-965713680bf1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:54.961288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef11d0b549f464d80a2db1b605bc2ba', 'request_id': 'req-a6303a8c-5982-4e10-9310-85465d655a2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:54.983721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef11d0b549f464d80a2db1b605bc2ba', 'request_id': 'req-a6303a8c-5982-4e10-9310-85465d655a2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:54.992621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef11d0b549f464d80a2db1b605bc2ba', 'request_id': 'req-a6303a8c-5982-4e10-9310-85465d655a2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:55.037028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] The token cache is being invalidate because project 7ef11d0b549f464d80a2db1b605bc2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:51:55.038116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:55.043746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:55.046638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 909/1838] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:51:54 2022] DELETE /identity/v3/projects/7ef11d0b549f464d80a2db1b605bc2ba => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:55.050018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.053745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.105611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.107264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.107796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.108447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.109416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.111654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509c262-0f5b-426e-81a0-d082cf8a27c2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.144737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 930/1839] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:54 2022] POST /identity/v3/users => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:55.150034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cbb-ac65-4350-9aab-d6c86047f0a7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.150499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cbb-ac65-4350-9aab-d6c86047f0a7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.151107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cbb-ac65-4350-9aab-d6c86047f0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.176387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c8846cbb-ac65-4350-9aab-d6c86047f0a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:55.177966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8846cbb-ac65-4350-9aab-d6c86047f0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.209525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 931/1840] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:55.212997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.213546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.214629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.219831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 932/1841] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:55.222297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.226345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.284693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0fbaf-e319-4de3-b035-f720c6f92349 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.299872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.300911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.301570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.301911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.302927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.305653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c532ea-eb71-40ec-80a6-e07d35a07821 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.325503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303a8c-5982-4e10-9310-85465d655a2f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.333388 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 933/1842] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:55.333388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.333948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.334391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.336587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.337384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.337785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.338178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.347672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.361705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:55.364368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.397191 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 934/1843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:55.398189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:55.401494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.420542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.422020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.497864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.499740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.530263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 910/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:55.531159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.548373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f258f8-eeb2-4e21-9b2b-d61f5d984fa8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.554453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.555581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.556069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.556482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.558652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.561475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.565952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc836ab2-c205-451e-a4cf-3853df8f49ba service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.576903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 935/1845] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 395 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:55.577117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.578104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.578228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.578739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.579084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] PATH_INFO: `/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6/users/b9d25cd4ad4144329a356459343d1dd9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.609318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b690a-468b-47c9-a3b0-5b57aa075818 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.622187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c12dfc9eb478ead4ac4ae32cd9fe6, user_id=b9d25cd4ad4144329a356459343d1dd9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.627742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.628751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.629238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.629861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.631574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.632149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:51:55.634276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.636822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.666490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 911/1846] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:55 2022] PUT /identity/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6/users/b9d25cd4ad4144329a356459343d1dd9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:55.668428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.670691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 936/1847] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:55.672223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.701176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f79f-8f1b-48d6-8388-d50eaeb8ee38 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.789876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.790440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.790781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.791097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.791908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.793716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b153c8-fb14-46ef-93e9-1a2c61aaaf8e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.804968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 937/1848] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:55.810420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079ca8-8933-4971-8e0f-6c9e09976a97 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.810729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079ca8-8933-4971-8e0f-6c9e09976a97 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.811019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079ca8-8933-4971-8e0f-6c9e09976a97 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.813199 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 938/1849] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:51:55.814011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079ca8-8933-4971-8e0f-6c9e09976a97 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.830682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079ca8-8933-4971-8e0f-6c9e09976a97 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.832898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fea485-8586-4896-89be-6d461a7e7ffe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.837278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.838717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.839027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.839397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.840166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.840990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.841739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.842097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.842446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.844512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.844696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:55.882722 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 939/1850] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:55 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:55.882722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:55.966423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.968378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:55.969049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021e00-962e-4517-92d4-1ca43a45aa85 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:55.983411 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 912/1851] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:55.984631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:55.991751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:55.992791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:55.993144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:55.993492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] PATH_INFO: `/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6/users/b9d25cd4ad4144329a356459343d1dd9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:55.997255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c12dfc9eb478ead4ac4ae32cd9fe6, user_id=b9d25cd4ad4144329a356459343d1dd9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:55.998039 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 02 20:51:55.998348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.001108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.018646 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 940/1852] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:55 2022] PUT /identity/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6/users/b9d25cd4ad4144329a356459343d1dd9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:56.028241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.122539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67a4f-7956-4268-9386-59fe7c23c819 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.226876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79aba-5eee-48ae-97f7-3c9c74114816 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.245762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.246509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.246858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.247235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.247835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:56.249872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7554b2-ddda-4a98-9fba-0d1a14c1f4bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.324980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.324980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.325324 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 941/1853] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:56 2022] POST /identity/v3/users => generated 288 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:56.326562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.326856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.327135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.328638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.328961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.330529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:56.333102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.335046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 913/1854] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:55 2022] GET /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 395 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:56.344091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.377747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae479f-2a0b-48ab-80ed-e803f63c46e2 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.398657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.399334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.399629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.399900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.409699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:56.423920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.428349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] MFA Rules not processed for user `b9d25cd4ad4144329a356459343d1dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:56.430547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:56.492813 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 914/1855] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:56.493813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.536590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f850dd-cbee-4762-82b0-12eca12d5703 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.564421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.565742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.565742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.565966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.566627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:56.568894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.617377 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 942/1857] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:56.618269 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 915/1857] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:56.620613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.639761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:56.641951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48b37-c35e-4573-ad13-cf60cc0afe6a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.648831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.650950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.651962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.652613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] PATH_INFO: `/v3/projects/bda645627e434ca8a4db26e99ab32097/users/15044084440248c8a71c8da1f3dfc813/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.697167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda645627e434ca8a4db26e99ab32097, user_id=15044084440248c8a71c8da1f3dfc813, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:56.703526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4508abe-8765-4b11-bc0f-c5ae3b54aaa7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:56.731572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 943/1858] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:56 2022] PUT /identity/v3/projects/bda645627e434ca8a4db26e99ab32097/users/15044084440248c8a71c8da1f3dfc813/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:56.736329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c44850-3a16-48b2-b7f5-da62d5e68fdd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.737936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c44850-3a16-48b2-b7f5-da62d5e68fdd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.739010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c44850-3a16-48b2-b7f5-da62d5e68fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.759794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec9d0b-1b54-4dec-98c0-754efe1be0c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:56.779452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-89c44850-3a16-48b2-b7f5-da62d5e68fdd None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:56.780734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-89c44850-3a16-48b2-b7f5-da62d5e68fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:56.871221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:56.872630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.873289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.873905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.918738 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 944/1859] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:56.920500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:56.920500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:56.920699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:56.992796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] MFA Rules not processed for user `15044084440248c8a71c8da1f3dfc813`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:56.994080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:57.032622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.035153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.047698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 916/1860] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:51:57.049219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.050999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:57.156247 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 945/1861] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:57.157201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.183082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255863-c620-4acc-bc2b-d17fb544fc1d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.215286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.216071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.216339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.216745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.243776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.250869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c57e6-5621-496a-8837-41acc668b235 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.311853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 917/1862] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:57.327799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.328102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.328368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.330388 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 918/1863] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:51:57.351707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:51:57.395719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.400995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154658-f2db-4621-8a9f-1dbb8e2b1e0b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.414145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.415154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.415775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.417355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.426922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.429330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.503071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 946/1864] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:51:57 2022] POST /identity/v3/projects => generated 375 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:57.507388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.587575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e993c-97ac-4cb3-9b69-8539b981e9ce None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.667314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b593436-3a68-4116-acad-f543330e28f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.690001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.690963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.691443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.691921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.693245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.695403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.726620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc321b8e04e049c4827b6d42f8c531b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '822cb58660c8461fb50d6b3d8c93782b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.727775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.728037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.728423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] PATH_INFO: `/v3/projects/5c8862ffa283462ca3bc634c79f45ba6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.730616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorizing `identity:get_project(project_id=5c8862ffa283462ca3bc634c79f45ba6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.733560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.736110 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 919/1865] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:51:57 2022] GET /identity/v3/projects/5c8862ffa283462ca3bc634c79f45ba6 => generated 393 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:51:57.756875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 947/1866] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:51:57 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:51:57.762687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.784146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1759-3d8a-4b8c-8d5c-0b4dbd2abd84 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.790648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.792131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.792550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.792952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.793765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.796388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.817274 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 920/1867] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:51:57.823346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.843984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2b440-d848-4153-877a-32fed1afab5a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:57.859768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:57.861003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:57.861473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:57.861944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] PATH_INFO: `/v3/projects/6480226e0a61431e905695dfd7f8e4a7/users/69e4f084f7244b2f9540a2d471160a32/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:57.911791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6480226e0a61431e905695dfd7f8e4a7, user_id=69e4f084f7244b2f9540a2d471160a32, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:57.914916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:57.949822 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 948/1868] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:57 2022] PUT /identity/v3/projects/6480226e0a61431e905695dfd7f8e4a7/users/69e4f084f7244b2f9540a2d471160a32/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:57.951294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:57.972463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71af56-9b60-47a6-8ae4-39ed2deb9fd0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:58.109761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:58.111942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:58.184052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:58.186059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:58.186715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:58.187234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:58.188721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:58.194430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:58.219258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 921/1869] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:51:58.230232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:58.271693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e11fb-148d-46fe-9cfc-7e51bf6b1008 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:58.304612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:58.305843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:58.306417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:58.309716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] PATH_INFO: `/v3/projects/6480226e0a61431e905695dfd7f8e4a7/users/69e4f084f7244b2f9540a2d471160a32/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:58.323013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6480226e0a61431e905695dfd7f8e4a7, user_id=69e4f084f7244b2f9540a2d471160a32, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:58.333125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713ddc2-bd8a-4ebb-9095-7007650a4402 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:58.374839 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 922/1870] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:51:58 2022] PUT /identity/v3/projects/6480226e0a61431e905695dfd7f8e4a7/users/69e4f084f7244b2f9540a2d471160a32/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:58.384166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8ba44-18c7-46b7-875d-08dfbb77769a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:58.390617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c46aa8-223f-40e8-9066-0c605d0cbfa7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:58.391418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c46aa8-223f-40e8-9066-0c605d0cbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:58.391710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c46aa8-223f-40e8-9066-0c605d0cbfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:58.508024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-17c46aa8-223f-40e8-9066-0c605d0cbfa7 None None] MFA Rules not processed for user `69e4f084f7244b2f9540a2d471160a32`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:58.509747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-17c46aa8-223f-40e8-9066-0c605d0cbfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:58.732029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:58.732974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:58.745314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:58.745803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] PATH_INFO: `/v3/users/9bd45d73ee784b2d88712ec65d16d62c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:58.752180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd45d73ee784b2d88712ec65d16d62c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:58.758055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:58.779041 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 923/1871] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:51:58.779702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:58.782075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:58.782409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:58.876667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:58.880662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:58.908832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd45d73ee784b2d88712ec65d16d62c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:58.935664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd45d73ee784b2d88712ec65d16d62c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:58.936415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd45d73ee784b2d88712ec65d16d62c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:58.937024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd45d73ee784b2d88712ec65d16d62c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:58.953184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd45d73ee784b2d88712ec65d16d62c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.018183 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 949/1872] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:58 2022] DELETE /identity/v3/users/9bd45d73ee784b2d88712ec65d16d62c => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:59.020546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:59.023682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.032435 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 924/1873] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Apr 2 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:59.033644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:59.036145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.199198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b121f06-9724-4503-be9c-9a67bbb192f1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:59.208140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:59.211456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:59.211737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:59.212405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] PATH_INFO: `/v3/users/d4d9bbdefa7a48028aa4104a7148bf7c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:59.212836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaedea0-d2f9-4af7-b8b2-c34f16a303a1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:59.214773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d9bbdefa7a48028aa4104a7148bf7c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:59.218777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:59.311435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d9bbdefa7a48028aa4104a7148bf7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.343226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d9bbdefa7a48028aa4104a7148bf7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.344367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d9bbdefa7a48028aa4104a7148bf7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.345345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d9bbdefa7a48028aa4104a7148bf7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.356361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:59.357069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:59.357354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:59.357780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:59.363765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.381709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df7b1a1-4c53-4b91-a1f2-e6779f333120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d9bbdefa7a48028aa4104a7148bf7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:51:59.433484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 950/1874] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:51:59 2022] DELETE /identity/v3/users/d4d9bbdefa7a48028aa4104a7148bf7c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:51:59.434999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfd9a-2fd6-412a-8233-398a48d2bba7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:59.435298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfd9a-2fd6-412a-8233-398a48d2bba7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:59.435582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cfd9a-2fd6-412a-8233-398a48d2bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:59.508865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-024cfd9a-2fd6-412a-8233-398a48d2bba7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:59.510877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-024cfd9a-2fd6-412a-8233-398a48d2bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.549116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:59.550770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:51:59.592231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 925/1875] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:59.595438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:59.602102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.708182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 951/1876] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:59.712163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:59.712682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:59.714768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:59.766142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02f5be-9f6f-484a-b8bc-0e38939dc2ae service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:51:59.767806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:51:59.771080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.813924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 952/1877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:51:59.815155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:51:59.820013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.919578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:51:59.928269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:51:59.930001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:51:59.930276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:51:59.936140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:51:59.973988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:51:59.978074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:00.001703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 926/1878] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:00.004847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:00.009024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:00.033776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19286d-53d7-4f74-b135-01d9425d1fc3 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:00.046399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:00.048762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:00.050233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:00.051045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:00.052512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af4e36-e1f5-487d-a800-1e7b1cbf7a12 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:00.067620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:00.069301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:00.070626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:00.071594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:00.077794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:00.080256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:00.097724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:00.104369 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 927/1879] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:00.105571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:00.118655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c35255-77e4-4cef-9fa7-6748c257c940 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:00.133438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:00.133955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:00.134340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:00.134719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:00.153947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:00.155850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:00.185796 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 928/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:00.272663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:00.277224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:00.302155 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 953/1881] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:00.814695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:00.824501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:00.853542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:00.857184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.052466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6983fb-1f42-4b1a-a0b3-8aa01650ae79 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:01.053937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c268d0-e399-4941-bf14-ff711d2e619a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:01.068249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:01.069224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:01.069510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:01.069797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] PATH_INFO: `/v3/users/15044084440248c8a71c8da1f3dfc813` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:01.071221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15044084440248c8a71c8da1f3dfc813)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:01.074339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:01.077467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:01.078384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:01.078674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:01.078951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] PATH_INFO: `/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:01.081228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8633aa0dea5440d9a9a03f23a9a8a558)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:01.083152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:01.180146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15044084440248c8a71c8da1f3dfc813'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.214384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8633aa0dea5440d9a9a03f23a9a8a558', 'request_id': 'req-a054af59-c51f-41a5-9033-dc320335686b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.222453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15044084440248c8a71c8da1f3dfc813'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.226524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15044084440248c8a71c8da1f3dfc813'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.231998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8633aa0dea5440d9a9a03f23a9a8a558', 'request_id': 'req-a054af59-c51f-41a5-9033-dc320335686b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.240752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15044084440248c8a71c8da1f3dfc813'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.249637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8633aa0dea5440d9a9a03f23a9a8a558', 'request_id': 'req-a054af59-c51f-41a5-9033-dc320335686b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.263991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65b35a4-bc41-438c-affe-9bc3af37123d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15044084440248c8a71c8da1f3dfc813'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.280739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] The token cache is being invalidate because project 8633aa0dea5440d9a9a03f23a9a8a558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:01.281035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.283391 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 929/1882] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:00 2022] DELETE /identity/v3/users/15044084440248c8a71c8da1f3dfc813 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:01.287384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.290677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:01.291015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:01.291778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:01.296137 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 954/1883] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:00 2022] DELETE /identity/v3/projects/8633aa0dea5440d9a9a03f23a9a8a558 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:01.297379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:01.300654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.388733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:01.388733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.536353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054af59-c51f-41a5-9033-dc320335686b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:01.603137 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 930/1884] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:01.663707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:01.665251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.692026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:01.693777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:01.696661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:01.696863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] PATH_INFO: `/v3/users/cc321b8e04e049c4827b6d42f8c531b7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:01.699040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc321b8e04e049c4827b6d42f8c531b7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:01.703593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:01.799180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc321b8e04e049c4827b6d42f8c531b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.813936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc321b8e04e049c4827b6d42f8c531b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.814959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc321b8e04e049c4827b6d42f8c531b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.815949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc321b8e04e049c4827b6d42f8c531b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.837610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc321b8e04e049c4827b6d42f8c531b7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:01.851274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078eb03-8905-452c-ba65-d1effd2501fc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:01.859175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:01.860354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:01.860845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:01.861525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:01.863598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.867257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 955/1885] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:01 2022] DELETE /identity/v3/users/cc321b8e04e049c4827b6d42f8c531b7 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:01.867965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:01.899001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:01.905126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ca5cc-37ce-429d-b486-6a52d1e971dc service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:01.905983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:01.921530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 931/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:02.098065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d0583-ff02-4cae-8f49-0b01d3d5653b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:02.105543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:02.109271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:02.109565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:02.111054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] PATH_INFO: `/v3/projects/45eb276d740649e99bb0bbf1ac0ac989` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:02.113065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45eb276d740649e99bb0bbf1ac0ac989)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:02.115445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:02.165160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:02.165160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:02.165160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:02.185831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] MFA Rules not processed for user `c42119999e6f40b487a7174dc5a7d617`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:02.188288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:02.232496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45eb276d740649e99bb0bbf1ac0ac989', 'request_id': 'req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.256116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45eb276d740649e99bb0bbf1ac0ac989', 'request_id': 'req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.280539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45eb276d740649e99bb0bbf1ac0ac989', 'request_id': 'req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.313155 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 932/1887] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:02.321215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] The token cache is being invalidate because project 45eb276d740649e99bb0bbf1ac0ac989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:02.321515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.334810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.337203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 956/1888] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:01 2022] DELETE /identity/v3/projects/45eb276d740649e99bb0bbf1ac0ac989 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:02.341263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:02.357572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed1e6-0039-4ecc-8ad7-62929227e9da None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:02.594343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:02.595941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:02.596422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:02.597020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] PATH_INFO: `/v3/users/b9d25cd4ad4144329a356459343d1dd9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:02.598717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d25cd4ad4144329a356459343d1dd9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:02.601083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:02.663045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:02.670440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:02.694213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d25cd4ad4144329a356459343d1dd9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.715132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256da6-fb17-4c6b-906d-bdc2b277ec2c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:02.727389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d25cd4ad4144329a356459343d1dd9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.729079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d25cd4ad4144329a356459343d1dd9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.733479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:02.738666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:02.738666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:02.738666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] PATH_INFO: `/v3/projects/bda645627e434ca8a4db26e99ab32097` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:02.738666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda645627e434ca8a4db26e99ab32097)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:02.741164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:02.759223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d25cd4ad4144329a356459343d1dd9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.775266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d25cd4ad4144329a356459343d1dd9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.793550 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 933/1889] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:02 2022] DELETE /identity/v3/users/b9d25cd4ad4144329a356459343d1dd9 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:02.819541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda645627e434ca8a4db26e99ab32097', 'request_id': 'req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.833361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda645627e434ca8a4db26e99ab32097', 'request_id': 'req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.849191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda645627e434ca8a4db26e99ab32097', 'request_id': 'req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.890573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] The token cache is being invalidate because project bda645627e434ca8a4db26e99ab32097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:02.891626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.901868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:02.907404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 957/1890] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:02 2022] DELETE /identity/v3/projects/bda645627e434ca8a4db26e99ab32097 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:02.911397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:02.914443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.030054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:03.033157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.076952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb198d-3806-4c22-937f-9c14090b4e95 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:03.195996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86caa1-844f-4ba1-a6d8-4777ce8e3233 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:03.196782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:03.197870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.198165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.198444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] PATH_INFO: `/v3/users/69e4f084f7244b2f9540a2d471160a32` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.200396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e4f084f7244b2f9540a2d471160a32)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:03.203383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:03.230084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:03.230992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.231281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.231573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] PATH_INFO: `/v3/projects/822cb58660c8461fb50d6b3d8c93782b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.237352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822cb58660c8461fb50d6b3d8c93782b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:03.239349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:03.294520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e4f084f7244b2f9540a2d471160a32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.325746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e4f084f7244b2f9540a2d471160a32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.326680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e4f084f7244b2f9540a2d471160a32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.343730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e4f084f7244b2f9540a2d471160a32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.352780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e4f084f7244b2f9540a2d471160a32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.371100 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 934/1891] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:02 2022] DELETE /identity/v3/users/69e4f084f7244b2f9540a2d471160a32 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:03.382011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822cb58660c8461fb50d6b3d8c93782b', 'request_id': 'req-6eabda15-44a6-467b-aed5-48710bb7f296'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.396339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822cb58660c8461fb50d6b3d8c93782b', 'request_id': 'req-6eabda15-44a6-467b-aed5-48710bb7f296'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.408087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822cb58660c8461fb50d6b3d8c93782b', 'request_id': 'req-6eabda15-44a6-467b-aed5-48710bb7f296'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.426820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] The token cache is being invalidate because project 822cb58660c8461fb50d6b3d8c93782b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:03.427306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.428264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6eabda15-44a6-467b-aed5-48710bb7f296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.431068 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 958/1892] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:03 2022] DELETE /identity/v3/projects/822cb58660c8461fb50d6b3d8c93782b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:03.435025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:03.437683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.493045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a549-2174-4969-9fe6-10832041a540 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.493526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a549-2174-4969-9fe6-10832041a540 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.493910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a549-2174-4969-9fe6-10832041a540 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.498235 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 959/1893] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:03.514309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.514946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.524683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.567153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:03.569169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.590270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079637cf-7671-4ac3-ba10-e8f1f979490c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:03.596412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:03.600844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.601178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.601458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] PATH_INFO: `/v3/users/c3a5a9846c7145bc8ca1ba0d8b28b635` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.605207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a5a9846c7145bc8ca1ba0d8b28b635)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:03.609994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:03.655841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 960/1894] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:03.662944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:03.664832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.685032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a5a9846c7145bc8ca1ba0d8b28b635'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.693446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f77e5-626f-4539-a02e-ee5e445a8dbe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:03.705361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:03.705604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a5a9846c7145bc8ca1ba0d8b28b635'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.706627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.707071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.707498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] PATH_INFO: `/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.708961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96c12dfc9eb478ead4ac4ae32cd9fe6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:03.709081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a5a9846c7145bc8ca1ba0d8b28b635'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.711154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:03.719914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a5a9846c7145bc8ca1ba0d8b28b635'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.741038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a5a9846c7145bc8ca1ba0d8b28b635'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.748937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 935/1895] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:03 2022] DELETE /identity/v3/users/c3a5a9846c7145bc8ca1ba0d8b28b635 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:03.749928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:03.751347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.795056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96c12dfc9eb478ead4ac4ae32cd9fe6', 'request_id': 'req-bef52afa-b869-41b3-bebe-1f05b6ad5911'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.803818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96c12dfc9eb478ead4ac4ae32cd9fe6', 'request_id': 'req-bef52afa-b869-41b3-bebe-1f05b6ad5911'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.813601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96c12dfc9eb478ead4ac4ae32cd9fe6', 'request_id': 'req-bef52afa-b869-41b3-bebe-1f05b6ad5911'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.829508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] The token cache is being invalidate because project c96c12dfc9eb478ead4ac4ae32cd9fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:03.829801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.830486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef52afa-b869-41b3-bebe-1f05b6ad5911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:03.832206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 961/1896] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:03 2022] DELETE /identity/v3/projects/c96c12dfc9eb478ead4ac4ae32cd9fe6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:03.838984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4401-a763-47e3-9bd4-5c7769314094 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.840197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4401-a763-47e3-9bd4-5c7769314094 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.841604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d4401-a763-47e3-9bd4-5c7769314094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:03.902177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d05d4401-a763-47e3-9bd4-5c7769314094 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:03.906212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d05d4401-a763-47e3-9bd4-5c7769314094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:03.909092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96557205-da88-4b00-8f47-e9357bc16df4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:03.989002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 962/1897] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:03.998849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:03.999456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:03.999815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.035476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:04.036795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.054270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.055856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 963/1898] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:04.056588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.057506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.058149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.058269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.060221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.060572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.075139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63233394-4b1e-4b18-a30c-52605ba39aca None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.078029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.080058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.081086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.082025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.082502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.082793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] PATH_INFO: `/v3/projects/6480226e0a61431e905695dfd7f8e4a7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.084062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6480226e0a61431e905695dfd7f8e4a7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.087687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.092295 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 936/1899] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:04.093369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.125134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc9dc-229c-4b2a-8890-78625325a5ab service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.137402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.138520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.138520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.139752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.140540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:04.140856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.142804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.155810 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 937/1900] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:04.164761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.187583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6480226e0a61431e905695dfd7f8e4a7', 'request_id': 'req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.196698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4af0-e29c-43f6-9b9f-aaab89085ce4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.197915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6480226e0a61431e905695dfd7f8e4a7', 'request_id': 'req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.219529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6480226e0a61431e905695dfd7f8e4a7', 'request_id': 'req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.240530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] The token cache is being invalidate because project 6480226e0a61431e905695dfd7f8e4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:04.240530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.240530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc4daf75-aec6-4cf4-8929-449ab52c7dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.247914 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 964/1901] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:04 2022] DELETE /identity/v3/projects/6480226e0a61431e905695dfd7f8e4a7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:04.254144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9825f-ea09-4025-a76e-c5422d0b255f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.254662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9825f-ea09-4025-a76e-c5422d0b255f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.255136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9825f-ea09-4025-a76e-c5422d0b255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.290349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d3a9825f-ea09-4025-a76e-c5422d0b255f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:04.292133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d3a9825f-ea09-4025-a76e-c5422d0b255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.293057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.294628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.294924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.295279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.296120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.299176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.300993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 965/1902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:04.309461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.309755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.310046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.334297 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 938/1903] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:04.338760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.341607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.351233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:04.352494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.445124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 966/1904] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:04.451624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a64c-b9fe-417b-8578-ec3f08d32838 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.454299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.459058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.459844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.460134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.460522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.461227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.463559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.468244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28108-28e8-411c-b5ce-88f64b3e88aa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.483922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.483922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.483922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.485866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.486874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:04.489335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.491152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.496638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 939/1905] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:04.497968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.511131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030d2f0-60e4-42e5-89be-f76ff76db1a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.516252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.517013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.517306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.517584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.518322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.520171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.537423 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 940/1906] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:04.539395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.541786 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 967/1907] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:04.546203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.566941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06046220-0f59-49f8-9b07-a60bc489f2c1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.567226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1c8c0-20fd-4e77-bb7a-85df903572ac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.576672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.578565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.579095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.579621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.581428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.581787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.582667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.584534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.584534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.585449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.587672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.592218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.611549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 941/1908] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:04.618188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.639567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71188-2406-4963-9d80-2c6f47d89f5c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.647939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.649441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.650032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.651068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749/users/cf654deee6974ffa8cacea70192c8a90/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.662164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 968/1909] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/projects => generated 395 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:04.662164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.664666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.688209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e4c08f91e24bedb51356cd9e640749, user_id=cf654deee6974ffa8cacea70192c8a90, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.691175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.714846 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 942/1910] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:04 2022] PUT /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749/users/cf654deee6974ffa8cacea70192c8a90/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:04.715690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.782277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cece0e-9bae-4233-b5dd-debe26156ef8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.786399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320aaef-7282-468f-93c3-926772142f45 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:04.786897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.787893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.788489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.788809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] PATH_INFO: `/v3/projects/5c8862ffa283462ca3bc634c79f45ba6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.790471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8862ffa283462ca3bc634c79f45ba6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.792638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:04.793420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.793770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.794951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.797828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:04.800622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.819296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5ebb1-85af-4629-969b-2a9851eab0b6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:04.865612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 943/1911] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:04.866207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aca7e3-55ec-4447-b1fb-125ad86df8c0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:04.866502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aca7e3-55ec-4447-b1fb-125ad86df8c0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:04.870357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aca7e3-55ec-4447-b1fb-125ad86df8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:04.884446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8862ffa283462ca3bc634c79f45ba6', 'request_id': 'req-b05aca80-b398-47ee-b9c2-74479e964c22'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.901089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8862ffa283462ca3bc634c79f45ba6', 'request_id': 'req-b05aca80-b398-47ee-b9c2-74479e964c22'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.914989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70aca7e3-55ec-4447-b1fb-125ad86df8c0 None None] MFA Rules not processed for user `cf654deee6974ffa8cacea70192c8a90`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:04.915610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8862ffa283462ca3bc634c79f45ba6', 'request_id': 'req-b05aca80-b398-47ee-b9c2-74479e964c22'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.918858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70aca7e3-55ec-4447-b1fb-125ad86df8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:04.946329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] The token cache is being invalidate because project 5c8862ffa283462ca3bc634c79f45ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:04.946535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.950143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:04.959508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 969/1912] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:04 2022] DELETE /identity/v3/projects/5c8862ffa283462ca3bc634c79f45ba6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:04.959508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:04.971260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.026383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 944/1913] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:05.027812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.028112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.028394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.066391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:05.068120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.101301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca80-b398-47ee-b9c2-74479e964c22 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.106256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.106951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.107237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.107543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 945/1914] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:05.108387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.113176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.114486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.115502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.117206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b154b-5af2-4b06-a1db-8bc2f5b8f1cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.132021 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 970/1915] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:05.133570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.133922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.134131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.139891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d27d66-c9ab-497a-a662-c56a2a3230f3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.148726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.149558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.149900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.150250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.151619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.153742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.156897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:05.158118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.184942 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 971/1916] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:05.186421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.194327 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 946/1917] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:05.195264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.209733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ecbf6-a77f-4671-b694-c7b8231ffefb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.303864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.304319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.304648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.304926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.305742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.308135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.327642 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 972/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:05.329195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.333241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21580a8-0e7a-4f10-a18d-58fa65c50ef6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.339663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.340714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.341608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ccb38-3a20-4fa2-94d6-cc99046cc2f4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.342051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.342598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.344328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:05.344777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.346640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.346855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de06d9-d68e-482b-ab93-5d98191dd6c4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.347370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.347810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.348101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.349436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.351974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.371161 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 947/1919] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:05.375532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d26-8d72-4dd9-a6b7-e6452062a484 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.376106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d26-8d72-4dd9-a6b7-e6452062a484 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.376773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc9d26-8d72-4dd9-a6b7-e6452062a484 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.385836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 973/1920] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:05.387028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.394150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 948/1921] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:52:05 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:05.395173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9d26-8d72-4dd9-a6b7-e6452062a484 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.414607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc9d26-8d72-4dd9-a6b7-e6452062a484 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.415682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a492-fa78-4f41-ac3b-61681084548c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.425813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.427146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.427606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.428192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] PATH_INFO: `/v3/projects/9839c4966f3646a692929ca82a9a5fa5/users/a72be51adbcd4880a3c4b2e47759d16b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.432638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.433520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.433959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.434854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.435844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.441136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.469490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9839c4966f3646a692929ca82a9a5fa5, user_id=a72be51adbcd4880a3c4b2e47759d16b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.492709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71b07c-9942-456c-b311-62a56edb8fff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.502848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 949/1922] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:05.504077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.517719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 974/1923] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:05 2022] PUT /identity/v3/projects/9839c4966f3646a692929ca82a9a5fa5/users/a72be51adbcd4880a3c4b2e47759d16b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:05.527372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.527372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.527372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.558987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:05.560259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.602140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8bc42-c508-4858-903f-2b08247f035c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.650988 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 975/1924] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:05.652249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.668642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.669326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.669606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.669880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.670760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.672404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ee0c-17fc-4122-a082-2e2240b0d015 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.682651 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 950/1925] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:05.684015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.684304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.684612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.714219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] MFA Rules not processed for user `a72be51adbcd4880a3c4b2e47759d16b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:05.715335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.729745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a092ddd-49a2-41ce-aab0-35a89d64d470 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.737909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.738603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.738889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.739168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.739877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.743262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.773710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 976/1926] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:05.773710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.774545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:05.792616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdde1-0303-4044-85cf-b25064361042 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.798276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.798922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.799203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.799475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.805476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 951/1927] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:05.806480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.812324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.814041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.826353 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 977/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:05.827124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.842388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4568cd-62b9-4b97-9b8d-30b136344de9 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.845279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fa2ce-6cd4-4753-86a9-f54a84853d09 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.849192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.850131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.850579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.850997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.851395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.852031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.852496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.852858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.853260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] PATH_INFO: `/v3/projects/87adb6fa7637407eb49196fdf2eaad73/users/1e98117602f5479e83d46f8114ef0c18/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.855357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.868383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 978/1929] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:05.870141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.878977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87adb6fa7637407eb49196fdf2eaad73, user_id=1e98117602f5479e83d46f8114ef0c18, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.882411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.887348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe380cf-57ad-4bf1-88e7-724003fd4d5a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:05.892463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:05.893188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:05.893483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:05.893752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:05.894468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:05.896700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:05.900055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 952/1930] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:05 2022] PUT /identity/v3/projects/87adb6fa7637407eb49196fdf2eaad73/users/1e98117602f5479e83d46f8114ef0c18/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:05.901529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.940976 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 979/1931] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:05 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:05.940976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:05.985477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d213c81-5d5e-4d01-a962-e2fa1817510c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.020495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71e372-6fea-4821-b6b5-039eed6ca70b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.027265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.028433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.028833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.030027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.030323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.032706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.055613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 980/1932] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:06.057099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.070630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db48d-f6c4-4367-a4d0-d030f22db24d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.075896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.076615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.077181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.077475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.078451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.080700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.081319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.081584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.087207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.087207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.087207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.087207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.104662 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 953/1933] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:06.111690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.121519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 981/1934] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/users => generated 306 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:06.122794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.127691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d969-a4e6-4074-b74b-958751f407ea admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.136821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.137881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.138218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.138571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] PATH_INFO: `/v3/projects/87adb6fa7637407eb49196fdf2eaad73/users/1e98117602f5479e83d46f8114ef0c18/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.140199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bfaf-95d0-4e98-a003-fda2f77a9392 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.140961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=87adb6fa7637407eb49196fdf2eaad73, user_id=1e98117602f5479e83d46f8114ef0c18, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.144122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.146997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.148592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.149149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.149602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] PATH_INFO: `/v3/projects/30bc4f8730a441fabe8d11fe1c918c1d/users/b70b2f7eb5ec404aa5a74a32b01ce842/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.167222 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 954/1935] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:06 2022] PUT /identity/v3/projects/87adb6fa7637407eb49196fdf2eaad73/users/1e98117602f5479e83d46f8114ef0c18/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:06.167222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.176513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bc4f8730a441fabe8d11fe1c918c1d, user_id=b70b2f7eb5ec404aa5a74a32b01ce842, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.179428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec034302-ab4b-4986-b3d1-7f1d6fd3d6f7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.195728 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 982/1936] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:06 2022] PUT /identity/v3/projects/30bc4f8730a441fabe8d11fe1c918c1d/users/b70b2f7eb5ec404aa5a74a32b01ce842/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:06.205524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbffe2-b363-44aa-95a0-9c4f7de764a4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.205524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbffe2-b363-44aa-95a0-9c4f7de764a4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.205524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbffe2-b363-44aa-95a0-9c4f7de764a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.232731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7ffbffe2-b363-44aa-95a0-9c4f7de764a4 None None] MFA Rules not processed for user `1e98117602f5479e83d46f8114ef0c18`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:06.233954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ffbffe2-b363-44aa-95a0-9c4f7de764a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:06.235610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9832b-c53f-498a-a24f-f7aadf8887ed admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.293570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.294246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.294534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.294814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.295679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.297309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.302344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 983/1937] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:06.304585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.304585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.304585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.309762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 955/1938] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:06.313590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.315250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:06.335478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] MFA Rules not processed for user `b70b2f7eb5ec404aa5a74a32b01ce842`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:06.336699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:06.388893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce647f-4382-4a81-b60e-2184f2773c9a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.394449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.395100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.395390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.395669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.403103 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 984/1939] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:06.404073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.407927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.409628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.414408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd9bb-ae01-4732-a294-915d1ab2d61b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.419069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.419431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 956/1940] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:06.419935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.420190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.420284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.420499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] PATH_INFO: `/v3/projects/cca916b334104d67baa72f3b541a0c7b/users/2d3ccd0d46204d9bb52342960888342a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.430089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba19b83-4fad-4f6b-b325-c71feec80b13 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.435013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.435713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.435996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.436278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.437000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.437105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca916b334104d67baa72f3b541a0c7b, user_id=2d3ccd0d46204d9bb52342960888342a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.440090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b311-8bdd-4e03-b566-a08aee02bb65 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.443998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.455300 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 985/1941] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:06 2022] PUT /identity/v3/projects/cca916b334104d67baa72f3b541a0c7b/users/2d3ccd0d46204d9bb52342960888342a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:06.456690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d67c-ea28-443c-a74c-63c196f89d3f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.456982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d67c-ea28-443c-a74c-63c196f89d3f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.457260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d67c-ea28-443c-a74c-63c196f89d3f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.459205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 986/1942] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:06.460001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d67c-ea28-443c-a74c-63c196f89d3f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.480957 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 957/1943] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:06.480957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:06.524388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d67c-ea28-443c-a74c-63c196f89d3f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.548398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.584636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.585306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.585589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.585862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.586581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.588924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.603071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 987/1944] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:06.603071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.616682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330743-6b85-48ee-81a9-6a44d4c658cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.621956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.622701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.622991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.623099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e1354-bb1a-4e48-98b9-75bbaa3c19c8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.623275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.624061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.626026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.629944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.631170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.631528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.632538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.641738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.644272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.646275 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 958/1945] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:06.647163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.659511 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 988/1946] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/users => generated 303 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:06.661643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.672141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74ee4-8194-474a-a2b0-dc138fe6bfcd tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.676827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac506d-ff58-48f8-84bd-dcefb0fea0a6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.683752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.684698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.684979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.685271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] PATH_INFO: `/v3/projects/cca916b334104d67baa72f3b541a0c7b/users/2d3ccd0d46204d9bb52342960888342a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.687342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca916b334104d67baa72f3b541a0c7b, user_id=2d3ccd0d46204d9bb52342960888342a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.690019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182705be-d42a-4aef-841e-cea6bfc3f049 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.702013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.702707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.708737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.708937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 959/1947] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:06 2022] PUT /identity/v3/projects/cca916b334104d67baa72f3b541a0c7b/users/2d3ccd0d46204d9bb52342960888342a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:06.709035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.709035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.709190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9004f-53ef-4bc2-a42a-bfe29eab20c5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.709190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9004f-53ef-4bc2-a42a-bfe29eab20c5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.709190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9004f-53ef-4bc2-a42a-bfe29eab20c5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.709417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.709495 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 960/1948] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:06.716020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.716605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.717089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.725926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 989/1949] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:06.730147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:06.754142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] MFA Rules not processed for user `2d3ccd0d46204d9bb52342960888342a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:06.754280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.756440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:06.771382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd289153-efad-44dd-8c94-accc863aca90 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.834648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.835547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.835910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.836235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 961/1950] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:06.840493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.840603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.840688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.840688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.841747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 990/1951] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:06.846921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:06.907483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd87fd-6591-4cd7-bf63-cecced915862 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.913013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.913910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.914191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.914464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] PATH_INFO: `/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32/users/fd5c2e1b9caf430ab8f8fee636b49f9e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.932784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aa08f-0a52-4e7b-8d6e-434d18a4fb81 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:06.936936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d16a4ecf2834c978f5fa6646ed26a32, user_id=fd5c2e1b9caf430ab8f8fee636b49f9e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:06.938739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:06.939400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.939599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825e8a8-01de-4e8a-9599-fa679faaa778 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:06.939732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.939956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.953316 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 962/1952] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:06 2022] PUT /identity/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32/users/fd5c2e1b9caf430ab8f8fee636b49f9e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:06.957611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:06.957896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:06.958175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:06.975198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] MFA Rules not processed for user `cf654deee6974ffa8cacea70192c8a90`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:06.976523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:07.004639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.006255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.015650 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 991/1953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:07.016644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.031325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e6bd-9b32-4693-b5c3-8cf43492d40c service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.032107 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 963/1954] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:07.045228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.097613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.098326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.098620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.098891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.099614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.101250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.111536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 992/1955] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:07.115644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.123637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6f72f-d682-42ba-bd26-170f6e705afa None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.128284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6991-09c6-4714-8cf6-cb3a1f617170 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.129650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.130439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.130731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.131011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.133271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.134233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.136521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.136521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] PATH_INFO: `/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32/users/fd5c2e1b9caf430ab8f8fee636b49f9e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.138067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d16a4ecf2834c978f5fa6646ed26a32, user_id=fd5c2e1b9caf430ab8f8fee636b49f9e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.140362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.140858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.142004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17545820-2bbb-4d90-bc32-ffcdcf0ae7e4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.152009 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 964/1956] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:07.152543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 993/1957] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:07 2022] PUT /identity/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32/users/fd5c2e1b9caf430ab8f8fee636b49f9e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:07.163726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.164254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.164591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.196554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] MFA Rules not processed for user `fd5c2e1b9caf430ab8f8fee636b49f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:07.197900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:07.299449 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 965/1958] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:07.420858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.496093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6c2b5-68ec-42ef-92ba-cb7918c136fe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.501607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.502260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.502546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.502824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.551711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.564261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d787e-3c34-4670-813e-600f14b92a09 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.564854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.566497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf26c0d-4dac-4b5a-b89d-647fcdddd698 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.570324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.570996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.571276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.571556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.576170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 994/1959] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:07.580020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.581635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.592174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 966/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:07.635503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066726a-d957-40ab-bac7-3666b4800b89 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.635893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066726a-d957-40ab-bac7-3666b4800b89 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.636140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066726a-d957-40ab-bac7-3666b4800b89 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.638294 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 995/1961] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:07.643508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:07.656655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.722963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5796cf-bcbe-4c70-99c6-d9116240677a service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.727311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.728203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.729089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.729497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.730683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.732782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526912e-6b65-4083-9cfb-631432e7ea2a tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.734523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 967/1962] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:07.833815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066726a-d957-40ab-bac7-3666b4800b89 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.849560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.849859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.850136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.851921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 968/1963] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:07.858058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:07.875632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.886590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96692f14-21ea-48dc-b90b-b314821cdcd7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.895624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.897398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.897719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.898066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.899427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.902174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.902977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066726a-d957-40ab-bac7-3666b4800b89 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.904045 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 969/1964] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:07 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:07.908443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.909332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.909614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.909922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] PATH_INFO: `/v3/users/b70b2f7eb5ec404aa5a74a32b01ce842` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.911088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70b2f7eb5ec404aa5a74a32b01ce842)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.913025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.934538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:07.948491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb447d-5b83-45a0-89d8-06438c9338be tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:07.955780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:07.957118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:07.957528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:07.957908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] PATH_INFO: `/v3/users/a72be51adbcd4880a3c4b2e47759d16b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:07.959392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72be51adbcd4880a3c4b2e47759d16b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:07.961641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:07.976235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70b2f7eb5ec404aa5a74a32b01ce842'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:07.985199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70b2f7eb5ec404aa5a74a32b01ce842'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:07.985833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70b2f7eb5ec404aa5a74a32b01ce842'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:07.986456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70b2f7eb5ec404aa5a74a32b01ce842'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:07.996311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-294f68ce-7f14-4562-afdc-537b77c95203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70b2f7eb5ec404aa5a74a32b01ce842'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.012682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72be51adbcd4880a3c4b2e47759d16b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.017181 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 996/1965] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:07 2022] DELETE /identity/v3/users/b70b2f7eb5ec404aa5a74a32b01ce842 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:08.021071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26b3f-b6e2-4663-9ede-2b8e1e16df7b None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.021364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26b3f-b6e2-4663-9ede-2b8e1e16df7b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.021642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26b3f-b6e2-4663-9ede-2b8e1e16df7b None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.023325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 997/1966] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:08.024361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f189f-0d7e-4e4c-aba7-67ebf05ea4b7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.024760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f189f-0d7e-4e4c-aba7-67ebf05ea4b7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.025078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f189f-0d7e-4e4c-aba7-67ebf05ea4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.032425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72be51adbcd4880a3c4b2e47759d16b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.033368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72be51adbcd4880a3c4b2e47759d16b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.042144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72be51adbcd4880a3c4b2e47759d16b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.043426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a35f189f-0d7e-4e4c-aba7-67ebf05ea4b7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:08.044687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a35f189f-0d7e-4e4c-aba7-67ebf05ea4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.050371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72be51adbcd4880a3c4b2e47759d16b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:08.056612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 970/1967] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:07 2022] DELETE /identity/v3/users/a72be51adbcd4880a3c4b2e47759d16b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:08.057847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:08.059439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.116028 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 998/1968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:08.117116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.117412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.117697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.137304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:08.138746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.139272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:08.140587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.203692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febba6-5c61-4f33-9047-0392eb6fdd5d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:08.204741 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 999/1969] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:08.205437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:08.208868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.211667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:08.212561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.213461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.214024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.215224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:08.217341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:08.219104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 971/1970] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:08 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:08.219860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:08.221581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.270661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb7000-e2c1-46ff-bc64-6a5b5f8e68fa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:08.276085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:08.276900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.277319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.277883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.288353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:08.289355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696cc6d-4281-4933-aed3-de9b7d6a70ab tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:08.290046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae74f-241e-4c76-887d-a822e469a4d5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:08.298346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:08.299396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.299896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.300338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.300878 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1000/1971] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:08.305904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.306197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.307028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.312048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:08.313679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:08.324832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] MFA Rules not processed for user `cf654deee6974ffa8cacea70192c8a90`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:08.325503 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 972/1972] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:08.325880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.384082 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1001/1973] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:08.896280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:08.898920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.928279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:08.929133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942e7e-380d-4fed-9ecc-8813023065f4 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:08.929759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:08.935754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:08.936779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.937281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.937808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] PATH_INFO: `/v3/projects/30bc4f8730a441fabe8d11fe1c918c1d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.940232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bc4f8730a441fabe8d11fe1c918c1d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:08.944992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:08.954218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5d9e7-4457-40c9-bb78-731e17112550 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:08.977520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:08.979028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:08.979325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:08.979722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] PATH_INFO: `/v3/projects/9839c4966f3646a692929ca82a9a5fa5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:08.981373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9839c4966f3646a692929ca82a9a5fa5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:08.984750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:09.042078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bc4f8730a441fabe8d11fe1c918c1d', 'request_id': 'req-6f5b215d-b0a3-4407-bf41-3972f54436d7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.050443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bc4f8730a441fabe8d11fe1c918c1d', 'request_id': 'req-6f5b215d-b0a3-4407-bf41-3972f54436d7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.063227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bc4f8730a441fabe8d11fe1c918c1d', 'request_id': 'req-6f5b215d-b0a3-4407-bf41-3972f54436d7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.081683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] The token cache is being invalidate because project 30bc4f8730a441fabe8d11fe1c918c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:09.081977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.082078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9839c4966f3646a692929ca82a9a5fa5', 'request_id': 'req-2b775c08-088d-4bf0-9b9c-6976ffc21907'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.082642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6f5b215d-b0a3-4407-bf41-3972f54436d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.084515 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 973/1974] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:08 2022] DELETE /identity/v3/projects/30bc4f8730a441fabe8d11fe1c918c1d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:09.085909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.086199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.086478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.088663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 974/1975] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:09.091076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:09.092796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.098848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9839c4966f3646a692929ca82a9a5fa5', 'request_id': 'req-2b775c08-088d-4bf0-9b9c-6976ffc21907'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.110636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9839c4966f3646a692929ca82a9a5fa5', 'request_id': 'req-2b775c08-088d-4bf0-9b9c-6976ffc21907'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.126741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] The token cache is being invalidate because project 9839c4966f3646a692929ca82a9a5fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:09.127117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.127914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.130175 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1002/1976] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:08 2022] DELETE /identity/v3/projects/9839c4966f3646a692929ca82a9a5fa5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:09.131149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:09.132928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.198504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903ed76-f530-494f-8a26-3f5be0a5c942 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:09.204548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:09.205902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.206733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.207605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] PATH_INFO: `/v3/users/fd5c2e1b9caf430ab8f8fee636b49f9e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.209990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5c2e1b9caf430ab8f8fee636b49f9e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:09.213692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:09.247221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:09.249908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.288661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5c2e1b9caf430ab8f8fee636b49f9e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.309565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5c2e1b9caf430ab8f8fee636b49f9e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.310586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5c2e1b9caf430ab8f8fee636b49f9e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.323223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5c2e1b9caf430ab8f8fee636b49f9e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.333592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5c2e1b9caf430ab8f8fee636b49f9e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.344218 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 975/1977] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:09 2022] DELETE /identity/v3/users/fd5c2e1b9caf430ab8f8fee636b49f9e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:09.346168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:09.347944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.401514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775c08-088d-4bf0-9b9c-6976ffc21907 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:09.460701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce2048-4ad4-435a-95ef-a194707e8bd7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:09.469066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:09.472062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.472759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.473800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] PATH_INFO: `/v3/users/2d3ccd0d46204d9bb52342960888342a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.475975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3ccd0d46204d9bb52342960888342a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:09.479891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:09.490282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:09.491388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.491922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.491922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.494039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:09.497080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab663483-b822-449c-aa66-21342ca775af tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:09.518143 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1003/1978] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:09 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:09.554885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3ccd0d46204d9bb52342960888342a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.579111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3ccd0d46204d9bb52342960888342a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.580333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3ccd0d46204d9bb52342960888342a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.591198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3ccd0d46204d9bb52342960888342a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.602315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3ccd0d46204d9bb52342960888342a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:09.613022 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 976/1979] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:09 2022] DELETE /identity/v3/users/2d3ccd0d46204d9bb52342960888342a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:09.637765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.638207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.638593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.641080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1004/1980] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:09.646952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:09.648568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.763592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:09.764993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:09.855483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106a48-870a-4573-acc0-2c2ce32899cf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:09.861333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:09.862402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:09.862792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:09.863163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:09.864631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:09.868324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3e95-9c4a-4efb-9eee-bcb59d2de230 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:09.870981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 977/1981] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:09 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:10.029497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.030744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.101329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.101554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.101838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.104293 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 978/1982] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:52:10.110210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:10.112086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.114316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95562a7e-36f1-4991-8d05-bb33d089b455 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.119197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.120296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.121294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.121294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] PATH_INFO: `/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.122219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d16a4ecf2834c978f5fa6646ed26a32)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.124407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.132851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.144210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b5070-0f02-4029-9ef3-601e819535df None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.149558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.151543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.151868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.152219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.153504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.155919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2e55a-ca8b-4a0c-8729-2486f582bac8 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.163325 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 979/1983] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:10 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:10.215714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d16a4ecf2834c978f5fa6646ed26a32', 'request_id': 'req-c797bab9-4f03-4007-a300-9d0626869fbc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.224123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d16a4ecf2834c978f5fa6646ed26a32', 'request_id': 'req-c797bab9-4f03-4007-a300-9d0626869fbc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.236815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d16a4ecf2834c978f5fa6646ed26a32', 'request_id': 'req-c797bab9-4f03-4007-a300-9d0626869fbc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.263481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] The token cache is being invalidate because project 5d16a4ecf2834c978f5fa6646ed26a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:10.263862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.264091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.264602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.264691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.264850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c797bab9-4f03-4007-a300-9d0626869fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.267276 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1005/1984] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:10 2022] DELETE /identity/v3/projects/5d16a4ecf2834c978f5fa6646ed26a32 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:10.272610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6b83-fc6f-49dc-93e0-cb1880c0e663 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.273058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6b83-fc6f-49dc-93e0-cb1880c0e663 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.273439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b6b83-fc6f-49dc-93e0-cb1880c0e663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.294414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] MFA Rules not processed for user `cf654deee6974ffa8cacea70192c8a90`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:10.295753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6d1b6b83-fc6f-49dc-93e0-cb1880c0e663 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:10.296289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.297243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6d1b6b83-fc6f-49dc-93e0-cb1880c0e663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.393480 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1006/1985] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:10.401863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.403417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.403657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.428695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 980/1986] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:10.429721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.433497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.439522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:10.440980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.451508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1007/1987] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:10.455619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.472485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a660c01-a03c-45b5-b198-a66af8dd01aa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.477542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeeac1-43e6-42f8-81f9-768f9626dac7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.481320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.483631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.484323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.484717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.485161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.485913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.486329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.486671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] PATH_INFO: `/v3/projects/cca916b334104d67baa72f3b541a0c7b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.487109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:10.487721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.488946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca916b334104d67baa72f3b541a0c7b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.491290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.492247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.527453 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1008/1988] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:10.531698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.543889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a1a5-b4b0-4cb7-805f-2ed1c9a12287 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.558709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca916b334104d67baa72f3b541a0c7b', 'request_id': 'req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.571126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca916b334104d67baa72f3b541a0c7b', 'request_id': 'req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.577419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca916b334104d67baa72f3b541a0c7b', 'request_id': 'req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.593399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] The token cache is being invalidate because project cca916b334104d67baa72f3b541a0c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:10.593742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.594547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc3ee0d6-32eb-471d-b7a1-b97977f5d319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:10.599731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 981/1989] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:10 2022] DELETE /identity/v3/projects/cca916b334104d67baa72f3b541a0c7b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:10.601725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d56d0-e3f2-455d-a875-1c56faa4b34a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.602010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d56d0-e3f2-455d-a875-1c56faa4b34a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.602297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d56d0-e3f2-455d-a875-1c56faa4b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.624844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-145d56d0-e3f2-455d-a875-1c56faa4b34a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:10.626050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.626828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.627190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.627545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.627821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-145d56d0-e3f2-455d-a875-1c56faa4b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.628369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.630507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.642953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 982/1990] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:10.648228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.648660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.649001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.678507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:10.680615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.683159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1009/1991] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:52:10.688428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.693408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:10.769363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 983/1992] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:10.781406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.789834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed853a8-3461-4b4d-a79e-6b69aa66f1a8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.794366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a243-48b4-45a6-bf49-3ff6294ec25c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.796112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.796939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.797366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.797811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.798801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.801406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.803680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.804727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.805146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.805492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.806830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:10.807221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.810232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.830420 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 984/1993] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:10.831485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.833016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1010/1994] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:10.840582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.842410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284512-b9ee-47c1-aac4-973079ecf3db admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.848748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.849578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.849703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.849974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.850907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.852436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cb6a-93d9-4cea-84b2-8dc1872c0382 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.853285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.858492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.859267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.859627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.859977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.860976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.862681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.874759 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1011/1995] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:10.878291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.891766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f85ee3-7125-45ae-b23a-ef1838a88f2b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.901223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 985/1996] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:10.902832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.903754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:10.904728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:10.905026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:10.905493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:10.906390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:10.908070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:10.921667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1012/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:10.925408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:10.937718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212510-9d3e-4bb5-b16e-5641838e6b59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:10.992376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a55eb6-793e-4e02-800e-a9cef370e0f1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.017305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.018669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.019210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.019638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] PATH_INFO: `/v3/projects/0b334c3fec504bfd9e51005cb348310f/users/10ec6d72d6d041d8b13de8285235674d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.020087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.020941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.021327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.021706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.022753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.025111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0b73-fed0-40ae-b043-cc3a208afe61 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.040016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b334c3fec504bfd9e51005cb348310f, user_id=10ec6d72d6d041d8b13de8285235674d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.043698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.052844 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 986/1998] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:10 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:11.054724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271058f-9050-4667-9de0-2f79099e6dd6 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.055019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271058f-9050-4667-9de0-2f79099e6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.055303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271058f-9050-4667-9de0-2f79099e6dd6 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.058612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 987/1999] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:11.059052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271058f-9050-4667-9de0-2f79099e6dd6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.072553 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1013/2000] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:10 2022] PUT /identity/v3/projects/0b334c3fec504bfd9e51005cb348310f/users/10ec6d72d6d041d8b13de8285235674d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:11.074999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:11.079946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.163377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.164795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.175764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271058f-9050-4667-9de0-2f79099e6dd6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.181318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.182519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.182808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.183095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.183832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.185482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6a2a-6f91-407d-8007-d2572c2a9435 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.196084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 988/2001] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:11.196084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.196084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.196084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.234253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] MFA Rules not processed for user `10ec6d72d6d041d8b13de8285235674d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:11.235470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.247212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b8f15-e9dd-49a9-ab7d-b14b2f0bcfb9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.252768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e98117602f5479e83d46f8114ef0c18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87adb6fa7637407eb49196fdf2eaad73', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.253658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.253944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.254222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.255452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.257592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.263334 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1014/2002] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:11 2022] GET /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 383 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:11.266415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.283097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97753cbd-0ed1-4e70-bc7d-104e88fe2da3 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.291604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.293750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.294058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.294459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.295311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.297808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.311861 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1015/2003] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:11.316502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.319630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 989/2004] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:11.325894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.329088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f6ecb-3775-42a8-8c24-2e0d32d7cb10 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.340944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.342234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.342664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.343516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] PATH_INFO: `/v3/projects/6171ea999c7c40809bd2fbf1ee0bae27/users/76911712017c4cf9a027988418f39970/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.346168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6090-ba9a-4508-b436-af3d0442b3ba None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.360414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.361297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.361686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.362876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.363967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.367244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b1e5-8254-4577-a8c2-4f7ae1efc774 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.372973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6171ea999c7c40809bd2fbf1ee0bae27, user_id=76911712017c4cf9a027988418f39970, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.380915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.401501 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1016/2005] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:11 2022] PUT /identity/v3/projects/6171ea999c7c40809bd2fbf1ee0bae27/users/76911712017c4cf9a027988418f39970/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:11.402380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.411600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 990/2006] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:11.415511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.418191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.418858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.419407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.464372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] MFA Rules not processed for user `76911712017c4cf9a027988418f39970`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:11.467962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.492078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8795c-d644-4c5a-977e-79272a702c2c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.560890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 991/2007] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:11.560890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.593565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.594544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.594901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.595247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] PATH_INFO: `/v3/users/cf654deee6974ffa8cacea70192c8a90` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.597664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf654deee6974ffa8cacea70192c8a90)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.598720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.645261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d11bf-bdbb-4e1c-afaf-6f6fa443f660 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.651163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.652005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.652438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.652753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.653451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.655376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.655517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf654deee6974ffa8cacea70192c8a90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:11.663992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf654deee6974ffa8cacea70192c8a90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:11.665117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf654deee6974ffa8cacea70192c8a90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:11.667302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf654deee6974ffa8cacea70192c8a90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:11.675220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf654deee6974ffa8cacea70192c8a90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:11.680888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 992/2008] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:11.680888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.680888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.695475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa06c7-d424-4f46-bd20-17df0802b419 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.705317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.706443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.706935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.707391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.707790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1017/2009] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:11 2022] DELETE /identity/v3/users/cf654deee6974ffa8cacea70192c8a90 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:11.708738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.709250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.710507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.712144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dcbbc-515f-4fc5-ac7c-a1c246b0eee6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.752123 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 993/2010] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:11.753606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.753904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.754378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.775911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:11.777382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.795223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c5e-5f9f-48f1-a8d5-9302a609b90e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.864236 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 994/2011] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:11.865808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.883857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81f6ed-6924-4bf3-a7a4-c92e4beacbcb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.885011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.885817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.888578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.888578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.888578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.889335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.899018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.900849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.901500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.901980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:11.903371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:11.908707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:11.913636 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1018/2012] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:11.913636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.917573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:11.969474 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 995/2013] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:11 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:11.970533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:11.989152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38300a-929c-4ea6-ab51-75b74a42d248 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:11.994919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:11.996005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:11.996295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:11.996607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] PATH_INFO: `/v3/projects/b9bebc59831444768cbbd198adead85d/users/1ad352757da94f34aae62fd59921d4e9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.034201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bebc59831444768cbbd198adead85d, user_id=1ad352757da94f34aae62fd59921d4e9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.041261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.052213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79941b-9eb2-4eb5-98e2-e117d95a50a0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.071542 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 996/2014] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:11 2022] PUT /identity/v3/projects/b9bebc59831444768cbbd198adead85d/users/1ad352757da94f34aae62fd59921d4e9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:12.073540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.138287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.139034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.139483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.140143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.170089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501666-114c-4172-bce0-da5abf42af4c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.176818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.178153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.178809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.179272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.182176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.184045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.203412 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 997/2015] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:12.205365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.217567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.218689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9777b1-a226-4df5-9bd8-a2e7804f5c34 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.219366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.224401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.226043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.226546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.227295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.228317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.231918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.242493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1019/2016] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:12.243501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.244275 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 998/2017] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:12.248205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.262463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbc70d-e71b-437a-bdba-8547de573b86 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.269819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.270816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd29bb-2d4f-49d5-9249-aa909725fbad service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.271136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.271521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.272224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] PATH_INFO: `/v3/projects/b9bebc59831444768cbbd198adead85d/users/1ad352757da94f34aae62fd59921d4e9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.274359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bebc59831444768cbbd198adead85d, user_id=1ad352757da94f34aae62fd59921d4e9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.277672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.278320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384b78c-9b18-4157-8932-035db4e951ea admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.278946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.279229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.279512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] PATH_INFO: `/v3/projects/3b221652690d48439f5cfd605c190c09/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.303090 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 999/2018] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:12 2022] PUT /identity/v3/projects/b9bebc59831444768cbbd198adead85d/users/1ad352757da94f34aae62fd59921d4e9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:12.303459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b221652690d48439f5cfd605c190c09, user_id=c6966eb0d5334c0aaa8cb1ddc36bb5dd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.303459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.305567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.306954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.306954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.322995 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1020/2019] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:12 2022] PUT /identity/v3/projects/3b221652690d48439f5cfd605c190c09/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:12.327668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.349042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] MFA Rules not processed for user `1ad352757da94f34aae62fd59921d4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:12.350542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:12.420657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e43b-5e62-43a7-9695-05542ff7c3b3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.425972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.426614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.426901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.427175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.428073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.430913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.448332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1000/2020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:12.449594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.463951 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1021/2021] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:12.468419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.468568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eff0c-5d09-4b89-873b-c964e897258a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.473788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.474648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.474941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.475224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.475952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:12.476267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.478139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.479955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde6f3-9bfe-4b03-a16e-e03d5ee82989 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.490083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1001/2022] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:12.492485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.493854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.494778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.495281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.495662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] PATH_INFO: `/v3/projects/3b221652690d48439f5cfd605c190c09/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.499047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b221652690d48439f5cfd605c190c09, user_id=c6966eb0d5334c0aaa8cb1ddc36bb5dd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.504312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0bf91-ff54-44b8-b16b-3b72bf5431a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.506515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005feed-9d3b-4b22-96c1-d0ac92905e50 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.512252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.513204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.513638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.514205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.515065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.517417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.528904 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1022/2023] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:12 2022] PUT /identity/v3/projects/3b221652690d48439f5cfd605c190c09/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:12.531388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.531775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.532166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.566442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1002/2024] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:12 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:52:12.570689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.574517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] MFA Rules not processed for user `c6966eb0d5334c0aaa8cb1ddc36bb5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:12.577849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:12.708786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a85e7-1bd6-46bd-a40a-c9555296df2c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.718178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.719750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.720343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.721360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.722337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:12.722803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.725016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.742314 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1023/2025] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:12.748481 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1003/2026] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:12.793372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.794801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:12.881263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:12.883176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:12.906026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133b47-2cdf-4363-b382-dfaec94d5bbe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.911677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:12.916677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:12.917149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:12.917456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] PATH_INFO: `/v3/projects/d4e4c08f91e24bedb51356cd9e640749` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:12.919326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e4c08f91e24bedb51356cd9e640749)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:12.921390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:12.974858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb37f-43c8-45b6-b9e8-6052b33b8873 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:12.978959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e4c08f91e24bedb51356cd9e640749', 'request_id': 'req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:12.985824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e4c08f91e24bedb51356cd9e640749', 'request_id': 'req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:12.994544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e4c08f91e24bedb51356cd9e640749', 'request_id': 'req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.006208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] The token cache is being invalidate because project d4e4c08f91e24bedb51356cd9e640749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:13.006647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.007411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.009188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1024/2027] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:12 2022] DELETE /identity/v3/projects/d4e4c08f91e24bedb51356cd9e640749 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:13.013725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:13.015232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.045447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.046130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.046453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.046874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.048984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.087030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057a7d1-0ea0-4cf5-9e96-c0aa0dc2774d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:13.094980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.096042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.096613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.096873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] PATH_INFO: `/v3/users/1e98117602f5479e83d46f8114ef0c18` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.107782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e98117602f5479e83d46f8114ef0c18)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.107782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.123637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.125386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.136417 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1004/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:13.137341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:13.139061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.153932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda103-9440-4fdd-9a08-8381a632dab0 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:13.160722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.161814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.162133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.162540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.164992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.166165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e98117602f5479e83d46f8114ef0c18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.177489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e98117602f5479e83d46f8114ef0c18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.178246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e98117602f5479e83d46f8114ef0c18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.178865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e98117602f5479e83d46f8114ef0c18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.190479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9005aa51-0660-435b-8ca0-8df553d0d937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e98117602f5479e83d46f8114ef0c18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.231792 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1025/2029] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:13 2022] DELETE /identity/v3/users/1e98117602f5479e83d46f8114ef0c18 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:13.252504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.254187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.279771 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1005/2030] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:13.286829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c7bd-35bd-471f-b76f-8312a7bc4508 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.287551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c7bd-35bd-471f-b76f-8312a7bc4508 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.288397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3c7bd-35bd-471f-b76f-8312a7bc4508 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.291185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1026/2031] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:13.299029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:13.323643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:13.339473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8558b1-60af-4ebe-afc9-fbe9b73c9236 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:13.451578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.453323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.453761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.454211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects/8adb188035954ff490370ac2cea6b9e2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.455571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:get_project(project_id=8adb188035954ff490370ac2cea6b9e2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.459556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.464156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1006/2032] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:13 2022] GET /identity/v3/projects/8adb188035954ff490370ac2cea6b9e2 => generated 369 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:13.713392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.713682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.713960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.719262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:13.720146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1027/2033] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:52:13.721836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.727781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:13.730903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.826861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dd20f-edfd-48c1-8171-20fab713f4a0 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:13.831605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.832675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.832960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.833235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] PATH_INFO: `/v3/projects/87adb6fa7637407eb49196fdf2eaad73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.834501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=87adb6fa7637407eb49196fdf2eaad73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.836694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.861721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:13.862663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.876465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e40854-37f7-4866-9084-b32d164851e9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:13.893291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87adb6fa7637407eb49196fdf2eaad73', 'request_id': 'req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.899984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87adb6fa7637407eb49196fdf2eaad73', 'request_id': 'req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.909302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87adb6fa7637407eb49196fdf2eaad73', 'request_id': 'req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.927650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] The token cache is being invalidate because project 87adb6fa7637407eb49196fdf2eaad73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:13.928016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.928743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-134dbd24-7e2c-49c0-baa0-1d2c78bad1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:13.930423 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1007/2034] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:13 2022] DELETE /identity/v3/projects/87adb6fa7637407eb49196fdf2eaad73 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:13.936871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d21a8-5038-4949-bc1a-8af5bd0963a9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.937354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d21a8-5038-4949-bc1a-8af5bd0963a9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.937806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d21a8-5038-4949-bc1a-8af5bd0963a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.944126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:13.945029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:13.945476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:13.945765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects/8adb188035954ff490370ac2cea6b9e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:13.948248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:get_project(project_id=8adb188035954ff490370ac2cea6b9e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:13.950346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:13.952384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1028/2035] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:13 2022] GET /identity/v3/projects/8adb188035954ff490370ac2cea6b9e2 => generated 369 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:13.961767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-646d21a8-5038-4949-bc1a-8af5bd0963a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:13.963635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-646d21a8-5038-4949-bc1a-8af5bd0963a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:13.998062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.002045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.026420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206a1a9-0f65-41c7-9ea7-c45acb45a28d tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.031421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.032249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.032585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.032865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.033936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:14.034250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.037647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.056080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1029/2036] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:14.060018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.067678 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1008/2037] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:14.071204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.071506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.072484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.075823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12088206-ddff-48b1-b8ff-2e9ad559d496 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.084808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.086394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.089220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.091065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.092001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.094239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.122783 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1030/2038] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/users => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:14.127859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.136392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:14.137990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.145210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc286820-aff3-44a8-adfc-d16b39f46922 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.151537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1009/2039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:14.152545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.153827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.154771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.155355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.155786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.156829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:14.157318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.160162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.161844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a7888-6764-4867-94d0-9b8c058ba52e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.168888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.169734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.170018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.170294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.171014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:14.171320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.173271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.180669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1031/2040] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:14.187311 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1010/2041] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:14.191914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.204361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70bf4c-1ec8-4924-a582-e21b1d918813 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.211733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.211733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.211733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.211733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.212165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.214275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.255118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.266102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1032/2042] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:14.268210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0cbc-cd03-4402-8904-5160602690a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.336800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.337547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.337836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.338116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.338893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.341344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84719bc-dfe9-4757-9589-9d7c7009ba10 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.372643 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1011/2043] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:14.373817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.391996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63229b8b-c70b-4fb1-889f-aad1b60b03f9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.394240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.394541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.394823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.397198 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1012/2044] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:52:14.401946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.403267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:14.403728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.404355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.405163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.405913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.407146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.409999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.427850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1033/2045] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:14.429399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.449084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787a1e-4855-4f77-99c8-85f28733c413 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.462276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.463180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.463573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.464407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.465266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.469740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.489989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1034/2046] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:14.490885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.503879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0550-a72f-4138-ba37-bb1ebf1c315d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.513402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.514463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.514850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.515214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] PATH_INFO: `/v3/projects/c7076023af114f8399ce254557d49a92/users/d7a5f6aa796a441d93c21a80b4ff11d8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.530800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7076023af114f8399ce254557d49a92, user_id=d7a5f6aa796a441d93c21a80b4ff11d8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.533969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.534826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.550668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1035/2047] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:14 2022] PUT /identity/v3/projects/c7076023af114f8399ce254557d49a92/users/d7a5f6aa796a441d93c21a80b4ff11d8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:14.551493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.553235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.605786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2332143-3c56-4ad7-a18f-b31f2a0960c0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.616876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc190b-2ebb-436a-90d9-e360560f2d80 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.621952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.622890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.623243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.623520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] PATH_INFO: `/v3/users/76911712017c4cf9a027988418f39970` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.624817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76911712017c4cf9a027988418f39970)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.626711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.661629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.662501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.662789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.663073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects/8adb188035954ff490370ac2cea6b9e2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.664265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:get_project(project_id=8adb188035954ff490370ac2cea6b9e2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.666382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75dd34-f1a9-4e61-89f8-c18132e277c1 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.668107 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1013/2048] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/projects/8adb188035954ff490370ac2cea6b9e2 => generated 369 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:14.669303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.669592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.669934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.675040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76911712017c4cf9a027988418f39970'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:14.683596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76911712017c4cf9a027988418f39970'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:14.684653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76911712017c4cf9a027988418f39970'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:14.685289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76911712017c4cf9a027988418f39970'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:14.693231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab85ffff-f448-4e0b-acdd-5b6d340c6e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76911712017c4cf9a027988418f39970'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:14.706618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] MFA Rules not processed for user `d7a5f6aa796a441d93c21a80b4ff11d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:14.707773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.724547 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1036/2049] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:14 2022] DELETE /identity/v3/users/76911712017c4cf9a027988418f39970 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:14.727152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f27-489d-4726-8a22-db99dd1df230 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.727701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f27-489d-4726-8a22-db99dd1df230 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.728876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13f27-489d-4726-8a22-db99dd1df230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.751802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e1d13f27-489d-4726-8a22-db99dd1df230 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:14.752994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e1d13f27-489d-4726-8a22-db99dd1df230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.794750 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1014/2050] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:14.801478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.803134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.824472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eafbf-9315-4363-8df7-f104d6c6919b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.829348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1037/2051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:14.830691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.830984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.831263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.833594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1038/2052] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:14.838479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.839512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:52:14.840133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.840969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.841469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:14.842259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.843968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:14.846102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:14.876664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1015/2053] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:14 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:14.877516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.880738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.940693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:14.942507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:14.960798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03198930-0bde-4c03-810b-99ebb5c26501 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:14.967007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:14.971028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:14.971522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:14.971656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.022792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72edb-7f44-43ef-808c-13508d5d055a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.059312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.061996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.080906 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1016/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:15.082896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.091775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.092731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.093017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.093293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects/8adb188035954ff490370ac2cea6b9e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.094960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:get_project(project_id=8adb188035954ff490370ac2cea6b9e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.104046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaddb51-f589-4559-8fb0-de2d377c46f9 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.104802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.111164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.111982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.112277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.112991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.113643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.115977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.122777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1039/2055] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:52:14 2022] GET /identity/v3/projects/8adb188035954ff490370ac2cea6b9e2 => generated 369 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:15.144363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.155165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16777-302b-4f69-8f9a-6ea1da4c995c tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.163340 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1017/2056] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:15 2022] POST /identity/v3/users => generated 301 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:15.165056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.168393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.168985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.169268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.169546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/users/54fd082c6add472abcda7348d1b26b19` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.193049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c32b7-2c86-443b-933a-3baf9aa2022b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.205880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:delete_user(user_id=54fd082c6add472abcda7348d1b26b19)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.207810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.209982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.210975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.211871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.212471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.214117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.216272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.236209 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1018/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:15.238136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.254064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4b288-1327-4f42-bcf6-ee20c2527f6d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.262061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.264090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.264595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.265261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] PATH_INFO: `/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33/users/810a5e7f4cbe461bafec0e48bbdaf6b9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.284366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fd082c6add472abcda7348d1b26b19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.299763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fd082c6add472abcda7348d1b26b19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.301866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fd082c6add472abcda7348d1b26b19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.302807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fd082c6add472abcda7348d1b26b19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.314975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed7f8ebd83c4423a9c268bcac9e2e33, user_id=810a5e7f4cbe461bafec0e48bbdaf6b9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.318934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.322959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fd082c6add472abcda7348d1b26b19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.349433 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1019/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:15 2022] PUT /identity/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33/users/810a5e7f4cbe461bafec0e48bbdaf6b9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:15.350950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.369583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.373966 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1040/2059] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:15 2022] DELETE /identity/v3/users/54fd082c6add472abcda7348d1b26b19 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:15.374865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.381090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.480530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc447-e8ea-462a-991d-a204953cf761 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.534446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcb8e9-52c4-4b77-9b2d-e29fbd8b3773 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.541496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad352757da94f34aae62fd59921d4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9bebc59831444768cbbd198adead85d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.542556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.542852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.543130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] PATH_INFO: `/v3/projects/8adb188035954ff490370ac2cea6b9e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.544582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8adb188035954ff490370ac2cea6b9e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.549609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.566992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.568847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.569275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.569697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.570621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.572529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.592745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1020/2060] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:15.592745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.594772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.611654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186abc8a-a17a-4282-b3c2-76f5fc415d7a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.619372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adb188035954ff490370ac2cea6b9e2', 'request_id': 'req-dc23a9e3-d74c-43b9-ab02-97beef6a2035'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.625974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adb188035954ff490370ac2cea6b9e2', 'request_id': 'req-dc23a9e3-d74c-43b9-ab02-97beef6a2035'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.642519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adb188035954ff490370ac2cea6b9e2', 'request_id': 'req-dc23a9e3-d74c-43b9-ab02-97beef6a2035'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.653322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] The token cache is being invalidate because project 8adb188035954ff490370ac2cea6b9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:15.653615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.654280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.655859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1041/2061] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:15 2022] DELETE /identity/v3/projects/8adb188035954ff490370ac2cea6b9e2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:15.656635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.657965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.681883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.682764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.683049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.683326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] PATH_INFO: `/v3/projects/6171ea999c7c40809bd2fbf1ee0bae27` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.684551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6171ea999c7c40809bd2fbf1ee0bae27)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.686530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.733137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23a9e3-d74c-43b9-ab02-97beef6a2035 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.740088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6171ea999c7c40809bd2fbf1ee0bae27', 'request_id': 'req-20eb522f-5ea9-4914-8909-ff9b191259d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.747144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6171ea999c7c40809bd2fbf1ee0bae27', 'request_id': 'req-20eb522f-5ea9-4914-8909-ff9b191259d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.753251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6171ea999c7c40809bd2fbf1ee0bae27', 'request_id': 'req-20eb522f-5ea9-4914-8909-ff9b191259d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.766350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] The token cache is being invalidate because project 6171ea999c7c40809bd2fbf1ee0bae27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:15.766644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.767315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.768984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1021/2062] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:15 2022] DELETE /identity/v3/projects/6171ea999c7c40809bd2fbf1ee0bae27 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:15.769760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.771094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.800642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.801813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.802112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.802470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] PATH_INFO: `/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33/users/810a5e7f4cbe461bafec0e48bbdaf6b9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.812378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed7f8ebd83c4423a9c268bcac9e2e33, user_id=810a5e7f4cbe461bafec0e48bbdaf6b9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.815215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.826807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1042/2063] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:15 2022] PUT /identity/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33/users/810a5e7f4cbe461bafec0e48bbdaf6b9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:15.833454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:15.838262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:15.840948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb522f-5ea9-4914-8909-ff9b191259d2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.906842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089b97-5b8e-4834-87e8-1301720cc3cd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:15.911982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.912908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.913195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.913474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] PATH_INFO: `/v3/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.915011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6966eb0d5334c0aaa8cb1ddc36bb5dd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.916965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:15.917668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.917835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:15.918117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:15.918426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] PATH_INFO: `/v3/users/10ec6d72d6d041d8b13de8285235674d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:15.920047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ec6d72d6d041d8b13de8285235674d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:15.922682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:15.976555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6966eb0d5334c0aaa8cb1ddc36bb5dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.977745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ec6d72d6d041d8b13de8285235674d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.988340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6966eb0d5334c0aaa8cb1ddc36bb5dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.989039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6966eb0d5334c0aaa8cb1ddc36bb5dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.989670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6966eb0d5334c0aaa8cb1ddc36bb5dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.993157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ec6d72d6d041d8b13de8285235674d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.993991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ec6d72d6d041d8b13de8285235674d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:15.997765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d37c9c-2b99-410c-b3ef-571f0309bf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6966eb0d5334c0aaa8cb1ddc36bb5dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.003087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ec6d72d6d041d8b13de8285235674d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.010644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea899316-66e2-41d1-b265-d2801db9c562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ec6d72d6d041d8b13de8285235674d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.016536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1022/2064] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:15 2022] DELETE /identity/v3/users/10ec6d72d6d041d8b13de8285235674d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:16.017906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.018196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.018466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.021099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1043/2065] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:15 2022] DELETE /identity/v3/users/c6966eb0d5334c0aaa8cb1ddc36bb5dd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:16.022243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.022534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.022818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.055614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] MFA Rules not processed for user `810a5e7f4cbe461bafec0e48bbdaf6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:16.056838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:16.058122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.059111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.145577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1023/2066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:16.153160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.153279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1044/2067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:16.154258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.155017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.155862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.254448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b6ad7-0e9a-492e-b176-fb443f704e63 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.265036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.265954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.266515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.266891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.280951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.282213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.286148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5050ca3-fdc7-4c82-825c-4f4060ef8b10 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.297251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.297985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.298300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.299291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.300006 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1045/2068] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:16.323523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.389289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.390943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.415345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544f8dd-e407-417d-9f53-881400ca3918 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.425132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.426645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a29542-0ecd-4564-9251-37b9f55754f4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.438920 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1024/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:16.440160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.441152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.442542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.442917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] PATH_INFO: `/v3/projects/3b221652690d48439f5cfd605c190c09` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.444396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b221652690d48439f5cfd605c190c09)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.446581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.549687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b221652690d48439f5cfd605c190c09', 'request_id': 'req-a6331aa0-f78d-4689-a167-297e7f728f77'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.569889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b221652690d48439f5cfd605c190c09', 'request_id': 'req-a6331aa0-f78d-4689-a167-297e7f728f77'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.586782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b221652690d48439f5cfd605c190c09', 'request_id': 'req-a6331aa0-f78d-4689-a167-297e7f728f77'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.607410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] The token cache is being invalidate because project 3b221652690d48439f5cfd605c190c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:16.607707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.613691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a6331aa0-f78d-4689-a167-297e7f728f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.620282 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1046/2070] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:16 2022] DELETE /identity/v3/projects/3b221652690d48439f5cfd605c190c09 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:16.622272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.623494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.623947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.660029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:16.661902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.754632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1025/2071] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:16.762683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.764010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.764363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.784959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:16.786331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.801256 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1047/2072] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:16.805283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.818815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0bec-c0c4-41b1-bdcf-abe54e131599 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.825930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.827497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.828613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.829271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.830248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:16.830713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.832513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.843733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.845293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:16.850234 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1026/2073] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:16.854970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.862488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be09c5-fdf6-46f7-885f-afc35b40c0b4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.867692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e9c4f-8054-4b9f-b0b2-0e2fd6c018b6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:16.868127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.869724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.870108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.870456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] PATH_INFO: `/v3/projects/0b334c3fec504bfd9e51005cb348310f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.871841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b334c3fec504bfd9e51005cb348310f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.874129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.876287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:16.877714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:16.877893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:16.878173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:16.879266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:16.881756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:16.958348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b334c3fec504bfd9e51005cb348310f', 'request_id': 'req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.965896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b334c3fec504bfd9e51005cb348310f', 'request_id': 'req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.971910 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1027/2074] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:16.977462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:16.978898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b334c3fec504bfd9e51005cb348310f', 'request_id': 'req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.993302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] The token cache is being invalidate because project 0b334c3fec504bfd9e51005cb348310f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:16.994344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:16.995120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.004880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1048/2075] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:16 2022] DELETE /identity/v3/projects/0b334c3fec504bfd9e51005cb348310f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:17.006089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.008277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.062242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f28e9-6487-4788-8e8b-021c15275f99 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.068796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.069477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.069760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.070038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.070724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.074064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.094312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e838cc-1f2b-47d1-b7dd-d827bda6dc38 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.106089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1028/2076] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:16 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:17.107304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.108644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.109642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.110677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.110983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.111339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] PATH_INFO: `/v3/users/1ad352757da94f34aae62fd59921d4e9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.114350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad352757da94f34aae62fd59921d4e9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.118658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.128006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8e93b-b5a6-439c-ba5f-67bed6944353 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.136778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.138463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.138929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.145303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.147002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.149359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.165631 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1029/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:17.167949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.182123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb99f-4a88-45d5-9b2f-bfba79be00dc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.188610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.189282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.189568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.189849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.190625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.192508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.199906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad352757da94f34aae62fd59921d4e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.208524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1030/2078] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:17.211649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.217938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad352757da94f34aae62fd59921d4e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.218910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad352757da94f34aae62fd59921d4e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.220026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad352757da94f34aae62fd59921d4e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.223827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384f1-6cc0-44d8-b162-e3afeda30c8b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.229009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.229897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.230181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.232026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad352757da94f34aae62fd59921d4e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.232660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] PATH_INFO: `/v3/projects/1e586602a4da4d659974e36ab71486a7/users/a2e061bb9a054fb1945417baf444eaee/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.259055 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1049/2079] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:17 2022] DELETE /identity/v3/users/1ad352757da94f34aae62fd59921d4e9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:17.267678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e586602a4da4d659974e36ab71486a7, user_id=a2e061bb9a054fb1945417baf444eaee, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.270803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a145405-1df2-4570-a43e-a8c05d407854 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.287320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.288768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.301528 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1031/2080] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:17 2022] PUT /identity/v3/projects/1e586602a4da4d659974e36ab71486a7/users/a2e061bb9a054fb1945417baf444eaee/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:17.307872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.308922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.309336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.336374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:17.337917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.387191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3a8b6-3465-4b8f-b6a8-934a8430283a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.435421 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1032/2081] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:17.461705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.464222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.504258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.504829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.505127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.505477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.507781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.583834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ca198-43cb-48ec-9e01-32d0aff85070 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.590112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.591934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.592800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.593229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.603803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.605023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.605870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5e943-3360-4eae-9ab5-e6a21a45fa54 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.606750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.620921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1033/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:17.632888 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1050/2083] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:17.655178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.656761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.677226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693febe8-b597-41d0-b9b0-12a93e37df09 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.689395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.690425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.690783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.691434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] PATH_INFO: `/v3/projects/b9bebc59831444768cbbd198adead85d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.693314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bebc59831444768cbbd198adead85d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.697642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.751804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bebc59831444768cbbd198adead85d', 'request_id': 'req-77329710-5c7f-4a10-b6ef-d03795c25c73'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.760215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bebc59831444768cbbd198adead85d', 'request_id': 'req-77329710-5c7f-4a10-b6ef-d03795c25c73'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.770825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bebc59831444768cbbd198adead85d', 'request_id': 'req-77329710-5c7f-4a10-b6ef-d03795c25c73'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.798674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] The token cache is being invalidate because project b9bebc59831444768cbbd198adead85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:17.799064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.799837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:17.802196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1034/2084] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:17 2022] DELETE /identity/v3/projects/b9bebc59831444768cbbd198adead85d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:17.809129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9787-aeb2-486a-b97e-dcfbccfc3d5e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.809418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9787-aeb2-486a-b97e-dcfbccfc3d5e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.809700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9787-aeb2-486a-b97e-dcfbccfc3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.823492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:17.827595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.828390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4ebb9787-aeb2-486a-b97e-dcfbccfc3d5e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:17.829795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ebb9787-aeb2-486a-b97e-dcfbccfc3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:17.925512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1051/2085] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:17.934350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.934636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.934927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.937383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77329710-5c7f-4a10-b6ef-d03795c25c73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:17.943905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:17.944901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:17.945238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:17.945591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] PATH_INFO: `/v3/users/f3407b4401294ecb8b01a81ef19dd474` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:17.946948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3407b4401294ecb8b01a81ef19dd474)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:17.948963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:17.982450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:17.984009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:18.003018 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1052/2086] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:18.007112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.014051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3407b4401294ecb8b01a81ef19dd474'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:18.020816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec9ab6-b559-4add-92ca-c0cfdd22c707 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.029152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.030035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.030407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.030763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.031880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:18.032210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.033900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.046400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3407b4401294ecb8b01a81ef19dd474'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:18.047541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3407b4401294ecb8b01a81ef19dd474'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:18.051122 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1053/2087] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:18.055855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.058572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:18.061436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3407b4401294ecb8b01a81ef19dd474'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:18.072655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72dbacbb-a8a2-47fb-8bf3-3f0c73c047f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3407b4401294ecb8b01a81ef19dd474'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:18.076651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79092-33b7-4ac4-9ca6-5fdea0aa3769 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.085071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1035/2088] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:17 2022] DELETE /identity/v3/users/f3407b4401294ecb8b01a81ef19dd474 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:18.085238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.085336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.085672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.086037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.087034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.089930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.090376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.090836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.091426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.126552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1054/2089] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:18.126928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:18.126928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:18.128806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.211053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb7cdf-7278-45e5-94d8-1163f9ac22fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.220744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.223799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.224090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.234694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.236255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.239143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.248777 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1036/2090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:18.267028 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1055/2091] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:18.271443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.283338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.284104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559ebb1-7048-41b2-8b59-e0bfcf341409 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.291417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.292568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.293067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.293508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.294411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.297505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.301726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:18.322758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1037/2092] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:18.324791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.343915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993604aa-224f-42e7-96c9-033a50cd908d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.358902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.359578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.359864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.360141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.360895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.363892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.386299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1038/2093] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:18.390474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.411792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f100c-d1d6-4813-952e-73388291e3c1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.425012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c267b4-eaa5-4dd2-bbea-0a80c83c52c0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.428531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.429386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.429671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.429949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] PATH_INFO: `/v3/projects/6641567a5d6d4eddb03a728991b989ba/users/7a5c2863efed4b87b8919e1a6ffc1d10/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.435245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.435919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.436203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.436500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.467931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.470044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e45c-3033-4a67-a301-654cc68b27cf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.474106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6641567a5d6d4eddb03a728991b989ba, user_id=7a5c2863efed4b87b8919e1a6ffc1d10, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.477100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.512547 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1056/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:18.514647 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1039/2095] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:18 2022] PUT /identity/v3/projects/6641567a5d6d4eddb03a728991b989ba/users/7a5c2863efed4b87b8919e1a6ffc1d10/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:18.531961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.532268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.532557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.583675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] MFA Rules not processed for user `7a5c2863efed4b87b8919e1a6ffc1d10`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:18.585904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:18.696172 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1057/2096] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:18.701735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.785076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09f288-203a-4d5d-a997-1c5ab38dcfa5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.792773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:18.793483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.794312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.794312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.794981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:18.797807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e9d05-745a-4b15-bb6b-37a6f02fd153 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:18.841451 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1040/2097] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:52:18.842546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:18.870908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc2425-2ef8-4a91-950e-15714c8d57d1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:18.886417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:18.886754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:18.886983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:18.942433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] MFA Rules not processed for user `a2e061bb9a054fb1945417baf444eaee`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:18.944659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.008410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.009990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.011014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.011014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.012083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.019281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.052650 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1058/2098] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:19.061899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.065879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.085354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002e7f4-852a-4f94-a37d-1f5babd708d9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.091182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.092422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.092864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.093357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] PATH_INFO: `/v3/users/d6343df3331040deaa106799798d583c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.103645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6343df3331040deaa106799798d583c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.107041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.115693 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1041/2099] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:19.116730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.159163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142fd6e-b1ea-48f9-a961-cd242ed97529 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.165101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.166320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.166609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.166948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.168106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.170430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.183425 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1042/2100] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:19.186642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.190386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.213034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6343df3331040deaa106799798d583c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.213655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdeff2-8f70-4e45-a6a4-ef36ba4aca93 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.230703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6343df3331040deaa106799798d583c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.231799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6343df3331040deaa106799798d583c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.232647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6343df3331040deaa106799798d583c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.235383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.236123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.236399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.236709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.237407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.241216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.262461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6343df3331040deaa106799798d583c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.325226 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1059/2101] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:19 2022] DELETE /identity/v3/users/d6343df3331040deaa106799798d583c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:19.326642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.328766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.334418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1043/2102] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:19 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:19.335490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.343976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.426974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860a879-5b88-4d57-ab69-b005f93f45a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.442005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9353c-3df5-42a3-bd82-8566e03aa32f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.449326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.450538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.450973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.451350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] PATH_INFO: `/v3/projects/77f55ac7e48c4634ba63ef1bec31a1de` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.453151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f55ac7e48c4634ba63ef1bec31a1de)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.457349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.512015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.513159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.513831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.514128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] PATH_INFO: `/v3/projects/222fbfe211d84bd98883124a710e98ff/users/9a09228a8bc440b4aab7f33478d1227c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.518951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f55ac7e48c4634ba63ef1bec31a1de', 'request_id': 'req-9e3a339e-6794-478f-b8a8-a070eb361d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.527569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f55ac7e48c4634ba63ef1bec31a1de', 'request_id': 'req-9e3a339e-6794-478f-b8a8-a070eb361d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.535003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222fbfe211d84bd98883124a710e98ff, user_id=9a09228a8bc440b4aab7f33478d1227c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.539298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eb4e2-dc12-465a-8719-ad9d37bec461 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.553441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f55ac7e48c4634ba63ef1bec31a1de', 'request_id': 'req-9e3a339e-6794-478f-b8a8-a070eb361d71'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.560038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1060/2103] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:19 2022] PUT /identity/v3/projects/222fbfe211d84bd98883124a710e98ff/users/9a09228a8bc440b4aab7f33478d1227c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:19.560038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.560038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.569002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] The token cache is being invalidate because project 77f55ac7e48c4634ba63ef1bec31a1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:19.569777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.570653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.571572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.573713 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1044/2104] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:19 2022] DELETE /identity/v3/projects/77f55ac7e48c4634ba63ef1bec31a1de => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:19.574469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.576218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.600447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:19.601721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.652276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a339e-6794-478f-b8a8-a070eb361d71 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.703552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1061/2105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:19.704432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.705883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.717130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.717822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.718218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.718573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.719704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.722696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.752539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a151f8-c465-481f-a3f7-68a282eb5b8e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.754787 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1045/2106] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:19 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:19.756185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.761372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.762236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.763095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.763612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.764051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.765009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.768847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.799124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1062/2107] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:19.799224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254969e-982d-49df-8321-b4e316ef4914 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.799308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.800305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:19.807687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.808948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.809230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.815013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] PATH_INFO: `/v3/users/9db736445f7045cfbae7e481895d23a5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.818108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db736445f7045cfbae7e481895d23a5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.822497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.895654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805abe2-f3c3-47ee-9a36-1d60ff830b00 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.896544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db736445f7045cfbae7e481895d23a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.901241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:19.902056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:19.902687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:19.903150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:19.916707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:19.917752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db736445f7045cfbae7e481895d23a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.918428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db736445f7045cfbae7e481895d23a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.918543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:19.927401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db736445f7045cfbae7e481895d23a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.932609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1063/2108] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:19.933486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.935041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db736445f7045cfbae7e481895d23a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:19.942450 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1046/2109] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:19 2022] DELETE /identity/v3/users/9db736445f7045cfbae7e481895d23a5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:19.943059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a884023-d9cd-4fbb-ae5d-2bc3d122df26 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:19.945486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:19.948073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.025704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.026358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.027090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.027513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.028653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.030595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.046559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1064/2110] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:20.048024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.050946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.066569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeaa-b306-4d17-a17f-28a4f9082b90 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.067424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43705059-df4e-44f1-bdc0-e23016db2412 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.073911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.074159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.074919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.075256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.075535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] PATH_INFO: `/v3/projects/222fbfe211d84bd98883124a710e98ff/users/9a09228a8bc440b4aab7f33478d1227c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.075663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.076026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.076590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] PATH_INFO: `/v3/users/61c0b07ac66748afbf2c5671b1adaf08` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.077789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222fbfe211d84bd98883124a710e98ff, user_id=9a09228a8bc440b4aab7f33478d1227c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.078234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c0b07ac66748afbf2c5671b1adaf08)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.080520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.081293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.094075 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1047/2111] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:19 2022] PUT /identity/v3/projects/222fbfe211d84bd98883124a710e98ff/users/9a09228a8bc440b4aab7f33478d1227c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.094973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.096843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.142216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c0b07ac66748afbf2c5671b1adaf08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.150512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c0b07ac66748afbf2c5671b1adaf08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.151160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c0b07ac66748afbf2c5671b1adaf08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.151784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c0b07ac66748afbf2c5671b1adaf08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.159094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c0b07ac66748afbf2c5671b1adaf08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.178726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1065/2112] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:20 2022] DELETE /identity/v3/users/61c0b07ac66748afbf2c5671b1adaf08 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.179784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.183465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.188382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269096-28ef-437b-812b-d9eca797d718 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.256113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.256817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.257110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.257389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.260417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.270544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513fbcc-4e1a-4909-9db4-6af979ceb0bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.277536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.278438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.278722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.278996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] PATH_INFO: `/v3/projects/1b0aa5573931449796e2c01365d4292f/users/65483dc9763e4e7db4365cae3329c6a2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.296726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0aa5573931449796e2c01365d4292f, user_id=65483dc9763e4e7db4365cae3329c6a2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.299383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0b4c-f01f-47c0-9ba4-904aaf66eada admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.328894 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1066/2113] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:20 2022] PUT /identity/v3/projects/1b0aa5573931449796e2c01365d4292f/users/65483dc9763e4e7db4365cae3329c6a2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.330520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.330810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.331087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.352284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.354296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31a309-4f97-4e93-bf5c-a3e7057ff589 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.366681 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1048/2114] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:20.368125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.369279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.369688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.380693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] MFA Rules not processed for user `9a09228a8bc440b4aab7f33478d1227c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:20.381920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.390550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:20.392763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.491530 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1067/2115] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:20.491530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.513227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1049/2116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:20.514415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.518867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.535285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbba39-70a6-42d0-b9a2-b54486ccf8bc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.552959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.554155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.554555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.554923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] PATH_INFO: `/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.558710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8a9be50ed245fba2aa19eee5c6ee08)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.560983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.604597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00a19-211b-44b9-a36d-ed3de817b64b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.613496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.616809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.617836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.619063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.621422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.626391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.640702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1068/2117] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:20.641393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.643099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.654588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8a9be50ed245fba2aa19eee5c6ee08', 'request_id': 'req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.655947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe81919-6838-4042-a38e-92191080ad86 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.663903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8a9be50ed245fba2aa19eee5c6ee08', 'request_id': 'req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.672262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8a9be50ed245fba2aa19eee5c6ee08', 'request_id': 'req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.687520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] The token cache is being invalidate because project 3b8a9be50ed245fba2aa19eee5c6ee08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:20.687894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.688671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.690303 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1050/2118] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:20 2022] DELETE /identity/v3/projects/3b8a9be50ed245fba2aa19eee5c6ee08 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.694147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.694147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.725318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.726549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.726872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.727278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] PATH_INFO: `/v3/projects/e2256486ffe742f1bd7777b410610a88` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.729636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2256486ffe742f1bd7777b410610a88)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.731631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.759691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738a32-59ad-4913-b11f-f1f7f60fb9e6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.764851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.765496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.765783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.766063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.768220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.781163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2256486ffe742f1bd7777b410610a88', 'request_id': 'req-d3f62769-5e57-4f05-bd8e-95277b7b97df'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.781524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.783314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2d0a-cab2-4378-857f-cd2815cefe12 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.787266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2256486ffe742f1bd7777b410610a88', 'request_id': 'req-d3f62769-5e57-4f05-bd8e-95277b7b97df'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.794739 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1051/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:20.796370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af482-b706-4721-b0ed-1baa8f346e61 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.796647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2256486ffe742f1bd7777b410610a88', 'request_id': 'req-d3f62769-5e57-4f05-bd8e-95277b7b97df'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.797078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af482-b706-4721-b0ed-1baa8f346e61 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.797468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af482-b706-4721-b0ed-1baa8f346e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.815969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] The token cache is being invalidate because project e2256486ffe742f1bd7777b410610a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:20.816507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.817468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:20.819167 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1069/2120] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:20 2022] DELETE /identity/v3/projects/e2256486ffe742f1bd7777b410610a88 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.820075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.823610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.836592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7e3af482-b706-4721-b0ed-1baa8f346e61 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:20.837965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e3af482-b706-4721-b0ed-1baa8f346e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.904718 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1052/2121] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:20.905992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.906461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.906567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f62769-5e57-4f05-bd8e-95277b7b97df admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:20.907593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.912161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:20.913747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:20.914197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:20.914656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] PATH_INFO: `/v3/projects/1b0aa5573931449796e2c01365d4292f/users/65483dc9763e4e7db4365cae3329c6a2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:20.917509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0aa5573931449796e2c01365d4292f, user_id=65483dc9763e4e7db4365cae3329c6a2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:20.921464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:20.927155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:20.928752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:20.934525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1070/2122] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:20 2022] PUT /identity/v3/projects/1b0aa5573931449796e2c01365d4292f/users/65483dc9763e4e7db4365cae3329c6a2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:20.935665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:20.937606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.018187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda30a-ad3d-47ec-84c9-fbaf3c948c08 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.020933 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1053/2123] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:21.022309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.025676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.028624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.030315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.030835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.031412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] PATH_INFO: `/v3/users/8c0c08042204498b8277d43ad8e46e3c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.033818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0c08042204498b8277d43ad8e46e3c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.036406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.105731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0c08042204498b8277d43ad8e46e3c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.116609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb72d6-57e3-432a-8ed4-1ff23e090de5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.118293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0c08042204498b8277d43ad8e46e3c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.119060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0c08042204498b8277d43ad8e46e3c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.121828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.122468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.122824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.123160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.123951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0c08042204498b8277d43ad8e46e3c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.125684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.136836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0c08042204498b8277d43ad8e46e3c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.152849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.154298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dff68-720e-47e2-9b8e-9d439e59639c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.162855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1054/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:21.164084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.164376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.164700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.184053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:21.184969 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1071/2125] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:20 2022] DELETE /identity/v3/users/8c0c08042204498b8277d43ad8e46e3c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:21.185452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.185858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.187631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.256916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1055/2126] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:21.257824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.265671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2347-504f-4a81-a6b6-2f8957bc0cf4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.272281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.273627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.274118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.275109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] PATH_INFO: `/v3/projects/b9fb7e0a29fc4b53825f8910b80bc992` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.276876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fb7e0a29fc4b53825f8910b80bc992)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.279266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3602914-4a87-4d19-8009-c3da52ff7b95 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.279454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.285470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.286154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.286447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.286737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.287468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:21.287862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.289521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.324245 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1056/2127] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:21.324245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.326127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.344968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fb7e0a29fc4b53825f8910b80bc992', 'request_id': 'req-bf32e010-b1da-4167-b755-cc383768bd6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.357982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fb7e0a29fc4b53825f8910b80bc992', 'request_id': 'req-bf32e010-b1da-4167-b755-cc383768bd6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.380133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fb7e0a29fc4b53825f8910b80bc992', 'request_id': 'req-bf32e010-b1da-4167-b755-cc383768bd6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.394934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] The token cache is being invalidate because project b9fb7e0a29fc4b53825f8910b80bc992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:21.395762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.396633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.398839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1072/2128] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:21 2022] DELETE /identity/v3/projects/b9fb7e0a29fc4b53825f8910b80bc992 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:21.399801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.401526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.441279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b69e19-94ae-4a1a-90df-c8b7121fce3c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.514785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32e010-b1da-4167-b755-cc383768bd6b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.522451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.523344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.523951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.524267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.524992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.528661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.554671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.555475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.556482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.556919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.558775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.567932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1073/2129] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:21 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:21.568923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.572029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.663275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.670023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.674246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3304a-8e63-41c2-b496-9ae2e57dc15b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.680047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.681518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.681986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.682270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] PATH_INFO: `/v3/users/9305cf7e03bc4388aab4c8c1255ae476` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.683515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9305cf7e03bc4388aab4c8c1255ae476)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.684111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1057/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:21.685698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.700174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd36f2-1612-43da-be9b-91655a09a333 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.706229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.707474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.707870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.708256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.708747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.709859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.712839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.747991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1058/2131] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:21 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:21.749407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.762566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa46c-ed43-4444-9b09-6449a217f720 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.772078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.772994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.782805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.783236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.784324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.797439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.815387 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1059/2132] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:21.816535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.819041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.835005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9305cf7e03bc4388aab4c8c1255ae476'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.842282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d3004-1fdf-4bde-b29c-094e0d440f14 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:21.847310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9305cf7e03bc4388aab4c8c1255ae476'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.848232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9305cf7e03bc4388aab4c8c1255ae476'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.849005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9305cf7e03bc4388aab4c8c1255ae476'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.850142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:21.851191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:21.852144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:21.852664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] PATH_INFO: `/v3/projects/5fbdabfd7e35449c833c59dffcdd1128` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:21.855254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbdabfd7e35449c833c59dffcdd1128)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:21.857431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:21.860710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9305cf7e03bc4388aab4c8c1255ae476'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.889071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1074/2133] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:21 2022] DELETE /identity/v3/users/9305cf7e03bc4388aab4c8c1255ae476 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:21.893336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:21.896198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:21.953170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbdabfd7e35449c833c59dffcdd1128', 'request_id': 'req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.973467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbdabfd7e35449c833c59dffcdd1128', 'request_id': 'req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:21.985722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbdabfd7e35449c833c59dffcdd1128', 'request_id': 'req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.026021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] The token cache is being invalidate because project 5fbdabfd7e35449c833c59dffcdd1128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:22.026403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.027832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-726dbc67-b954-4326-8f67-e1a5f8c8eb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.032672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1060/2134] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:21 2022] DELETE /identity/v3/projects/5fbdabfd7e35449c833c59dffcdd1128 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:22.039899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417df3-17e0-4d86-a71b-b63ce73c91ed None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.043986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417df3-17e0-4d86-a71b-b63ce73c91ed None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.044528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417df3-17e0-4d86-a71b-b63ce73c91ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.073580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594f29c-3eaf-483d-9411-de02df7f1be5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.103786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-18417df3-17e0-4d86-a71b-b63ce73c91ed None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.105425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-18417df3-17e0-4d86-a71b-b63ce73c91ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.138393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.139256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.139685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.140179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.141130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.143798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379feb4-c111-46ec-9046-ec2eb982a0ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.158741 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1075/2135] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:22.160362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.160847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.161278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.189483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] MFA Rules not processed for user `b68e4ad966924cf98c972f0fc0704fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.190748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.209162 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1061/2136] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.215343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.215945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.216262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.252733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] MFA Rules not processed for user `65483dc9763e4e7db4365cae3329c6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.254996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.257717 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1076/2137] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.258754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.260805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.276144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c149c3-1eb7-4577-bd7a-e7873d115bad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.282131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.283028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.283380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.283668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] PATH_INFO: `/v3/users/7a5c2863efed4b87b8919e1a6ffc1d10` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.284948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5c2863efed4b87b8919e1a6ffc1d10)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.287232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.352941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5c2863efed4b87b8919e1a6ffc1d10'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.357833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1062/2138] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.365419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5c2863efed4b87b8919e1a6ffc1d10'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.366150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5c2863efed4b87b8919e1a6ffc1d10'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.367560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5c2863efed4b87b8919e1a6ffc1d10'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.370186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.372280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.391805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58407568-eb8b-49f0-8d32-91e2348a3d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5c2863efed4b87b8919e1a6ffc1d10'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.395962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c897b-30d5-4e90-9953-6f7ec3fe6849 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.402384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.403432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.404089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.404563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] PATH_INFO: `/v3/projects/745143f194794a09bc5a093721a70a0e/users/3eb070fec4fe461bb7e57f8c45681dc7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.423529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1077/2139] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:22 2022] DELETE /identity/v3/users/7a5c2863efed4b87b8919e1a6ffc1d10 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:22.425863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df83eb-035a-4704-b1aa-907ed55ab7c4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.426413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df83eb-035a-4704-b1aa-907ed55ab7c4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.426620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df83eb-035a-4704-b1aa-907ed55ab7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.432516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745143f194794a09bc5a093721a70a0e, user_id=3eb070fec4fe461bb7e57f8c45681dc7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.435483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72e3ee-e55d-4581-928c-e10104809f50 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.454592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a7df83eb-035a-4704-b1aa-907ed55ab7c4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.455976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a7df83eb-035a-4704-b1aa-907ed55ab7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.476503 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1063/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:22 2022] PUT /identity/v3/projects/745143f194794a09bc5a093721a70a0e/users/3eb070fec4fe461bb7e57f8c45681dc7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:22.476503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.476503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.476503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.506269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] MFA Rules not processed for user `a2e061bb9a054fb1945417baf444eaee`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.507946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.545359 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1078/2141] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.550343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2029fc-3ab0-4016-8cac-237b4fc3b3c9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.550751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2029fc-3ab0-4016-8cac-237b4fc3b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.551291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2029fc-3ab0-4016-8cac-237b4fc3b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.608223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c2029fc-3ab0-4016-8cac-237b4fc3b3c9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.609647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c2029fc-3ab0-4016-8cac-237b4fc3b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.629099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1079/2142] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.630804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.631210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.631591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.669028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1064/2143] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.669900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.694360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] MFA Rules not processed for user `3eb070fec4fe461bb7e57f8c45681dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:22.695579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.702229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bf617-db3c-499a-adc9-37927346cea3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.716883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.717563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.717844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.718159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.720308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:22.720665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.724608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.743807 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1065/2144] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:22.745400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.747402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.831457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6439e-05ec-4302-a47f-8d13de3b2fb3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.834765 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1080/2145] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:22.836341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.838156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.838999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.839665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.839949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.840229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.855928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239bb9-71f3-41af-8574-33b52c757360 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.861196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.861341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.862491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.862859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.862969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.863303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] PATH_INFO: `/v3/projects/9904a696bbb043e4bafd415933961394` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.864661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9904a696bbb043e4bafd415933961394)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.867821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.874020 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1066/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:22.874846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.886407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a5efc-84de-423a-9072-24b0d6a0298b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:22.893495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:22.893673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:22.893926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:22.894150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:22.895572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:22.897788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:22.946830 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1067/2147] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/projects => generated 395 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:22.946830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:22.954865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:22.971275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9904a696bbb043e4bafd415933961394', 'request_id': 'req-94d28768-318a-4bae-aa51-472805649531'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:22.983920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9904a696bbb043e4bafd415933961394', 'request_id': 'req-94d28768-318a-4bae-aa51-472805649531'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:23.002934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9904a696bbb043e4bafd415933961394', 'request_id': 'req-94d28768-318a-4bae-aa51-472805649531'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:23.028299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] The token cache is being invalidate because project 9904a696bbb043e4bafd415933961394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:23.028755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:23.029736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:23.032159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1081/2148] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:22 2022] DELETE /identity/v3/projects/9904a696bbb043e4bafd415933961394 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:23.035627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.066291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.170205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15daeea-a23e-45fb-b762-3b8c3f919b80 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.178619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.179822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.180245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.180854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.182114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.185491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.190945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d28768-318a-4bae-aa51-472805649531 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.196853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.197660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.198894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.199254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.200025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.202094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53b145-8c50-47ce-83f9-6a3fab6f4463 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.235049 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1082/2149] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:23.235049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.235049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.235049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.237295 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1068/2150] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:22 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:23.241293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.247877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.272886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:23.276273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.365517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708a91-b44c-4e36-a1e7-71c3ccc61e68 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.376262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.377234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.378494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.378880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.385577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.453476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1083/2151] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:23.455447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.478154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2f19-205d-433e-b24b-fef5e682528c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.487296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.489475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.490062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.491065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.492202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.495232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.515798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1084/2152] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:23.515798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.518065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.520614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.524567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aba2a-9b5b-45db-86bc-b583734075ac service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.539159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ddb02-2edd-49e4-bd3d-62d6da1c1c95 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.541612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1069/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:23.543181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.543586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.544045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.545964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.546754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.547056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.547336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.548029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.550516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.567662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:23.569312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.579416 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1085/2154] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/users => generated 299 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:23.579416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.587791 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1070/2155] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:23.588621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.591382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec77fcb-d8bb-4d23-822c-9ec74e13f356 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.596741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.597494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.597909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.598291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.599117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.601303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.601857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544fe3-0b8c-4407-889a-0e26546f81a7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.614196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1086/2156] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:23.615253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.620200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.621282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.622010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.622889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.629186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.633829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.648537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4c544-5d5d-4b77-8f1c-999f9d5ca834 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.655586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.656537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.656936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.657224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.657988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:23.658301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.662181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1071/2157] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:23.662181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.662437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.675695 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1087/2158] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:23.676514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.679865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b800c5-2d47-474f-a694-6ddaad7811f8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.690016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.690845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151606e-30e5-4dd6-81a1-82939a0bdb79 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.691386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.691768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.692558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] PATH_INFO: `/v3/projects/4b2be6848c6e4205b771081eb2b6ec99/users/3e2725a6279b4d5baea22fad55e238aa/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.698424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.699863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.699863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.700043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] PATH_INFO: `/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6/users/56b4cc2bf94f409e97873a9a2e8d10e9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.711580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2be6848c6e4205b771081eb2b6ec99, user_id=3e2725a6279b4d5baea22fad55e238aa, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.715644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.740349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b56936d85e94b27b8d70a3f6bd5f4f6, user_id=56b4cc2bf94f409e97873a9a2e8d10e9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.746153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e18f0-25f6-4ad7-9fa5-eee641b59df5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:23.750847 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1072/2159] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:23 2022] PUT /identity/v3/projects/4b2be6848c6e4205b771081eb2b6ec99/users/3e2725a6279b4d5baea22fad55e238aa/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:23.764036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:23.818945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1088/2160] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:23 2022] PUT /identity/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6/users/56b4cc2bf94f409e97873a9a2e8d10e9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:23.836048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.836519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.837793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.885754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] MFA Rules not processed for user `3e2725a6279b4d5baea22fad55e238aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:23.886474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eb574-5987-4202-91af-038d36d69cc2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:23.887056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:23.976550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:23.977356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:23.978189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:23.978470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:23.979308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:23.981281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.012826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1089/2161] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:24.016626 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1073/2162] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:23 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:24.016768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.016876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.018724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.034762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b11e3-6861-4d91-b000-15caa057b1e1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.093424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847d331-9f47-4f44-9c86-7d62f0c17d52 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.098734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.099545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.099835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.100116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.101020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.103330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.109550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.110435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.110721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.111141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] PATH_INFO: `/v3/projects/6641567a5d6d4eddb03a728991b989ba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.112382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6641567a5d6d4eddb03a728991b989ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.114473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.117139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1074/2163] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:24.118694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.146299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e5ce7-bbd0-4609-a414-7a9a1010befc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.154837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.156009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.156527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.157015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.157930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.160545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.178806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6641567a5d6d4eddb03a728991b989ba', 'request_id': 'req-eb4b718b-202d-4899-93b9-dc2dc3488e74'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.186251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6641567a5d6d4eddb03a728991b989ba', 'request_id': 'req-eb4b718b-202d-4899-93b9-dc2dc3488e74'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.196003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6641567a5d6d4eddb03a728991b989ba', 'request_id': 'req-eb4b718b-202d-4899-93b9-dc2dc3488e74'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.213337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] The token cache is being invalidate because project 6641567a5d6d4eddb03a728991b989ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:24.214517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.216724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.219548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1090/2164] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:24 2022] DELETE /identity/v3/projects/6641567a5d6d4eddb03a728991b989ba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:24.220601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.221973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.234554 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1075/2165] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:24 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:24.235605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.237490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.304612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b718b-202d-4899-93b9-dc2dc3488e74 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.310809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.311932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.312443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.313047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.314075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.316442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4b80f-566b-4187-bd0b-f209308d1e1a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.316876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.322232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.323207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.323493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.323775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] PATH_INFO: `/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6/users/56b4cc2bf94f409e97873a9a2e8d10e9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.326804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b56936d85e94b27b8d70a3f6bd5f4f6, user_id=56b4cc2bf94f409e97873a9a2e8d10e9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.329947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.345366 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1076/2166] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:24 2022] PUT /identity/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6/users/56b4cc2bf94f409e97873a9a2e8d10e9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:24.348528 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1091/2167] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:24 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:24.349955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.353970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.357830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.359564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.376437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b52ef-ba42-4c7c-ab32-2b59ca759d50 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.454893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.454893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.458496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.458496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] PATH_INFO: `/v3/users/9a09228a8bc440b4aab7f33478d1227c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.459479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a09228a8bc440b4aab7f33478d1227c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.464007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.487121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983d94-6796-4192-b997-94e3927c765f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.492922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.494138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.494519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.494871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] PATH_INFO: `/v3/users/d7a5f6aa796a441d93c21a80b4ff11d8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.497176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a5f6aa796a441d93c21a80b4ff11d8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.498841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:24.563919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a09228a8bc440b4aab7f33478d1227c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.576188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a09228a8bc440b4aab7f33478d1227c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.577350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a09228a8bc440b4aab7f33478d1227c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.578870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a09228a8bc440b4aab7f33478d1227c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.588186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a5f6aa796a441d93c21a80b4ff11d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.594359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a09228a8bc440b4aab7f33478d1227c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.606652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a5f6aa796a441d93c21a80b4ff11d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.607487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a5f6aa796a441d93c21a80b4ff11d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.619505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a5f6aa796a441d93c21a80b4ff11d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.638008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ff00623-5734-42c2-a079-9a35d1ba28e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a5f6aa796a441d93c21a80b4ff11d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:24.645059 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1092/2168] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:24 2022] DELETE /identity/v3/users/9a09228a8bc440b4aab7f33478d1227c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:24.646291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1077/2169] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:24 2022] DELETE /identity/v3/users/d7a5f6aa796a441d93c21a80b4ff11d8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:24.646648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.651403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.652687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.653099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.653621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.699021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] MFA Rules not processed for user `56b4cc2bf94f409e97873a9a2e8d10e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:24.700629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.859688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd6881-c8cf-4594-a98e-87306dc10554 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:24.890862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1078/2170] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:24.891822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:24.895392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:24.984817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:24.986059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:24.986548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:24.987407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:24.989041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:24.991350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cff3-ef8e-4fff-b475-ae3b8e0394be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.033085 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1093/2171] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:24 2022] POST /identity/v3/users => generated 303 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:25.038236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.040054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.041215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.043943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddc229-69d9-4da7-9d71-53188909786f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.065044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.068407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.068952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.070137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.071476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.075502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.085497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:25.087588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.089418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1079/2172] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:25.090425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.093433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.099681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1094/2173] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:25.100809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.104427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.123268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9b25b-e9b0-4ea3-8567-793c8d7629f4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.128965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.129620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.129924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.130198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.130926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.132549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.150148 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1095/2174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:25.150148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.152225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.165563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fceb73c-d442-42b6-aeab-a02d7515674e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.187767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.188723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.189012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.189300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] PATH_INFO: `/v3/projects/222fbfe211d84bd98883124a710e98ff` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.190701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] RBAC: Authorizing `identity:delete_project(project_id=222fbfe211d84bd98883124a710e98ff)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.193130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.254874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222fbfe211d84bd98883124a710e98ff', 'request_id': 'req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:25.264169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222fbfe211d84bd98883124a710e98ff', 'request_id': 'req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:25.275493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222fbfe211d84bd98883124a710e98ff', 'request_id': 'req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:25.276062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc072a-39db-4440-8490-888c2571b70f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.289053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] The token cache is being invalidate because project 222fbfe211d84bd98883124a710e98ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:25.289347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:25.290640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:25.293341 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1096/2175] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:25 2022] DELETE /identity/v3/projects/222fbfe211d84bd98883124a710e98ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:25.297483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.298915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.363787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.365276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.365833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.366582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.368238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fd6e4-1989-48e5-a44c-a260bd5f042d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.368997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.374449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.375199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.375567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.376109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.376718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.378735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.394015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1097/2176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:25.394015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.394632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.461102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.463460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.489193 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1080/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:25.490466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.496014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.519233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da5c1e-0531-493a-b7bd-55d126153554 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.534875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.535551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.536275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.536620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.541552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.542653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546dd2-6f26-4017-855e-1e0ce0a4c9af service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.561604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.565047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.565692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.566189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] PATH_INFO: `/v3/projects/709ba1dd2e6b42568f31073a18b238b2/users/a0d8843a390d4de68c32b3d435f9fdea/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.568116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.569700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff42bb6-3ef3-4dd5-bb7c-66db193f3ec1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.593614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1098/2178] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:25.600886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.601421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.601920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.610163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ba1dd2e6b42568f31073a18b238b2, user_id=a0d8843a390d4de68c32b3d435f9fdea, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.613608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.643311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:25.645279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.645799 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1081/2179] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:25 2022] PUT /identity/v3/projects/709ba1dd2e6b42568f31073a18b238b2/users/a0d8843a390d4de68c32b3d435f9fdea/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:25.646738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.805491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1099/2180] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:25.805688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bad8a-27e5-47a5-8ebd-830d8e40a92e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.805771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:25.819615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.821100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffce40-9166-4de5-bb5b-5b100d89f3cd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:25.822993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.824773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.825697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] PATH_INFO: `/v3/projects/7755ff4a52a843d5afe245dd067d37fb/users/b6bd66a0c09642dc91a334698fbd4daa/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.827764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:25.828581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.828978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.829328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.830128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.832430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bb1bb-cf1a-456c-9786-2a838d0bd463 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.849563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1100/2181] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:25.853657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a18d-abcd-4a7d-81db-ee8b21d01279 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:25.854106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a18d-abcd-4a7d-81db-ee8b21d01279 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:25.854522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a18d-abcd-4a7d-81db-ee8b21d01279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:25.870363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7755ff4a52a843d5afe245dd067d37fb, user_id=b6bd66a0c09642dc91a334698fbd4daa, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:25.892723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:25.914347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9871a18d-abcd-4a7d-81db-ee8b21d01279 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:25.916670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9871a18d-abcd-4a7d-81db-ee8b21d01279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:25.932508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1082/2182] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:25 2022] PUT /identity/v3/projects/7755ff4a52a843d5afe245dd067d37fb/users/b6bd66a0c09642dc91a334698fbd4daa/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:25.932508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.126399 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1101/2183] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:26.127862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.128157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.128440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.146032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843294d9-e054-4162-8f04-18c31ca90bf8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.153490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.155146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.155600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.156109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] PATH_INFO: `/v3/projects/709ba1dd2e6b42568f31073a18b238b2/users/a0d8843a390d4de68c32b3d435f9fdea/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.158538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ba1dd2e6b42568f31073a18b238b2, user_id=a0d8843a390d4de68c32b3d435f9fdea, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.161731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.174677 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1083/2184] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:25 2022] PUT /identity/v3/projects/709ba1dd2e6b42568f31073a18b238b2/users/a0d8843a390d4de68c32b3d435f9fdea/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:26.177959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.189492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] MFA Rules not processed for user `b6bd66a0c09642dc91a334698fbd4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:26.197883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:26.287051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54428d91-a85c-42b6-b6d9-0c6ca04ef367 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.292694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.293694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.294383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.294881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.295839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:26.296407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.298592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f414-f8f6-4b1b-841d-5119e89fd33e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.316710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1084/2185] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:26.319147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.319694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.320194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.369407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] MFA Rules not processed for user `a0d8843a390d4de68c32b3d435f9fdea`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:26.372158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:26.385723 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1102/2186] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:26.390552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.402605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c81a-aa9b-43a6-9092-982182a9502d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.408120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.408840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.410553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.411452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.411604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.413681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.458916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1103/2187] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:26.459662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.531776 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1085/2188] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:26.533072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.544854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2736d-0979-4888-8a82-9e36b577d4a6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.550536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.551519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.552128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.552637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.553530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.553646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47d65-8ef0-42cc-89eb-3b9673340cb7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.556444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.561682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.562683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.563108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.563632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.565388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.570099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.606903 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1086/2189] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/users => generated 301 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:26.610985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.617815 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1104/2190] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:26.624357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.630437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619927a-678c-4986-b41a-12e6ec68289c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.700468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fd94c-8d3b-46f4-a6c9-84afc42f717f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.701434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.702325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.702681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.703064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.704151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.706550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.708245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.709347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.709938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.710591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.711553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.714674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.722289 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1087/2191] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:26.723460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.735997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98caef-ffcb-41ed-9616-b98c5ba303e3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.740991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.741556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.742086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.742360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.742958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.745220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.755241 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1105/2192] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:26.761863 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1088/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:26.762040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.762987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.774025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b9f8-e975-414e-8595-592ebb5e53aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.779204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.780099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.780381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.780691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] PATH_INFO: `/v3/projects/ce16d6684bbf4f0eb8223f7a65631ccc/users/f1475ed2bd1a4f6fa581f9d5616e1e6a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.787493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f6d0-c3e3-4737-8edb-dad11df083c2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.794433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.797018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.797318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.797601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.798524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce16d6684bbf4f0eb8223f7a65631ccc, user_id=f1475ed2bd1a4f6fa581f9d5616e1e6a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.798610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:26.801513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df099b2-d192-4190-8351-39f946abb63e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.809543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:26.836594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1089/2194] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:26 2022] PUT /identity/v3/projects/ce16d6684bbf4f0eb8223f7a65631ccc/users/f1475ed2bd1a4f6fa581f9d5616e1e6a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:26.839181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.839479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.839760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:26.849468 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1106/2195] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:26.850759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:26.882219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba3553-c715-4989-819b-6d758b18e257 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:26.891731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] MFA Rules not processed for user `f1475ed2bd1a4f6fa581f9d5616e1e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:26.894429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:26.991086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:26.991807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:26.992093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:26.992374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] PATH_INFO: `/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2/users/00a52964722e4547a7f8daf32cd39476/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.014576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1090/2196] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:27.015492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.019597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.022623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d66d2af87345d38fa807f9c3d25bf2, user_id=00a52964722e4547a7f8daf32cd39476, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.028511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.074081 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1107/2197] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:26 2022] PUT /identity/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2/users/00a52964722e4547a7f8daf32cd39476/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:27.074916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.157863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789548ba-ae31-4bdf-bf94-47e1af76613d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.216980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02364476-a97c-4131-8886-453657fcca1d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.223554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.224568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.225073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.225525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.226572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.240344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.247923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.248660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.251091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.252880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.336052 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1108/2198] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:27 2022] POST /identity/v3/projects => generated 401 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:27.339256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.341241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.392354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.394350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.407443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1091/2199] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:27.408639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.419668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0201a-6b11-4a6b-a3f3-6cd934245852 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.424811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.425660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.425951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.426228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.426953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.428585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.432156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27bf0-536d-4896-80f5-980164b5b120 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.441299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1092/2200] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:27.442418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.448604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.450456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.451231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.451851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] PATH_INFO: `/v3/users/3eb070fec4fe461bb7e57f8c45681dc7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.453403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb070fec4fe461bb7e57f8c45681dc7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.455575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.459490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.491318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab83b7-b1a0-48d5-a1d6-c0e629eb83ea admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.504503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.505377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.505660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.505935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] PATH_INFO: `/v3/projects/c7076023af114f8399ce254557d49a92` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.507132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7076023af114f8399ce254557d49a92)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.516528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.553598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb070fec4fe461bb7e57f8c45681dc7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.565607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb070fec4fe461bb7e57f8c45681dc7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.566697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb070fec4fe461bb7e57f8c45681dc7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.568573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb070fec4fe461bb7e57f8c45681dc7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.595131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb070fec4fe461bb7e57f8c45681dc7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.621977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7076023af114f8399ce254557d49a92', 'request_id': 'req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.627142 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1109/2201] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:27 2022] DELETE /identity/v3/users/3eb070fec4fe461bb7e57f8c45681dc7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:27.634713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7076023af114f8399ce254557d49a92', 'request_id': 'req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.645072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.647691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.648409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7076023af114f8399ce254557d49a92', 'request_id': 'req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.677755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] The token cache is being invalidate because project c7076023af114f8399ce254557d49a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:27.678042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.680861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.682458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1093/2202] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:27 2022] DELETE /identity/v3/projects/c7076023af114f8399ce254557d49a92 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:27.683208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.686699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.776564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c5c51-02bf-42f5-a92b-bca8f3870596 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.782741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.783437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.783723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.784409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.784722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.788275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.793453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4d81d-1869-49de-a6fb-8e75f4f13b42 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.802762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.803721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.804014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.804916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] PATH_INFO: `/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2/users/00a52964722e4547a7f8daf32cd39476/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.808630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d66d2af87345d38fa807f9c3d25bf2, user_id=00a52964722e4547a7f8daf32cd39476, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.812384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6f61e-ec65-4e25-bc10-b49bd782b2fc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.816093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1110/2203] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:27 2022] POST /identity/v3/users => generated 307 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:27.817904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.819813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.827420 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1094/2204] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:27 2022] PUT /identity/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2/users/00a52964722e4547a7f8daf32cd39476/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:27.829254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.829543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.829973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.835544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21495-2e65-4cc1-9253-33b0002e1723 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.851743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:27.853106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.905137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.906805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.907099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.907386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] PATH_INFO: `/v3/users/3e2725a6279b4d5baea22fad55e238aa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.909130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2725a6279b4d5baea22fad55e238aa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.911743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.937381 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1095/2205] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:27.937381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:27.940060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:27.957545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad74-df11-4e7c-aa2b-aa8382ebc230 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:27.971045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2725a6279b4d5baea22fad55e238aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.981322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2725a6279b4d5baea22fad55e238aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.982044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:27.982237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2725a6279b4d5baea22fad55e238aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.983374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2725a6279b4d5baea22fad55e238aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:27.983820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:27.984691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:27.985186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] PATH_INFO: `/v3/users/810a5e7f4cbe461bafec0e48bbdaf6b9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:27.987357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810a5e7f4cbe461bafec0e48bbdaf6b9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:27.990471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:27.996138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2725a6279b4d5baea22fad55e238aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.027721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1111/2206] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:27 2022] DELETE /identity/v3/users/3e2725a6279b4d5baea22fad55e238aa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:28.028822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.030669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.056915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810a5e7f4cbe461bafec0e48bbdaf6b9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.091875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810a5e7f4cbe461bafec0e48bbdaf6b9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.092655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810a5e7f4cbe461bafec0e48bbdaf6b9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.105345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810a5e7f4cbe461bafec0e48bbdaf6b9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.114958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958916e1-05ee-44fc-8997-160422823910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810a5e7f4cbe461bafec0e48bbdaf6b9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:28.122401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1096/2207] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:27 2022] DELETE /identity/v3/users/810a5e7f4cbe461bafec0e48bbdaf6b9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:28.123961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d76e6-d811-4ae8-91f0-76f214180a69 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.124198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d76e6-d811-4ae8-91f0-76f214180a69 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.124650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d76e6-d811-4ae8-91f0-76f214180a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.138152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9d1f-8c50-4ad4-8f0e-93b6066ee4ec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.160220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ef3d76e6-d811-4ae8-91f0-76f214180a69 None None] MFA Rules not processed for user `00a52964722e4547a7f8daf32cd39476`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:28.161380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ef3d76e6-d811-4ae8-91f0-76f214180a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.204954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.206039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.206540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.207284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.208261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.210105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.225128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1112/2208] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:28.226758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.229163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.248975 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1097/2209] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:28.250678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.251327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.251822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.273452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:28.275946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.285433 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1098/2210] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:28.286537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.289594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.303881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdb67f-0221-4df9-a86c-4158e4d8f922 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.306931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca1e66-0171-4b8c-8861-d95b8992acd5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.309218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.310119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.310414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.310689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] PATH_INFO: `/v3/projects/6feca2ef39044127853c20cf5eef04db/users/74d0ec9434174c27aeb12384a073bb05/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.313476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.314588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.315094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.315575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.318060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.328380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feca2ef39044127853c20cf5eef04db, user_id=74d0ec9434174c27aeb12384a073bb05, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.331330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025672c-6ddf-4fca-9a0e-7ae109c4c357 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.339505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.341777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.350627 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1099/2211] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:28 2022] PUT /identity/v3/projects/6feca2ef39044127853c20cf5eef04db/users/74d0ec9434174c27aeb12384a073bb05/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:28.352104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.352633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.352919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.359683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1113/2212] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:28.360908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.369819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d551ed5-5913-42c3-9277-46974f008029 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.375497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] MFA Rules not processed for user `b6bd66a0c09642dc91a334698fbd4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:28.377502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.431514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.433460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.434626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.435094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.454856 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1100/2213] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:28.456988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.544215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.554077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b428a26-cec1-47d1-853d-efa15274e69d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.554651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.559426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.560213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.561954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.561954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.562707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.566042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.575279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1114/2214] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:28.576980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.579837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.588744 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1101/2215] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:28.590271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:28.619204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098304b-49d9-4b1c-bd30-cc6293303b86 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.628348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.629880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.630279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.630739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] PATH_INFO: `/v3/projects/6feca2ef39044127853c20cf5eef04db/users/74d0ec9434174c27aeb12384a073bb05/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.644091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feca2ef39044127853c20cf5eef04db, user_id=74d0ec9434174c27aeb12384a073bb05, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.653234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8279-965b-4c9b-be42-36761da48150 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.682182 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1102/2216] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:28 2022] PUT /identity/v3/projects/6feca2ef39044127853c20cf5eef04db/users/74d0ec9434174c27aeb12384a073bb05/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:28.683828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.684168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.684487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.720383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483419bd-cd5e-45e5-bb9c-a5f3b4c35d18 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:28.726946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] MFA Rules not processed for user `74d0ec9434174c27aeb12384a073bb05`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:28.729463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.830059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:28.832343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:28.833814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:28.834127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:28.840079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:28.862216 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1103/2217] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:28.934415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:28.937325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c3245-a10e-41b4-9c25-dab5d3f03b12 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:28.957392 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1115/2218] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:29.103291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.105461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.188003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1beae7-7034-4bec-baac-68dc2384d565 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:29.194087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:29.194956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.195280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.195563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] PATH_INFO: `/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.197326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed7f8ebd83c4423a9c268bcac9e2e33)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:29.199894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:29.257188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed7f8ebd83c4423a9c268bcac9e2e33', 'request_id': 'req-644cdbee-a1ea-44c2-8919-280d54dc7bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.263561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed7f8ebd83c4423a9c268bcac9e2e33', 'request_id': 'req-644cdbee-a1ea-44c2-8919-280d54dc7bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.269552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed7f8ebd83c4423a9c268bcac9e2e33', 'request_id': 'req-644cdbee-a1ea-44c2-8919-280d54dc7bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.284550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] The token cache is being invalidate because project 5ed7f8ebd83c4423a9c268bcac9e2e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:29.285356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.286378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.290699 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1104/2219] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:29 2022] DELETE /identity/v3/projects/5ed7f8ebd83c4423a9c268bcac9e2e33 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:29.296220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.296532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.296952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.325018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:29.326729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.328921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.330689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.407658 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1116/2220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:29.408729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.409952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.422588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986cba0-de4b-4b57-ae28-cc9877e85c2f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:29.429311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:29.430409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.430795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.430961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] PATH_INFO: `/v3/projects/745143f194794a09bc5a093721a70a0e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.432637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] RBAC: Authorizing `identity:delete_project(project_id=745143f194794a09bc5a093721a70a0e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:29.435615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:29.519465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745143f194794a09bc5a093721a70a0e', 'request_id': 'req-48d7c6a9-e973-4488-b697-5934775d974a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.530687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745143f194794a09bc5a093721a70a0e', 'request_id': 'req-48d7c6a9-e973-4488-b697-5934775d974a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.532081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cdbee-a1ea-44c2-8919-280d54dc7bbf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:29.545937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745143f194794a09bc5a093721a70a0e', 'request_id': 'req-48d7c6a9-e973-4488-b697-5934775d974a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.561556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] The token cache is being invalidate because project 745143f194794a09bc5a093721a70a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:29.562419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.563699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48d7c6a9-e973-4488-b697-5934775d974a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.569238 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1117/2221] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:29 2022] DELETE /identity/v3/projects/745143f194794a09bc5a093721a70a0e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:29.571272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.571558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.571835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.603900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:29.605134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.651112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:29.651977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.652865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.653156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.659486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.716195 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1118/2222] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:29.717211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.718793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.737948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199a016-a193-4ece-a7cb-84ed0853429d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:29.742999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:29.744082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:29.744499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:29.744666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] PATH_INFO: `/v3/projects/4b2be6848c6e4205b771081eb2b6ec99` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:29.745956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2be6848c6e4205b771081eb2b6ec99)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:29.748525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:29.748667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:29.750741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:29.764028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1105/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:29.765068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.767065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:29.817536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2be6848c6e4205b771081eb2b6ec99', 'request_id': 'req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.824659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acc7-c8d6-456f-b810-7cef3239e9fe service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:29.828960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2be6848c6e4205b771081eb2b6ec99', 'request_id': 'req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.839949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2be6848c6e4205b771081eb2b6ec99', 'request_id': 'req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.900731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] The token cache is being invalidate because project 4b2be6848c6e4205b771081eb2b6ec99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:29.901082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.904582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:29.909141 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1119/2224] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:29 2022] DELETE /identity/v3/projects/4b2be6848c6e4205b771081eb2b6ec99 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:29.910033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:29.913885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.019019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.020274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.020820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.021322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] PATH_INFO: `/v3/users/56b4cc2bf94f409e97873a9a2e8d10e9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.024426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b4cc2bf94f409e97873a9a2e8d10e9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.026654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.092443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f2c6c-ea02-4966-98d7-dbe324627d5f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.112058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.113025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.113487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.113905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.114902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:30.115563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.117610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.131743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b4cc2bf94f409e97873a9a2e8d10e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.155842 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1120/2225] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:30.155842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.162874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.167096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b4cc2bf94f409e97873a9a2e8d10e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.168557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b4cc2bf94f409e97873a9a2e8d10e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.184710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a000c3-d5d3-48ce-94ca-93e598c330fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.187633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b4cc2bf94f409e97873a9a2e8d10e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.200764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.201887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.202076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.202725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-75ad76c9-ec3c-431a-8c51-8ab6ad1d073a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b4cc2bf94f409e97873a9a2e8d10e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.202962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] PATH_INFO: `/v3/users/a0d8843a390d4de68c32b3d435f9fdea` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.213605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d8843a390d4de68c32b3d435f9fdea)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.215645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.219645 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1106/2226] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:29 2022] DELETE /identity/v3/users/56b4cc2bf94f409e97873a9a2e8d10e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:30.222266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.224974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.226748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.229771 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1107/2227] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:52:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:30.232346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.238010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.308601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d8843a390d4de68c32b3d435f9fdea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.326044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d8843a390d4de68c32b3d435f9fdea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.326892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d8843a390d4de68c32b3d435f9fdea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.328691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d8843a390d4de68c32b3d435f9fdea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.344503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-816c7200-f568-4e59-a101-65426a69dac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d8843a390d4de68c32b3d435f9fdea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:30.428491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1121/2228] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:30 2022] DELETE /identity/v3/users/a0d8843a390d4de68c32b3d435f9fdea => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:30.444597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccf304-0213-44ad-8e68-94cd7df4a574 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.537483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.537773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.538057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.539018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.539947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.544499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.544853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.546012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.549908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.594111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1108/2229] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:30 2022] POST /identity/v3/projects => generated 369 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:30.599608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.602671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.669529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:30.670809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.721110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f04fa-cded-4fd3-8bf3-fc778fcf3a22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.726982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.726982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.728029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.728410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.729522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.732330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.770537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1109/2230] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:30 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:30.772105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.786030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ca057-dabe-475b-9be1-38a3cf552f16 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.793103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.794338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.795170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.795170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.796090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.798174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.821427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1110/2231] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:30.823800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.834746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1122/2232] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:30.849038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76979e94-1b50-42f2-aa5b-f387e5a69342 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.855820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.857856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.860943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.863306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.867690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.868068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.868891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.870524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.882645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae24f4-202e-4733-8b5f-9241091bfe63 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.893141 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1111/2233] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:30.898845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.901521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.902172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.902461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.902742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.907601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:30.918307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f8284-5345-4708-94db-127feb3a7563 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:30.923512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:30.924409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:30.924724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:30.925177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] PATH_INFO: `/v3/projects/a20461c81df249d49f39a4137ddefcd5/users/803118f9c12e4f36a0e7b8872abf6007/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:30.941492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20461c81df249d49f39a4137ddefcd5, user_id=803118f9c12e4f36a0e7b8872abf6007, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:30.944636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:30.992550 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1112/2234] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:30 2022] PUT /identity/v3/projects/a20461c81df249d49f39a4137ddefcd5/users/803118f9c12e4f36a0e7b8872abf6007/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:30.992550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:30.992550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.045198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:31.047272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cf68b-37e1-49fb-8f2f-a9758f79b924 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:31.059483 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1123/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:31.064995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.065590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.066025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.121379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] MFA Rules not processed for user `803118f9c12e4f36a0e7b8872abf6007`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:31.122606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.204235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791375c2-4072-4c28-b74a-6ac1c93a0c74 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:31.220169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:31.221399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.221936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.222161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.246354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:31.249318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:31.274443 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1124/2236] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:31.280005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:31.286717 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1113/2237] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:31.287903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:31.288672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.293631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.424650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be75d-d10d-4a0a-bc3a-ad7437768a65 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:31.430957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:31.432239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.432727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.433325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] PATH_INFO: `/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.434750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b56936d85e94b27b8d70a3f6bd5f4f6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:31.437002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:31.524853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc80e-acf9-4e23-a61d-7a5f0ab12beb service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:31.542416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b56936d85e94b27b8d70a3f6bd5f4f6', 'request_id': 'req-e14f2c93-2616-4af4-8aa6-22cbef5a906d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.552609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b56936d85e94b27b8d70a3f6bd5f4f6', 'request_id': 'req-e14f2c93-2616-4af4-8aa6-22cbef5a906d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.564327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b56936d85e94b27b8d70a3f6bd5f4f6', 'request_id': 'req-e14f2c93-2616-4af4-8aa6-22cbef5a906d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.579844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] The token cache is being invalidate because project 2b56936d85e94b27b8d70a3f6bd5f4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:31.580646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.583593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.593461 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1125/2238] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:31 2022] DELETE /identity/v3/projects/2b56936d85e94b27b8d70a3f6bd5f4f6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:31.595509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:31.598798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.630080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:31.630965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.631271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.631524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] PATH_INFO: `/v3/users/f1475ed2bd1a4f6fa581f9d5616e1e6a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.632797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1475ed2bd1a4f6fa581f9d5616e1e6a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:31.635467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:31.705477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1475ed2bd1a4f6fa581f9d5616e1e6a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.720813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1475ed2bd1a4f6fa581f9d5616e1e6a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.722856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1475ed2bd1a4f6fa581f9d5616e1e6a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.728532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2c93-2616-4af4-8aa6-22cbef5a906d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:31.734058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1475ed2bd1a4f6fa581f9d5616e1e6a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.736583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:31.737254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.737657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.737993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.740323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.747528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-df44641a-c16f-435b-a41f-004fce058ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1475ed2bd1a4f6fa581f9d5616e1e6a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:31.759196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1114/2239] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:31 2022] DELETE /identity/v3/users/f1475ed2bd1a4f6fa581f9d5616e1e6a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:31.761631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b94d-599a-4736-b5d8-e698dd0539cd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.762216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b94d-599a-4736-b5d8-e698dd0539cd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.762646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b94d-599a-4736-b5d8-e698dd0539cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.792141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4c72b94d-599a-4736-b5d8-e698dd0539cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:31.793435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c72b94d-599a-4736-b5d8-e698dd0539cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.865178 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1115/2240] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:31.865178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4bab-b8a8-4b25-8b88-e9317644016e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.865178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4bab-b8a8-4b25-8b88-e9317644016e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.865178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4bab-b8a8-4b25-8b88-e9317644016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.902541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-09ef4bab-b8a8-4b25-8b88-e9317644016e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:31.904130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-09ef4bab-b8a8-4b25-8b88-e9317644016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.921681 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1116/2241] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:31.923411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:31.923411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:31.923630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:31.943578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:31.945235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:31.953356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:31.954741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:31.969844 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1117/2242] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:31.974978 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1126/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:31.980844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:31.991627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:31.994236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.007071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e039-c370-4df4-9081-e006a6a19300 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.027795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.028876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.029252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.029678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.031764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1af43b-d64d-4278-9873-2d69f87d26ad service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.033097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:32.033328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.035395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.047817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.048824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.051666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.052052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] PATH_INFO: `/v3/projects/709ba1dd2e6b42568f31073a18b238b2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.055245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709ba1dd2e6b42568f31073a18b238b2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.074161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.075892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1118/2244] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:32.076979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.081910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.188798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709ba1dd2e6b42568f31073a18b238b2', 'request_id': 'req-b8525720-9007-4c6c-aa16-99918e1d3528'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:32.195561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709ba1dd2e6b42568f31073a18b238b2', 'request_id': 'req-b8525720-9007-4c6c-aa16-99918e1d3528'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:32.200429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8add00b-e2f5-49c2-a550-cc224dfa4eda admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.208626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709ba1dd2e6b42568f31073a18b238b2', 'request_id': 'req-b8525720-9007-4c6c-aa16-99918e1d3528'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:32.235952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] The token cache is being invalidate because project 709ba1dd2e6b42568f31073a18b238b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:32.236260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:32.237073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:32.239916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1127/2245] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:31 2022] DELETE /identity/v3/projects/709ba1dd2e6b42568f31073a18b238b2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:32.244597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.246746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.295186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.295848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.296645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.296645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.298374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.410208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8525720-9007-4c6c-aa16-99918e1d3528 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.423555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.424254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.424577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.424860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.425577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.427502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a3669-fc13-41f3-b1bf-932604fbf15d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.469310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.471957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.493180 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1128/2246] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:32.493180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84fc9-7a15-401f-be56-8bebf15f7d45 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.493180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84fc9-7a15-401f-be56-8bebf15f7d45 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.493566 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1119/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:32.493659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84fc9-7a15-401f-be56-8bebf15f7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.495025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.505929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7eaad-b6d8-4197-a5a8-18c3509bbd79 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.542117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bfc84fc9-7a15-401f-be56-8bebf15f7d45 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:32.543599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bfc84fc9-7a15-401f-be56-8bebf15f7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.611180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.612319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.612819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.613256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.614098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.617390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.644771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1129/2248] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:32.652851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.653615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.654190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.670077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1120/2249] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:32.670954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.675986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:32.677531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.689109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a745731-44cb-4a46-9694-d750b106a7a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.694055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.694739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.695017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.695292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.696776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.698457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.712946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1121/2250] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:32.716847 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1130/2251] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:32.718054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.718680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.729460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aca81-0cc6-40cf-8a57-4708f2c11fb1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.734801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.735478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.735766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.736045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.737192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:32.737192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.737711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bcb0c-7a5a-43e1-8701-ae0cc97aa568 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.738689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.746335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.747630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.748115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.748564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.749711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.755685 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1131/2252] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:32.756915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.758116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.776502 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1122/2253] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:32.777470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f7eeb-6af7-4c44-9bcf-8a8cbb314eb3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.780376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.790149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.790985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.791341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.791701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.792614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.794799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.795409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a27f8-1a58-4462-8cb4-f1369a3d47a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.801515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.802880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.803315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.803757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] PATH_INFO: `/v3/projects/3a79a409571c4c9989b0843b6accacc8/users/11806992d3fd46aaa4989654399985e9/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.827104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a79a409571c4c9989b0843b6accacc8, user_id=11806992d3fd46aaa4989654399985e9, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:32.831944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac3de5-a5b8-4b03-a1cc-ab122e0dc5d9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:32.843287 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1132/2254] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/projects => generated 399 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:32.847399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:32.868722 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1123/2255] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:32 2022] PUT /identity/v3/projects/3a79a409571c4c9989b0843b6accacc8/users/11806992d3fd46aaa4989654399985e9/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:32.878894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.879448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.880860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.924195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916df2f7-90ec-4c03-9b3f-8dfa42405fa8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:32.954949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] MFA Rules not processed for user `11806992d3fd46aaa4989654399985e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:32.956409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:32.995564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:32.996932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:32.997397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:32.997864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:32.998924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.001508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.028971 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1133/2256] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:33.030297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.033563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.049405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14c80b-39c0-428a-ac95-92503d22e057 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.055633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.056745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.057386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.057822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] PATH_INFO: `/v3/users/803118f9c12e4f36a0e7b8872abf6007` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.060511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] RBAC: Authorizing `identity:delete_user(user_id=803118f9c12e4f36a0e7b8872abf6007)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.062862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.067826 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1124/2257] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:33.072653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.089232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b17de9-aca2-4034-b3d9-e306ed3e7438 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.095968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.096765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.097376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.097376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.101527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.104410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.120375 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1125/2258] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:33.121627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.122349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803118f9c12e4f36a0e7b8872abf6007'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.134050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803118f9c12e4f36a0e7b8872abf6007'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.135178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803118f9c12e4f36a0e7b8872abf6007'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.136576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803118f9c12e4f36a0e7b8872abf6007'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.137731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9789e7d-e512-445d-8905-e2f3aec9112d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.144372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.146258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.146720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.147161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.148146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803118f9c12e4f36a0e7b8872abf6007'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.148537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.151600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26005-7ba3-4554-90ed-b55e17ad5e59 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.177709 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1134/2259] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:33 2022] DELETE /identity/v3/users/803118f9c12e4f36a0e7b8872abf6007 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:33.186358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.189146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.207154 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1126/2260] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:33 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:33.207154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.207154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.207154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.231679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:33.233084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.297116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08883010-a1df-4395-8804-d4e321aa595b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.363920 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1127/2261] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:33.363920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.369407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.400306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd44dcc-bd81-448b-900c-73ad5edba3b0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.408841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.409892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.410557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.411069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.412183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.414480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.448008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.449497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.449792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.450079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.463712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.463712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.466422 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1128/2262] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:33 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:33.468155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.470082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.483839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1135/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:33.483839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.494689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60226ac8-a334-4057-a963-b655a9a5f2d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.500108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.500913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.501264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.501600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.502460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.504321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.517707 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1136/2264] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:33.518720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.538944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4695fc-1901-43c1-b889-8632eb96fa42 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.553170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.554316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.554605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.554886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] PATH_INFO: `/v3/projects/cb35175e41264b7cb3ca65aea6b25361/users/a3732d6d73c544b9b0f1a89f1eeadc8d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.579823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5325a-3b4a-4dc0-9bb9-de9869bb9e33 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.591384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.592064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.592417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.592922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.598883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb35175e41264b7cb3ca65aea6b25361, user_id=a3732d6d73c544b9b0f1a89f1eeadc8d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.601776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.609084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.610755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.638485 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1137/2265] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:33 2022] PUT /identity/v3/projects/cb35175e41264b7cb3ca65aea6b25361/users/a3732d6d73c544b9b0f1a89f1eeadc8d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:33.638485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.651753 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1129/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:33.652754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.659628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.675368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1625e-03b6-4a7e-ada4-8b601c4c59e0 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.730764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed905de5-385f-462f-8597-d81c85b5a0f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.736429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.737518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.737807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.738094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] PATH_INFO: `/v3/projects/83be0892990d4db087ad8d6294ae0047/users/daec37de8cf14dc38f6f51ba8f4937da/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.756518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83be0892990d4db087ad8d6294ae0047, user_id=daec37de8cf14dc38f6f51ba8f4937da, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.760009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bb7ec-1dbf-4ad8-9e05-706acff6bd2f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.782698 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1138/2267] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:33 2022] PUT /identity/v3/projects/83be0892990d4db087ad8d6294ae0047/users/daec37de8cf14dc38f6f51ba8f4937da/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:33.784019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:33.784926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.785212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.785533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] PATH_INFO: `/v3/projects/ce16d6684bbf4f0eb8223f7a65631ccc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.786797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:33.787080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:33.787352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:33.790154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce16d6684bbf4f0eb8223f7a65631ccc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:33.794361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:33.807140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:33.808764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.882228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce16d6684bbf4f0eb8223f7a65631ccc', 'request_id': 'req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.891002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1139/2268] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:33.891002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.891237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce16d6684bbf4f0eb8223f7a65631ccc', 'request_id': 'req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.896105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce16d6684bbf4f0eb8223f7a65631ccc', 'request_id': 'req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.910438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6166-d38a-4d54-a3ce-e697f1fbf853 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:33.915186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] The token cache is being invalidate because project ce16d6684bbf4f0eb8223f7a65631ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:33.915966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.917308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:33.922336 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1130/2269] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:33 2022] DELETE /identity/v3/projects/ce16d6684bbf4f0eb8223f7a65631ccc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:33.923023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:33.925168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:33.998665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b5f4-36eb-4e79-804b-04cfde63fbcc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.001014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.002797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.003231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.003769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.004814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.005322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.005673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.006029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.006774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.009320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.010160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.024413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.025229 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1140/2270] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:34.026398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:34.028746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.042221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.046231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a429fb-5a9b-4b37-bd2e-be3a96bba6c7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.056698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.057696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.058757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.059063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] PATH_INFO: `/v3/users/74d0ec9434174c27aeb12384a073bb05` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.060892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d0ec9434174c27aeb12384a073bb05)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.062315 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1131/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:34.063311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:34.063450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.065799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.083019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546bc2-c968-499f-a9b9-573dcbb1d998 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.088957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.090096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.090727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.091162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] PATH_INFO: `/v3/projects/83be0892990d4db087ad8d6294ae0047/users/daec37de8cf14dc38f6f51ba8f4937da/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.093614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83be0892990d4db087ad8d6294ae0047, user_id=daec37de8cf14dc38f6f51ba8f4937da, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.096805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3ed5-729b-4de7-bd27-3e43256af3cd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.113639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1132/2272] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:34 2022] PUT /identity/v3/projects/83be0892990d4db087ad8d6294ae0047/users/daec37de8cf14dc38f6f51ba8f4937da/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:34.127147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.127473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.127688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.148766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d0ec9434174c27aeb12384a073bb05'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.162217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d0ec9434174c27aeb12384a073bb05'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.170852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] MFA Rules not processed for user `daec37de8cf14dc38f6f51ba8f4937da`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:34.172145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.173135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d0ec9434174c27aeb12384a073bb05'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.178032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d0ec9434174c27aeb12384a073bb05'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.191979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d0ec9434174c27aeb12384a073bb05'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.225321 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1141/2273] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:34 2022] DELETE /identity/v3/users/74d0ec9434174c27aeb12384a073bb05 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:34.270352 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1133/2274] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:34.285491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:34.287171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.393909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edfe04-df2a-4761-83f1-9c91253c7dad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.401782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.402592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.402989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.403373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.490404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.492010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.521466 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1142/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:34.587645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:34.589707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.702656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868274-45c8-4d01-aefc-f0fce8611911 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.799513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:34.801003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.801323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.801610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] PATH_INFO: `/v3/projects/a20461c81df249d49f39a4137ddefcd5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.803605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20461c81df249d49f39a4137ddefcd5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:34.811210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:34.880767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20461c81df249d49f39a4137ddefcd5', 'request_id': 'req-c1815150-e6a6-4c8a-8639-d792f637d991'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.888776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20461c81df249d49f39a4137ddefcd5', 'request_id': 'req-c1815150-e6a6-4c8a-8639-d792f637d991'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.895532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20461c81df249d49f39a4137ddefcd5', 'request_id': 'req-c1815150-e6a6-4c8a-8639-d792f637d991'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.905615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:34.907304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:34.911143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] The token cache is being invalidate because project a20461c81df249d49f39a4137ddefcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:34.911375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.912070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1815150-e6a6-4c8a-8639-d792f637d991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:34.917912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1134/2276] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:34 2022] DELETE /identity/v3/projects/a20461c81df249d49f39a4137ddefcd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:34.919355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d497a-f677-4ea1-b723-0ae6114abaa6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:34.919654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d497a-f677-4ea1-b723-0ae6114abaa6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:34.919935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d497a-f677-4ea1-b723-0ae6114abaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:34.924409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566dd16-2d72-4db4-abac-5a1d41489d91 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:34.953051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-784d497a-f677-4ea1-b723-0ae6114abaa6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:34.954283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-784d497a-f677-4ea1-b723-0ae6114abaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.015750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.017250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.017906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.018385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.021192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.146935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1135/2277] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:35.157941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.158241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.158569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.196543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:35.200178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.200979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.205940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.215477 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1136/2278] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:35.216643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.218517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.231114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1143/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:35.232402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.251699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dccf6-9fbc-4f3d-ac68-d98f1a700219 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.255236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f5b1-a430-41ba-9c5f-f3634c5b7e3f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.261724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.262807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.263188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.263580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.264528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:35.264996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.266823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.269467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.270243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.270534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.270812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] PATH_INFO: `/v3/projects/6feca2ef39044127853c20cf5eef04db` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.276018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6feca2ef39044127853c20cf5eef04db)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.277993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.300744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1144/2280] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:35.307215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.324358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eceb13-284a-4581-9c47-9c4ba12f80e2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.350485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.352712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.352712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.352712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.367157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.373563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.375717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6feca2ef39044127853c20cf5eef04db', 'request_id': 'req-3a9dbf86-cfb3-4100-9e4e-8047745ba785'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.386992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6feca2ef39044127853c20cf5eef04db', 'request_id': 'req-3a9dbf86-cfb3-4100-9e4e-8047745ba785'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.406859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6feca2ef39044127853c20cf5eef04db', 'request_id': 'req-3a9dbf86-cfb3-4100-9e4e-8047745ba785'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.434791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] The token cache is being invalidate because project 6feca2ef39044127853c20cf5eef04db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:35.435087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.436958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3a9dbf86-cfb3-4100-9e4e-8047745ba785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.442701 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1137/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:35 2022] DELETE /identity/v3/projects/6feca2ef39044127853c20cf5eef04db => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:35.444663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.444937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.445235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.461020 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1145/2282] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:35.461020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.463639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.501941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:35.507609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.563483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adae14-f1f7-4a81-8630-e088010a78d6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.569068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.570153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.570515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.570906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.572393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.574492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.606527 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1146/2283] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:35.617786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.648737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1138/2284] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:35.651538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.651685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299075a-dde3-4b9a-ac44-4b64cacb0d2e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.655574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.661157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.661853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.662138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.662417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.663307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.665239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5ae08-251b-4970-ad40-26c369caa30f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.678183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ef045-f832-4f66-b8ef-c8305a25188b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.688871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1147/2285] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:35.689325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.689629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.689756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.689920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.691043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.692159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.693152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] PATH_INFO: `/v3/users/11806992d3fd46aaa4989654399985e9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.694950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11806992d3fd46aaa4989654399985e9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.700071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.713631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:35.714882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.724355 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1148/2286] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:35.725398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.736817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374047c1-47d4-4120-9d28-3f691e72505c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.743794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.744519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.744812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.745108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.745838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.747459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.770413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1149/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:35.770413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.790607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78e8e1-4142-4cf9-9f0b-ceb4a84d37db admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.795178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.795883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.796175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.796503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.797228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:35.797544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.799473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.814853 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1150/2288] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:35.815955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.824743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11806992d3fd46aaa4989654399985e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.843616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11806992d3fd46aaa4989654399985e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.845339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1f22a-c128-476a-b672-53446810a8dd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:35.846275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11806992d3fd46aaa4989654399985e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.859831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11806992d3fd46aaa4989654399985e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.863985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:35.865044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.865359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.865639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] PATH_INFO: `/v3/projects/d64a68c4487249c3835dff411ea414fa/users/6f68231211ca42b686402291b224543e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.871300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11806992d3fd46aaa4989654399985e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:35.886092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64a68c4487249c3835dff411ea414fa, user_id=6f68231211ca42b686402291b224543e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:35.889594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3c26-b0ea-4c3f-9f4d-2e78aa76b052 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:35.907196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1139/2289] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:35 2022] DELETE /identity/v3/users/11806992d3fd46aaa4989654399985e9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:35.907196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:35.909311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:35.913645 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1151/2290] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:35 2022] PUT /identity/v3/projects/d64a68c4487249c3835dff411ea414fa/users/6f68231211ca42b686402291b224543e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:35.915232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdb17-e5df-4bc5-9687-1fc7e48a6c05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:35.915526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdb17-e5df-4bc5-9687-1fc7e48a6c05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:35.915806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fdb17-e5df-4bc5-9687-1fc7e48a6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:35.961322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c3fdb17-e5df-4bc5-9687-1fc7e48a6c05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:35.964282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c3fdb17-e5df-4bc5-9687-1fc7e48a6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:36.066222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64560-e42b-4153-b736-85520aaa4d2d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.152668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1152/2291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:36.158002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.158541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.158980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.202928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.203573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.203865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.204153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.207054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.212855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.233757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] MFA Rules not processed for user `6f68231211ca42b686402291b224543e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:36.237568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:36.276507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1140/2292] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:35 2022] POST /identity/v3/projects => generated 375 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:36.277410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.288575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:36.371359 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1153/2293] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:36.373193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.412044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650cd29-6631-4a36-b250-bf7e11cf620f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.429713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475619a-a62c-436b-9917-a5d3f3ddffd9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.459602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.460532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.461009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.461470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.549629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.550484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.550871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.551868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.553010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.557110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.564726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.569694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.590060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1141/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:36.591987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.593971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:36.602502 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1154/2295] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:36 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:36.606673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.621806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6174a-258e-4ff5-af20-e15aa8202118 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.627016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.627829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.628335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.628741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.629792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.631297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.650530 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1155/2296] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:36.654465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.677932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea015-00dd-424a-a98c-9d6d578317d1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.691188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.692253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.693478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.694525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.696807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.700583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.722026 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1156/2297] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:36.723096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:36.741124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae565-7994-48da-b9e1-b4f9cff144cf service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.744714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aca02-1ffe-43b0-915d-2a750a57faf4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:36.752953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.753767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.754954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.755689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:36.756078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.758210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.759188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.759558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] PATH_INFO: `/v3/projects/38e81bc12e244167b6e8410e634607aa/users/34854e39546b41e98704f26501d8c8ab/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.779006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e81bc12e244167b6e8410e634607aa, user_id=34854e39546b41e98704f26501d8c8ab, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.783347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c68b08-0495-4d32-ac31-9e646ecf3de9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.811706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1157/2298] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:36 2022] PUT /identity/v3/projects/38e81bc12e244167b6e8410e634607aa/users/34854e39546b41e98704f26501d8c8ab/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:36.818528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eef0f-2d07-4c8a-9f3a-3bbaba7127f2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:36.824670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eef0f-2d07-4c8a-9f3a-3bbaba7127f2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:36.825724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eef0f-2d07-4c8a-9f3a-3bbaba7127f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:36.871139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e7eef0f-2d07-4c8a-9f3a-3bbaba7127f2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:36.872746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e7eef0f-2d07-4c8a-9f3a-3bbaba7127f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:36.928707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:36.936539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:36.952846 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1142/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:37.035864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1158/2300] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:37.067542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:37.092414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42786a45-6d61-4ef5-85bc-1088b4adb63d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:37.198670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3221-16d2-40e6-ae34-fa6696b6f941 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:37.199560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3221-16d2-40e6-ae34-fa6696b6f941 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:37.200049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b3221-16d2-40e6-ae34-fa6696b6f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:37.208316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:37.209017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:37.209303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:37.209581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:37.220720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:37.222224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:37.236329 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1143/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:37.237180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f7b3221-16d2-40e6-ae34-fa6696b6f941 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:37.238657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f7b3221-16d2-40e6-ae34-fa6696b6f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:37.324065 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1159/2302] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:37.339855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:37.341926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:37.492335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54eb34-ed65-4711-b5dd-75285975ce87 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:37.505632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:37.506347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:37.506632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:37.506908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:37.528133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:37.531842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:37.553066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1144/2303] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:37.761049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:37.761395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:37.761655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:37.787810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] MFA Rules not processed for user `6f68231211ca42b686402291b224543e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:37.788845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:37.861410 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1160/2304] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:38.006059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:38.007648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:38.021955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30555-d2ce-46bc-8bcd-d87cc99ea9e2 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:38.027185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:38.028517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:38.028517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:38.028718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] PATH_INFO: `/v3/projects/3a79a409571c4c9989b0843b6accacc8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:38.029826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a79a409571c4c9989b0843b6accacc8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:38.031744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:38.130741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a79a409571c4c9989b0843b6accacc8', 'request_id': 'req-70eae300-dcc4-41eb-a711-eb6ce33ae15d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.144504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a79a409571c4c9989b0843b6accacc8', 'request_id': 'req-70eae300-dcc4-41eb-a711-eb6ce33ae15d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.153393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a79a409571c4c9989b0843b6accacc8', 'request_id': 'req-70eae300-dcc4-41eb-a711-eb6ce33ae15d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.172315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] The token cache is being invalidate because project 3a79a409571c4c9989b0843b6accacc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:38.173532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.174193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-70eae300-dcc4-41eb-a711-eb6ce33ae15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.180949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:38.182044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1145/2305] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:38 2022] DELETE /identity/v3/projects/3a79a409571c4c9989b0843b6accacc8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:38.193746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea148444-bc07-4182-81fe-0ca06f0fc1f7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:38.278134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:38.278964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:38.279256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:38.279546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] PATH_INFO: `/v3/users/daec37de8cf14dc38f6f51ba8f4937da` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:38.280813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=daec37de8cf14dc38f6f51ba8f4937da)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:38.282786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:38.396094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daec37de8cf14dc38f6f51ba8f4937da'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.413909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daec37de8cf14dc38f6f51ba8f4937da'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.415692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daec37de8cf14dc38f6f51ba8f4937da'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.416590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daec37de8cf14dc38f6f51ba8f4937da'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.426991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daec37de8cf14dc38f6f51ba8f4937da'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:38.479631 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1161/2306] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:38 2022] DELETE /identity/v3/users/daec37de8cf14dc38f6f51ba8f4937da => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:38.538639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:38.539045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:38.539902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:38.574187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:38.575553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:38.714588 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1146/2307] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:38.732954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:38.734426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:38.839648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1d33f-b497-4412-b02e-d36436bea8fb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:38.846570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:38.847368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:38.847670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:38.848133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:38.859430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:38.861701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56793457-ced3-45ca-a680-cb8cf2cfe729 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:38.874605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1162/2308] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:39.298748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:39.300706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:39.487358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22172c38-2112-4acc-9f3a-2ab45e3e1522 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:39.497983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:39.499245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:39.499562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:39.499925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] PATH_INFO: `/v3/users/6f68231211ca42b686402291b224543e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:39.503667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f68231211ca42b686402291b224543e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:39.509705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:39.638887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f68231211ca42b686402291b224543e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:39.677769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f68231211ca42b686402291b224543e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:39.678908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f68231211ca42b686402291b224543e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:39.696712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f68231211ca42b686402291b224543e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:39.729550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f68231211ca42b686402291b224543e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:39.746859 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1147/2309] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:39 2022] DELETE /identity/v3/users/6f68231211ca42b686402291b224543e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:39.752604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:39.755163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:39.755709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:39.789889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:39.796240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:39.984411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1163/2310] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:40.071928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.074209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:40.100917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.102759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:40.129125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e49d-398a-4d41-bff8-4a2d516524d3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:40.153454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:40.155139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.155684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.156192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] PATH_INFO: `/v3/projects/83be0892990d4db087ad8d6294ae0047` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.161231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=83be0892990d4db087ad8d6294ae0047)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:40.163513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:40.256446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408ee5-1a97-408f-b366-47d8b27be0f0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:40.277551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83be0892990d4db087ad8d6294ae0047', 'request_id': 'req-3336ea11-58cd-458c-9916-36d8464019ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:40.284938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83be0892990d4db087ad8d6294ae0047', 'request_id': 'req-3336ea11-58cd-458c-9916-36d8464019ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:40.295597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83be0892990d4db087ad8d6294ae0047', 'request_id': 'req-3336ea11-58cd-458c-9916-36d8464019ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:40.311001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] The token cache is being invalidate because project 83be0892990d4db087ad8d6294ae0047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:40.311526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:40.312356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3336ea11-58cd-458c-9916-36d8464019ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:40.314373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1164/2311] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:40 2022] DELETE /identity/v3/projects/83be0892990d4db087ad8d6294ae0047 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:40.319710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed02-fbb7-4661-ac78-0323af0c4c2e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.320823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed02-fbb7-4661-ac78-0323af0c4c2e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.320823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed02-fbb7-4661-ac78-0323af0c4c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.341616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:40.343926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.344328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.345253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.347957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:40.360609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8c94ed02-fbb7-4661-ac78-0323af0c4c2e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:40.362286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c94ed02-fbb7-4661-ac78-0323af0c4c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:40.567580 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1165/2312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:40.569165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.572741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.573039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.581832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:40.585536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:40.611459 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1148/2313] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:40.615145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:40.616611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:40.633754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.643968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1166/2314] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:40.651479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a8ea-8fd3-4cfd-900f-5c3292191112 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:40.658153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:40.659095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.659532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.659985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.662605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:40.663392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:40.666538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:40.689552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.697783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1149/2315] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:40.702406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a6c67-f0ab-4e34-a543-c6b8bef6a3da None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:40.709603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:40.710385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.710750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.711854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.713264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:40.714858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:40.768445 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1167/2316] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:40 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:40.774127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.786005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1fc96-f80e-45e1-a0c1-e8319d713a39 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:40.906328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:40.907020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:40.907969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:40.907969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:40.909101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:40.911167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:40.961133 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1150/2317] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:40 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:40.962512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:40.980584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637ccf8-11e6-4d7d-88b0-cf2634b5520e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.002069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.004435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.004759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.006186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.007155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.010402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.042369 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1168/2318] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:41.043886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.062071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826b8e-dd97-455a-a479-74406e226dec admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.079119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.079846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.080130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.080408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.081175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.086998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2f09f-865e-49ba-a4f1-e8b947cee15b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.109576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1151/2319] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:41.113773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.129916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7587d-a27e-48b1-8961-41ed1d6efd84 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.145890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.146920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.147215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.147494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] PATH_INFO: `/v3/projects/0140cd55dde64802a079e71ca0012604/users/5e52786e465c4a9981adfb9f5077b50e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.182763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0140cd55dde64802a079e71ca0012604, user_id=5e52786e465c4a9981adfb9f5077b50e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.189008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.219378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1169/2320] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:41 2022] PUT /identity/v3/projects/0140cd55dde64802a079e71ca0012604/users/5e52786e465c4a9981adfb9f5077b50e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:41.236588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.236886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.237168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.297557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] MFA Rules not processed for user `5e52786e465c4a9981adfb9f5077b50e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:41.298906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:41.417259 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1152/2321] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:41.421800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.530091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddd19-2f5a-4deb-b8c3-dcf16be72813 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.544436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.546082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.546668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.546953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.549131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.551536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.620225 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1170/2322] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:41 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:41.624088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.637888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca26fe-782d-4635-ae9a-53d456282488 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.767072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.768986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.769283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.770074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.771319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.774354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.817754 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1153/2323] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:41 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:41.821906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.844544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205283b1-92b0-475e-9ad5-b8d19f16b3f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.851902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.852951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.853458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.853983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.854983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.857158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.869473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1171/2324] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:41.873670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.887916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b8762-d607-48ff-a73a-778f80bfd4d8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:41.898380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:41.900537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:41.901272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:41.901717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] PATH_INFO: `/v3/projects/e82c61a5452449679f698f4aa7eae49d/users/294505f0eeff42668b9007115d94898b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:41.933032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82c61a5452449679f698f4aa7eae49d, user_id=294505f0eeff42668b9007115d94898b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:41.938793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:41.969591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1154/2325] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:41 2022] PUT /identity/v3/projects/e82c61a5452449679f698f4aa7eae49d/users/294505f0eeff42668b9007115d94898b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:41.973365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:41.990285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c41a-17fe-48dd-a5eb-946d9fa7266a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:42.075460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:42.076950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.077292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.078106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.078848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:42.080633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08e6b-09b5-4d99-9b04-563f8a1f149f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:42.097302 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1172/2326] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:42.102636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:42.126631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66280e9-ba32-4f90-bfcf-8e1ad1259378 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:42.135914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:42.137145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.137429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.137707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] PATH_INFO: `/v3/projects/e82c61a5452449679f698f4aa7eae49d/users/294505f0eeff42668b9007115d94898b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.139939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82c61a5452449679f698f4aa7eae49d, user_id=294505f0eeff42668b9007115d94898b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:42.144733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:42.160212 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1155/2327] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:42 2022] PUT /identity/v3/projects/e82c61a5452449679f698f4aa7eae49d/users/294505f0eeff42668b9007115d94898b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:42.170210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.170885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.171323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.226237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] MFA Rules not processed for user `294505f0eeff42668b9007115d94898b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:42.228891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:42.331845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:42.334556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:42.353998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1173/2328] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:42.370614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:42.373024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:42.506138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4d87f-b5a9-4fbd-90df-d4e2a3cf0398 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:42.515505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:42.515892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.519611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.519945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] PATH_INFO: `/v3/projects/d64a68c4487249c3835dff411ea414fa` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.525295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64a68c4487249c3835dff411ea414fa)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:42.530441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:42.600560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04f0d-9750-4cf3-9f3b-30f1893f10b3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:42.629647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:42.630207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.630490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.630819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.672511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:42.674193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb7d8e-4990-472a-ae74-dec92c56843c service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:42.685221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64a68c4487249c3835dff411ea414fa', 'request_id': 'req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:42.713126 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1174/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:42.748498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64a68c4487249c3835dff411ea414fa', 'request_id': 'req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:42.762222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64a68c4487249c3835dff411ea414fa', 'request_id': 'req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:42.802191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] The token cache is being invalidate because project d64a68c4487249c3835dff411ea414fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:42.802495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:42.803357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab82266e-26f8-4f40-bfe7-852f0ba0e8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:42.808512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1156/2330] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:42 2022] DELETE /identity/v3/projects/d64a68c4487249c3835dff411ea414fa => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:42.813329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a2aa-b3f4-487e-b5ff-f3091b04005c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.813657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a2aa-b3f4-487e-b5ff-f3091b04005c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.813928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a2aa-b3f4-487e-b5ff-f3091b04005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.844395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-30f5a2aa-b3f4-487e-b5ff-f3091b04005c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:42.848120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-30f5a2aa-b3f4-487e-b5ff-f3091b04005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:42.989872 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1175/2331] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:42.989995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.989995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.989995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:42.994239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:42.994535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:42.994816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.068591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:43.069942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:43.075480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] MFA Rules not processed for user `a3732d6d73c544b9b0f1a89f1eeadc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:43.078142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:43.093023 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1176/2332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:43.095446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.137492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c2bd-d197-4560-9980-ed7f50cbfa6f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.153021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.153541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.153823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.154132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.154928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:43.155480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.160386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.192089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1177/2333] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:43.196201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.211291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743cf8-7c0a-453e-b902-98ca501d8725 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.227362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.228043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.228324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.228620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.230365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.238174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.252298 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1157/2334] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:43.291932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1178/2335] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:43.296245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.308310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ef02-c5df-42e4-ad72-1d695ea18b52 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.385773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.386826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.388374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.388712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.389613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.395271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.428085 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1158/2336] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:43 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:43.431723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.449380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d399fe-d8bd-481b-ab6b-a761bd6b44a2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.459084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.461202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.461508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.461792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.462660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.465363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.480514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1179/2337] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:43.483741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.498736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bab49-ac97-452a-b54d-559ca79ec401 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.510959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.511662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.512099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.513034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.517253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.519952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.538538 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1159/2338] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:43.540871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.557611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd879b-230a-44ed-864d-91c922cdf645 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.562603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.563704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.563988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.564266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] PATH_INFO: `/v3/projects/c2496c2b222148dfad37efb60e08356b/users/681f1a15a4a94f5ea8e9762494c953ae/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.579645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:43.581429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:43.605728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2496c2b222148dfad37efb60e08356b, user_id=681f1a15a4a94f5ea8e9762494c953ae, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.610453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e18f0-3c8e-4620-8443-f29bcabfc4f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.629827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1180/2339] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:43 2022] PUT /identity/v3/projects/c2496c2b222148dfad37efb60e08356b/users/681f1a15a4a94f5ea8e9762494c953ae/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:43.641909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.642542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.643029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.691695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] MFA Rules not processed for user `681f1a15a4a94f5ea8e9762494c953ae`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:43.693443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:43.703865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7b4d4-fe5d-43be-b254-c4ef1f26dda2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:43.779143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:43.780082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:43.780367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:43.780723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:43.783095 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1181/2340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:43.847897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:43.857777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:43.874550 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1160/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:44.067303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:44.072121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:44.073114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:44.073603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:44.099355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7482549-b789-46e3-9202-c735c62c7b0c service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:44.112577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:44.113247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:44.113526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:44.113799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:44.137728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:44.139534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:44.164850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1161/2342] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:44.240148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18ceb-018d-4a72-a325-fc36a4fdead9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:44.257787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:44.259588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:44.260063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:44.260602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] PATH_INFO: `/v3/users/5e52786e465c4a9981adfb9f5077b50e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:44.264316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e52786e465c4a9981adfb9f5077b50e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:44.270850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:44.383542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e52786e465c4a9981adfb9f5077b50e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:44.400203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e52786e465c4a9981adfb9f5077b50e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:44.400940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e52786e465c4a9981adfb9f5077b50e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:44.401742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e52786e465c4a9981adfb9f5077b50e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:44.414554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e55bc53-bc3f-48f7-bbcf-a3ed8f581e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e52786e465c4a9981adfb9f5077b50e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:44.467794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:44.473251 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1182/2343] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:44 2022] DELETE /identity/v3/users/5e52786e465c4a9981adfb9f5077b50e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:44.478392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:44.478693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:44.479352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:44.491314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c34fa-8576-4422-b89a-99b35c405ac9 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:44.556607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:44.559312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:44.650010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:44.650998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:44.651597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:44.652035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:44.661229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:44.674918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1183/2344] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:44.703099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:44.706694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:44.814424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:44.817042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:44.850251 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1162/2345] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:44.865833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2223f-c7c5-47b3-8cb3-06cba5ee3949 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:44.870465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:44.871205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:44.871422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:44.871702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:44.895477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:44.897100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:44.923435 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1184/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:46.997420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:46.999244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:47.024182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cf4b9-9f8a-45f3-a746-ecd496f4c64b service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:47.030829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:47.032868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:47.033432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:47.033998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] PATH_INFO: `/v3/projects/0140cd55dde64802a079e71ca0012604` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:47.035393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0140cd55dde64802a079e71ca0012604)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:47.037633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:47.109653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0140cd55dde64802a079e71ca0012604', 'request_id': 'req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.137288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0140cd55dde64802a079e71ca0012604', 'request_id': 'req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.156860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0140cd55dde64802a079e71ca0012604', 'request_id': 'req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.183226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] The token cache is being invalidate because project 0140cd55dde64802a079e71ca0012604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:47.183856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.184867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dd16ad3d-4877-4d0a-8a41-eb0c699466a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.187050 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1163/2347] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:46 2022] DELETE /identity/v3/projects/0140cd55dde64802a079e71ca0012604 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:47.191623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:47.211320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928513-15f3-45b1-bf04-38d75943cd92 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:47.481703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:47.482059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:47.482059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:47.482315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] PATH_INFO: `/v3/users/294505f0eeff42668b9007115d94898b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:47.488722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294505f0eeff42668b9007115d94898b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:47.490717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:47.615361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294505f0eeff42668b9007115d94898b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.639779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294505f0eeff42668b9007115d94898b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.640695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294505f0eeff42668b9007115d94898b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.643972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294505f0eeff42668b9007115d94898b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.666143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16aa66d1-4514-487f-8190-1a4e831e2bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294505f0eeff42668b9007115d94898b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:47.726516 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1185/2348] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:47 2022] DELETE /identity/v3/users/294505f0eeff42668b9007115d94898b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:47.888835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:47.889505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:47.890016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:47.893436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1164/2349] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:52:47.904807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e19-74bb-4b9c-b918-d6c81fdaa877 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:47.905106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e19-74bb-4b9c-b918-d6c81fdaa877 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:47.905392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8e19-74bb-4b9c-b918-d6c81fdaa877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:48.072785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c98a8e19-74bb-4b9c-b918-d6c81fdaa877 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:48.078811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c98a8e19-74bb-4b9c-b918-d6c81fdaa877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:48.280789 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1186/2350] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:48.294981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:48.296881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:48.348022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d931-5e7a-4704-9544-e02fe04ae962 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:48.364407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:48.365137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:48.365418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:48.365705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:48.389806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf687a15-c21d-41be-938b-d5abc6202f8b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:48.390136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf687a15-c21d-41be-938b-d5abc6202f8b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:48.390381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf687a15-c21d-41be-938b-d5abc6202f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:48.394330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:48.396049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:48.420916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1165/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:48.472606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cf687a15-c21d-41be-938b-d5abc6202f8b None None] MFA Rules not processed for user `34854e39546b41e98704f26501d8c8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:48.479468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf687a15-c21d-41be-938b-d5abc6202f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:48.746711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:48.758857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464356f9-79d6-4fea-9258-b7fb4d941284 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:48.774865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:48.775989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:48.776545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:48.778527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:48.780838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:48.796625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:48.798513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:48.836886 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1166/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:48.840302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:48.844844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.015841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1187/2353] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 627 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:49.059905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdfb9-68c7-4a32-9242-7e4777c52192 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:49.087670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:49.090203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.092785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.093191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] PATH_INFO: `/v3/projects/e82c61a5452449679f698f4aa7eae49d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.097648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82c61a5452449679f698f4aa7eae49d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:49.111194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:49.247451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82c61a5452449679f698f4aa7eae49d', 'request_id': 'req-fc510f32-52d3-4416-bf4a-ae1ca2034d40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:49.258822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82c61a5452449679f698f4aa7eae49d', 'request_id': 'req-fc510f32-52d3-4416-bf4a-ae1ca2034d40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:49.274519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82c61a5452449679f698f4aa7eae49d', 'request_id': 'req-fc510f32-52d3-4416-bf4a-ae1ca2034d40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:49.311250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] The token cache is being invalidate because project e82c61a5452449679f698f4aa7eae49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:49.311882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:49.312314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc510f32-52d3-4416-bf4a-ae1ca2034d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:49.314345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1167/2354] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:48 2022] DELETE /identity/v3/projects/e82c61a5452449679f698f4aa7eae49d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:49.323589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2067fb5-0908-4191-9aaa-25edd76e7f48 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.324087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2067fb5-0908-4191-9aaa-25edd76e7f48 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.324626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2067fb5-0908-4191-9aaa-25edd76e7f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.373680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d2067fb5-0908-4191-9aaa-25edd76e7f48 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:49.374904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2067fb5-0908-4191-9aaa-25edd76e7f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.446449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a94b10-2fd9-4bab-a5a9-40cad2fb0ece None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.446890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a94b10-2fd9-4bab-a5a9-40cad2fb0ece None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.447285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a94b10-2fd9-4bab-a5a9-40cad2fb0ece None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.449310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1168/2355] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:52:49.460040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.460489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.461575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.498593 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1188/2356] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:49.505232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:49.509134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.509422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.509698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.513756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.540735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:49.545066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.567222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1189/2357] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:49.572167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:49.586189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d40216-12a7-4ebc-8916-8587258f4677 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:49.609368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:49.610001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.610282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.610579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.611301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:49.611604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:49.613259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:49.641732 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1190/2358] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:52:49.642854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:49.662139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85445d28-f8fc-4f32-9c4e-156c7899d8be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:49.668185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:49.669785 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1169/2359] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:49.674437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.675070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.675188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.675863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:49.677826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:49.710453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:49.713988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.728749 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1191/2360] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:49 2022] POST /identity/v3/projects => generated 409 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:49.732100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:49.832412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd861e9-c470-4ff0-b21e-e705d143f73f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:49.880669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163751-7102-42b5-a80f-133f990764f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:49.888622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:49.889309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.889587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.889861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:49.890546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:49.892540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:49.929803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1192/2361] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:49 2022] POST /identity/v3/users => generated 305 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:49.929803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:49.934024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:49.940033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:49.941001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:49.941718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:49.942423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.064749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5df1-06b9-4ea9-9183-12e389c19d77 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.075147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.076070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.076347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.076646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.082287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:50.100940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.102971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.148062 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1170/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:50.161651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.184884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da046191-7182-483e-9015-bcdaba7e1dff service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.201504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.201812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.202112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.202357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.203080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.205188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.233810 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1171/2363] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:50.234963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.254229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04b97-ccfd-4aec-a605-3b23f97d7b20 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.265018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.265708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.265987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.266262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.266778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.266987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.269084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.270438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc9059-81e4-49d0-8ca5-9f31e8254f4f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.294088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1193/2364] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:50.298992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddee58d-bb23-416b-909f-c2325b0ef31b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.301947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddee58d-bb23-416b-909f-c2325b0ef31b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.302164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddee58d-bb23-416b-909f-c2325b0ef31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.307556 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1172/2365] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:50.308772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.320391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac5393-b5ad-4869-a461-e79a8a75ad7e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.331399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.332620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.332951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.333394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] PATH_INFO: `/v3/projects/ee9875c19e834d52b2f43c18e116140c/users/5e902cef0a67479090472d2bfa3bd928/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.343872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4ddee58d-bb23-416b-909f-c2325b0ef31b None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:50.346125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ddee58d-bb23-416b-909f-c2325b0ef31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:50.360397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9875c19e834d52b2f43c18e116140c, user_id=5e902cef0a67479090472d2bfa3bd928, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.361620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1194/2366] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:50.371331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.393263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1173/2367] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:50 2022] PUT /identity/v3/projects/ee9875c19e834d52b2f43c18e116140c/users/5e902cef0a67479090472d2bfa3bd928/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:50.404909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.405893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.406172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.435452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] MFA Rules not processed for user `5e902cef0a67479090472d2bfa3bd928`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:50.436719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:50.552047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1195/2368] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:50.557764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.661715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.661960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7b907-8a55-417d-84d1-d61620c847f4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.673190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.673924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.674212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.674487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.675236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.679334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.745558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1174/2369] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:50 2022] POST /identity/v3/projects => generated 407 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:50.746728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.771706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b828d-34b3-49a6-961a-d3959973d815 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.894613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.895301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.895577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.895853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.909632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f2a03-53f1-44a8-bcec-51ebc149e4b4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.913870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.918320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.921079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.921767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.922055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.925492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.927158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.929952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:50.932744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1196/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:50.954464 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1175/2371] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:50 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:50.958879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:50.973253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58e0c-eae2-4865-acfa-7fbb2d912fc5 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:50.983130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:50.984877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:50.985173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:50.985456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:50.986216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:50.987852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:51.033556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:51.043698 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1197/2372] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:51.053395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ada731-93e7-417d-8432-5be09e22ff3b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:51.072480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:51.073821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:51.074271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:51.074708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] PATH_INFO: `/v3/projects/aa0b17111e9c49b8949bb1703bcceec5/users/f63d8c6e30f04a179bad0d2eee203d07/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:51.107010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0b17111e9c49b8949bb1703bcceec5, user_id=f63d8c6e30f04a179bad0d2eee203d07, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:51.110018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:51.140272 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1176/2373] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:51 2022] PUT /identity/v3/projects/aa0b17111e9c49b8949bb1703bcceec5/users/f63d8c6e30f04a179bad0d2eee203d07/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:51.144321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:51.161736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08a68b-6a65-4f64-83f7-a60fbb7db756 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:51.231247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:51.232325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:51.232325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:51.232704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:51.233287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:51.235187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfb3e1-df03-4779-bc15-efd144074c0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:51.251454 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1198/2374] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:51.252829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:51.265342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c37497-dd26-4166-93a8-232acfb86cc5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:51.271966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:51.273171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:51.273354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:51.273997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] PATH_INFO: `/v3/projects/aa0b17111e9c49b8949bb1703bcceec5/users/f63d8c6e30f04a179bad0d2eee203d07/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:51.276286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0b17111e9c49b8949bb1703bcceec5, user_id=f63d8c6e30f04a179bad0d2eee203d07, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:51.279466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:51.296523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1177/2375] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:51 2022] PUT /identity/v3/projects/aa0b17111e9c49b8949bb1703bcceec5/users/f63d8c6e30f04a179bad0d2eee203d07/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:51.305863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a192a-2488-4247-bd9b-0ca95f737d4f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:51.310729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a192a-2488-4247-bd9b-0ca95f737d4f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:51.311273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a192a-2488-4247-bd9b-0ca95f737d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:51.369205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-180a192a-2488-4247-bd9b-0ca95f737d4f None None] MFA Rules not processed for user `f63d8c6e30f04a179bad0d2eee203d07`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:51.370477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-180a192a-2488-4247-bd9b-0ca95f737d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:51.531878 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1199/2376] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:52.127277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:52.129371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:52.325536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d2d18-cc03-46bf-8b11-9b36077d449e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:52.335191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:52.337418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:52.337894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:52.338349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] PATH_INFO: `/v3/users/b68e4ad966924cf98c972f0fc0704fc1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:52.341296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68e4ad966924cf98c972f0fc0704fc1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:52.343951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:52.464700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68e4ad966924cf98c972f0fc0704fc1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:52.500410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68e4ad966924cf98c972f0fc0704fc1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:52.501969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68e4ad966924cf98c972f0fc0704fc1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:52.529623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68e4ad966924cf98c972f0fc0704fc1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:52.547976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68e4ad966924cf98c972f0fc0704fc1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:52.559355 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1178/2377] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:52 2022] DELETE /identity/v3/users/b68e4ad966924cf98c972f0fc0704fc1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:52.561130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:52.561737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:52.562091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:52.601646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:52.608675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:52.735731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1200/2378] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:52.836674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:52.838680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:52.947790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:52.950107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:52.950941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea0c72-8381-474b-b24a-79249fe1be5a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:52.955565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:52.956882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:52.957284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:52.957748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:52.970747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:52.972566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:52.986222 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1179/2379] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:53.122330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1491439-46e5-4aaf-968e-f4853b70a720 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:53.129595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:53.130787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:53.131239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:53.131664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:53.134097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:53.277981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:53.281237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:53.302474 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1201/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:53.619621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:53.644208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4d1c8-808a-4a14-8f83-0e8039ec04cd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:53.656977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:53.658121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:53.658630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:53.659107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:53.663823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:53.783128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:53.787704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:53.821858 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1180/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:53 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:54.165616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.172068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.190237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe682bf-83b8-4a25-a9ba-35ce56b413c0 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:54.196211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:54.197297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.197729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.198178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] PATH_INFO: `/v3/projects/493bc8b0b32f4804a5694c0bf34cdeb4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:54.200159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=493bc8b0b32f4804a5694c0bf34cdeb4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:54.202541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:54.290624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493bc8b0b32f4804a5694c0bf34cdeb4', 'request_id': 'req-97411d2f-d308-469f-8847-b80b27ba9deb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.300539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493bc8b0b32f4804a5694c0bf34cdeb4', 'request_id': 'req-97411d2f-d308-469f-8847-b80b27ba9deb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.314236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493bc8b0b32f4804a5694c0bf34cdeb4', 'request_id': 'req-97411d2f-d308-469f-8847-b80b27ba9deb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.339101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] The token cache is being invalidate because project 493bc8b0b32f4804a5694c0bf34cdeb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:54.339402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.340069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.341998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1202/2382] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:54 2022] DELETE /identity/v3/projects/493bc8b0b32f4804a5694c0bf34cdeb4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:54.345965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.361541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e2f0-772c-474c-a5ab-a85448eaa9cf service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:54.408414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.409852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.494577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:54.495920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.496422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.496951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] PATH_INFO: `/v3/users/7808ec6392d14c469918b8ccd562712c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:54.499051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7808ec6392d14c469918b8ccd562712c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:54.504217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:54.521807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97411d2f-d308-469f-8847-b80b27ba9deb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:54.528691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:54.529062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.529349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.529630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:54.531451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.563797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7808ec6392d14c469918b8ccd562712c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.578864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7808ec6392d14c469918b8ccd562712c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.579676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7808ec6392d14c469918b8ccd562712c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.587837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7808ec6392d14c469918b8ccd562712c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.595355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7808ec6392d14c469918b8ccd562712c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.600206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:54.602613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:54.603150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1181/2383] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:54 2022] DELETE /identity/v3/users/7808ec6392d14c469918b8ccd562712c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:54.619457 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1203/2384] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:54.714203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.716236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.806388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8746-0b4e-4cf7-adbc-5d8a9f4a7266 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:54.812522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:54.813565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.813849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.814302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] PATH_INFO: `/v3/users/681f1a15a4a94f5ea8e9762494c953ae` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:54.815554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681f1a15a4a94f5ea8e9762494c953ae)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:54.818156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:54.824899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.826539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.856094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2265-dcca-4d4e-bd3a-c68f17e5cad7 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:54.861194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:54.862166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.862507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.862865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] PATH_INFO: `/v3/projects/302dda741e3141789056831e28cf1bfc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:54.864726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=302dda741e3141789056831e28cf1bfc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:54.867182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:54.909601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681f1a15a4a94f5ea8e9762494c953ae'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.923654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681f1a15a4a94f5ea8e9762494c953ae'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.924819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681f1a15a4a94f5ea8e9762494c953ae'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.933569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681f1a15a4a94f5ea8e9762494c953ae'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.936096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302dda741e3141789056831e28cf1bfc', 'request_id': 'req-f1d8eadf-67bf-481c-b163-18eff31eefcb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.946572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302dda741e3141789056831e28cf1bfc', 'request_id': 'req-f1d8eadf-67bf-481c-b163-18eff31eefcb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.947608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681f1a15a4a94f5ea8e9762494c953ae'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.958198 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1182/2385] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:54 2022] DELETE /identity/v3/users/681f1a15a4a94f5ea8e9762494c953ae => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:54.959403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:54.961970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:54.964383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302dda741e3141789056831e28cf1bfc', 'request_id': 'req-f1d8eadf-67bf-481c-b163-18eff31eefcb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.977122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] The token cache is being invalidate because project 302dda741e3141789056831e28cf1bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:54.977468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.978236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f1d8eadf-67bf-481c-b163-18eff31eefcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:54.983155 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1204/2386] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:54 2022] DELETE /identity/v3/projects/302dda741e3141789056831e28cf1bfc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:54.983155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcb54-5c01-40de-a4db-0a8c7de69d6f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:54.983155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcb54-5c01-40de-a4db-0a8c7de69d6f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:54.983155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babcb54-5c01-40de-a4db-0a8c7de69d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.002896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7babcb54-5c01-40de-a4db-0a8c7de69d6f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:55.004923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7babcb54-5c01-40de-a4db-0a8c7de69d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.044638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658dcc-37d2-4d81-967d-8ee74fc3e028 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.053498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.055728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.056025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.056310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] PATH_INFO: `/v3/users/5e902cef0a67479090472d2bfa3bd928` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.057627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e902cef0a67479090472d2bfa3bd928)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.060690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.114437 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1205/2387] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:55.116386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.116386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.116881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.144497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e902cef0a67479090472d2bfa3bd928'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.150999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:55.152272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.167781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1206/2388] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:55.167781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.167781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.187333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e902cef0a67479090472d2bfa3bd928'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.187971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e902cef0a67479090472d2bfa3bd928'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.202891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e902cef0a67479090472d2bfa3bd928'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.217105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806bf98e-1deb-44ac-96b9-1514084e94c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e902cef0a67479090472d2bfa3bd928'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.231560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1183/2389] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:54 2022] DELETE /identity/v3/users/5e902cef0a67479090472d2bfa3bd928 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:55.233821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91694bd-8944-4df3-b58a-bbd5ac154634 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.234378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91694bd-8944-4df3-b58a-bbd5ac154634 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.235497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91694bd-8944-4df3-b58a-bbd5ac154634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.262852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b91694bd-8944-4df3-b58a-bbd5ac154634 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:55.264694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b91694bd-8944-4df3-b58a-bbd5ac154634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.271289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684e432-1f10-4a3c-b350-8e04f125178c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.358211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.359413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.359710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.360017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.361938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.376925 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1184/2390] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:55.378647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.379132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.379614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.379876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.381363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.392794 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1207/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:55.393513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.405038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885654e-cd6f-48aa-8ae4-b9ce209b95c7 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.406761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:55.408571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.410875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.411500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.411791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.412073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.412962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:55.413138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.415910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.420642 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1185/2392] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:55.433202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1208/2393] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:55.434453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.437440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.439962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.448412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c3fcc-3e26-48a6-a6ed-fa92a34497d4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.458428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c814-fa3e-459e-b936-1272e0eff206 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.461481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.461879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.462163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.462581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.463731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.470705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.472914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.473893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.474097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.475623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] PATH_INFO: `/v3/users/a3732d6d73c544b9b0f1a89f1eeadc8d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.481157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3732d6d73c544b9b0f1a89f1eeadc8d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.491118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.535450 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1186/2394] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:55.536097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.551268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.576627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3732d6d73c544b9b0f1a89f1eeadc8d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.588048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3732d6d73c544b9b0f1a89f1eeadc8d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.589562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3732d6d73c544b9b0f1a89f1eeadc8d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.590149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3732d6d73c544b9b0f1a89f1eeadc8d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.611057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3732d6d73c544b9b0f1a89f1eeadc8d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:55.626282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f849a-c6d1-4a22-95f9-b4fc51c90b8f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.630653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.631316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.631600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.631926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.634393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.647444 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1209/2395] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:55 2022] DELETE /identity/v3/users/a3732d6d73c544b9b0f1a89f1eeadc8d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:55.647444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.651663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:55.733533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.736508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.751015 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1187/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:55.771016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfe98f-d97c-40c5-a38b-b5130a856519 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.776654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.777367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.777655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.777933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.778619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.780582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.802934 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1210/2397] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:55.806935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.819771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9dab-8977-4bea-84e0-6e94082ed7d5 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.827547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.828965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.829155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.829432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.830132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.832144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.870618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1188/2398] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:55.874415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.893808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d115fd-70f4-44e1-ae4d-c380564d4fa0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.899825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.900553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.900838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.901120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.901852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.903462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a034e-9b0e-4318-a0ac-751788b97f7d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.914747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1211/2399] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:55.918929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:55.930049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e92d7-8be9-43b4-8de4-374bd1d0b1e5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:55.935413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:55.936477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.936784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.937067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] PATH_INFO: `/v3/projects/3f5ee31cb0954403a80a9edea439fdda/users/b2acbd3c9ddf41dd8577b9d3049bd7ec/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:55.961355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5ee31cb0954403a80a9edea439fdda, user_id=b2acbd3c9ddf41dd8577b9d3049bd7ec, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:55.964654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:55.998607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:55.998907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:55.999191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.000991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1189/2400] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:55 2022] PUT /identity/v3/projects/3f5ee31cb0954403a80a9edea439fdda/users/b2acbd3c9ddf41dd8577b9d3049bd7ec/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:56.039246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] MFA Rules not processed for user `b2acbd3c9ddf41dd8577b9d3049bd7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:56.040592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.101390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.103329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.178485 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1212/2401] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:56.184706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.235465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478f97-cbe6-4244-bc72-fa8a85e25e91 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.241268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.242985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.243365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.243734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] PATH_INFO: `/v3/projects/c2496c2b222148dfad37efb60e08356b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.245502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2496c2b222148dfad37efb60e08356b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.247541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.272389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a796-565e-4c55-a5fe-557bea689dbc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.280311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.281034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.281322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.281609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.282308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.285408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.316813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2496c2b222148dfad37efb60e08356b', 'request_id': 'req-f665548f-930f-42e2-8b67-088a01aa30ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.321095 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1213/2402] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:56.322012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.324349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.328267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2496c2b222148dfad37efb60e08356b', 'request_id': 'req-f665548f-930f-42e2-8b67-088a01aa30ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.336115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2496c2b222148dfad37efb60e08356b', 'request_id': 'req-f665548f-930f-42e2-8b67-088a01aa30ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.354376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] The token cache is being invalidate because project c2496c2b222148dfad37efb60e08356b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:56.354717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.355382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.360598 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1190/2403] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:56 2022] DELETE /identity/v3/projects/c2496c2b222148dfad37efb60e08356b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:56.360598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.360598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.439841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcdea6-0e3e-40be-9976-e192f2aa0c45 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.448111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665548f-930f-42e2-8b67-088a01aa30ac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.451358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.452483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.452873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.453256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] PATH_INFO: `/v3/projects/cb35175e41264b7cb3ca65aea6b25361` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.454023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.454715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.454838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb35175e41264b7cb3ca65aea6b25361)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.455822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.456263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.457314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.459704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.459847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e52bf-4ba3-4238-b803-dd47208edd85 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.490552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1191/2404] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:56.492851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5850-6fef-4fe3-b8b8-b05a57e6c76d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.493252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5850-6fef-4fe3-b8b8-b05a57e6c76d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.493636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e5850-6fef-4fe3-b8b8-b05a57e6c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.515509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bd6e5850-6fef-4fe3-b8b8-b05a57e6c76d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:56.517153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd6e5850-6fef-4fe3-b8b8-b05a57e6c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.537039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb35175e41264b7cb3ca65aea6b25361', 'request_id': 'req-7573a615-7201-4813-994e-caf6b5dc0d6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.545039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb35175e41264b7cb3ca65aea6b25361', 'request_id': 'req-7573a615-7201-4813-994e-caf6b5dc0d6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.562824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb35175e41264b7cb3ca65aea6b25361', 'request_id': 'req-7573a615-7201-4813-994e-caf6b5dc0d6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.578374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] The token cache is being invalidate because project cb35175e41264b7cb3ca65aea6b25361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:56.578907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.579851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:56.582147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1214/2405] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:56 2022] DELETE /identity/v3/projects/cb35175e41264b7cb3ca65aea6b25361 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:56.583332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.585004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.612016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1192/2406] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:56.613630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9193-2538-4bec-9549-78f92fdfb414 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.613928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9193-2538-4bec-9549-78f92fdfb414 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.614205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9193-2538-4bec-9549-78f92fdfb414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.649880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-554e9193-2538-4bec-9549-78f92fdfb414 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:56.651906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-554e9193-2538-4bec-9549-78f92fdfb414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.661266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1193/2407] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:56.671042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470679-4a5c-40de-bd94-233baf3603ca None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.671343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470679-4a5c-40de-bd94-233baf3603ca None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.671625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470679-4a5c-40de-bd94-233baf3603ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.679229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573a615-7201-4813-994e-caf6b5dc0d6b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.698700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.699389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.699676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.699954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.700718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.702358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.704902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-48470679-4a5c-40de-bd94-233baf3603ca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:56.706320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48470679-4a5c-40de-bd94-233baf3603ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.719189 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1194/2408] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:56.719189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.719189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.719189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.727985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1215/2409] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:56.729738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.755203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb43cc-a74e-41ba-8f4e-ac65d3dab3be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.758574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:56.759818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:56.763585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.764283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.764742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.765048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.765772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:56.766076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.767931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.785309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1195/2410] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:56.786341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.799557 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1216/2411] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:56.799557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.807282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ed45-de1e-4621-aff9-440fe7eeb115 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.813633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.814666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.815055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.815437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] PATH_INFO: `/v3/projects/09f879d952994286b2cc4335f43a0843/users/c262b1d620364ccfa45859abb1229ea3/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.816122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a771b-42b5-401b-9163-ff7503f278ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.822502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:56.823176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:56.823462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:56.823736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:56.824488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:56.824924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.826530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.841133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f879d952994286b2cc4335f43a0843, user_id=c262b1d620364ccfa45859abb1229ea3, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:56.845016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1217/2412] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:56.846156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:56.847150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:56.867277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1324e-536b-4340-9478-b7b3cbe5d178 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:56.870890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1196/2413] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:56 2022] PUT /identity/v3/projects/09f879d952994286b2cc4335f43a0843/users/c262b1d620364ccfa45859abb1229ea3/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:56.875476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.024193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.025331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.025773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.026219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.027085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.030657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.043570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97d3f-8be9-4475-83ae-945c790baca0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.058964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.060069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.061908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.062399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.064481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.067725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.078056 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1218/2414] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:57.079179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.118560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1197/2415] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:56 2022] POST /identity/v3/projects => generated 397 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:57.121479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.127281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.190471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f6573-4389-43ea-9109-249da1e28784 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.218184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257064-9da0-4af4-aff7-0463803cbfb2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.223599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.224993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.226113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.226693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] PATH_INFO: `/v3/projects/ee9875c19e834d52b2f43c18e116140c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.227955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9875c19e834d52b2f43c18e116140c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.230064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.257779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.259008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.259298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.259610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.260791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.262597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.275234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1219/2416] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:57.276216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.292987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba30277-1ba2-4496-b986-f0fbfef7c11f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.297443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9875c19e834d52b2f43c18e116140c', 'request_id': 'req-3d67476b-5a96-4bc3-8089-523d66e40aca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.304660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9875c19e834d52b2f43c18e116140c', 'request_id': 'req-3d67476b-5a96-4bc3-8089-523d66e40aca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.311896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9875c19e834d52b2f43c18e116140c', 'request_id': 'req-3d67476b-5a96-4bc3-8089-523d66e40aca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.332638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] The token cache is being invalidate because project ee9875c19e834d52b2f43c18e116140c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:57.333027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.333620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.335537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1198/2417] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:57 2022] DELETE /identity/v3/projects/ee9875c19e834d52b2f43c18e116140c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:57.336483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.337813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.366165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.367614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.367900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.368171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.368976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.372894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.400127 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1220/2418] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:57 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:57.401109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.404294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.420496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a420-148c-4ecb-80a8-6d52fcc9d756 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.425340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.427265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.428807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.429670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] PATH_INFO: `/v3/projects/09f879d952994286b2cc4335f43a0843/users/c262b1d620364ccfa45859abb1229ea3/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.432061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f879d952994286b2cc4335f43a0843, user_id=c262b1d620364ccfa45859abb1229ea3, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.435034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.453012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67476b-5a96-4bc3-8089-523d66e40aca admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.458607 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1221/2419] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:57 2022] PUT /identity/v3/projects/09f879d952994286b2cc4335f43a0843/users/c262b1d620364ccfa45859abb1229ea3/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:57.460325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.470642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.536140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.537018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.537331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.537620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.538836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.541072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.553396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3bf12-7926-4c67-9d53-e22d53140b5a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.561256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.562593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.563023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.563618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] PATH_INFO: `/v3/users/f63d8c6e30f04a179bad0d2eee203d07` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.565438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63d8c6e30f04a179bad0d2eee203d07)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.568865 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1199/2420] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:57 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:57.568865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.568865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.570026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.581883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afec87-9d1c-4409-918a-e17269726a8b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.589591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.590850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.591142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.591423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.592217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.593989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5809070-cd99-4eb1-937c-97e6abeac0e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.605457 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1200/2421] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:57.606704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.606994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.607328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.624587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63d8c6e30f04a179bad0d2eee203d07'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.633384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63d8c6e30f04a179bad0d2eee203d07'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.634057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63d8c6e30f04a179bad0d2eee203d07'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.634695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63d8c6e30f04a179bad0d2eee203d07'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.636343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] MFA Rules not processed for user `c262b1d620364ccfa45859abb1229ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:57.637973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.642576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63d8c6e30f04a179bad0d2eee203d07'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:57.660734 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1222/2422] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:57 2022] DELETE /identity/v3/users/f63d8c6e30f04a179bad0d2eee203d07 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:57.661739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.663195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.737226 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1201/2423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:57.738195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.738318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d2c69-2c3f-4519-9a0a-115161324c8d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.739670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.744818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.745501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.745783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.746080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.746842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.748785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.757626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764854f-c082-4cb4-ae3c-3fb46bd80466 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.762769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.763545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.763928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.764407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.765413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1223/2424] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:57.765557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.769484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.769673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.786536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4d63-de73-4550-9ed7-7d9271f2c278 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.789011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1202/2425] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:57.789863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.792655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.796673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.797008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.797303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.798243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.800254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.800371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8b3a-4635-44f7-bf0c-7e09ab09d1c4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.805689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.806627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.806915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.807236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] PATH_INFO: `/v3/projects/ad36f69b8e4e4691ad078f8f626f41df/users/d3e44392fbac42388dd99c039d470029/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.814690 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1224/2426] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:57.815584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:57.827000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad36f69b8e4e4691ad078f8f626f41df, user_id=d3e44392fbac42388dd99c039d470029, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.829899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30155e00-1d3c-45ac-b442-b2109700061b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:57.830185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62310-bfb8-44e9-86e8-378ace6235f3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.838213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:57.839438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.839732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.840019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] PATH_INFO: `/v3/projects/53a52cc441fb4933bc02b16d4327307d/users/dd4bff9a3a2e410aa9c2921987c1b7cd/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.845120 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1203/2427] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:57 2022] PUT /identity/v3/projects/ad36f69b8e4e4691ad078f8f626f41df/users/d3e44392fbac42388dd99c039d470029/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:57.858484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.858920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.859039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a52cc441fb4933bc02b16d4327307d, user_id=dd4bff9a3a2e410aa9c2921987c1b7cd, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:57.859442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.861880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a620-b249-4bee-89eb-efce011b4fec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:57.889073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1225/2428] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:57 2022] PUT /identity/v3/projects/53a52cc441fb4933bc02b16d4327307d/users/dd4bff9a3a2e410aa9c2921987c1b7cd/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:57.890687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:57.890990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:57.891275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:57.898967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] MFA Rules not processed for user `d3e44392fbac42388dd99c039d470029`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:57.901269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:57.922391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] MFA Rules not processed for user `dd4bff9a3a2e410aa9c2921987c1b7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:57.923630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.006883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1226/2429] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:58.015519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.016963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.028221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1204/2430] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:58.092270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7e13-88f2-4776-9685-450325163ce5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.097938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.098613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.098857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.099123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.162641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.164305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.174490 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1227/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:58.231687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.249403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa39205-41e3-4a29-b6f5-87ddb94af484 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.255299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.256002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.256334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.256652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.274404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.276376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.289265 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1205/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:58.304118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.306736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.334171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.346994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efe60d-1f7b-46b8-adb0-d8465ca8af4c service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.353058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.353959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.354316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.354668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.364612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.365937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de5c76-ce94-48c1-b801-a0440d84b82a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.386368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd15c7-0bbf-4f59-b0aa-8d8015469f65 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.387019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1206/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:58.391111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.391974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.392260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.392580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] PATH_INFO: `/v3/projects/aa0b17111e9c49b8949bb1703bcceec5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.393795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0b17111e9c49b8949bb1703bcceec5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.396598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.438870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.439236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.439706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.457277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0b17111e9c49b8949bb1703bcceec5', 'request_id': 'req-1813f088-fd4e-4979-98c6-6c836cae3eb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:58.465611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0b17111e9c49b8949bb1703bcceec5', 'request_id': 'req-1813f088-fd4e-4979-98c6-6c836cae3eb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:58.473513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] MFA Rules not processed for user `b6bd66a0c09642dc91a334698fbd4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:58.479223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0b17111e9c49b8949bb1703bcceec5', 'request_id': 'req-1813f088-fd4e-4979-98c6-6c836cae3eb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:58.479611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.503347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] The token cache is being invalidate because project aa0b17111e9c49b8949bb1703bcceec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:52:58.503752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:58.504595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1813f088-fd4e-4979-98c6-6c836cae3eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:58.507218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1228/2434] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:52:58 2022] DELETE /identity/v3/projects/aa0b17111e9c49b8949bb1703bcceec5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:58.512425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850b16-c25f-4627-847b-29629da01874 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.512742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850b16-c25f-4627-847b-29629da01874 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.513103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850b16-c25f-4627-847b-29629da01874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.543220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6a850b16-c25f-4627-847b-29629da01874 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:58.545140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6a850b16-c25f-4627-847b-29629da01874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.570698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1207/2435] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:58.587594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.589188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.638339 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1229/2436] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:58.640599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.640870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.642016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.679048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:58.680613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.691325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1230/2437] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:58.695939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.704717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f62780-f07d-48be-8fc8-d97db9d046ec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.712004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8dba1-441e-4d98-90ea-968193decf77 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.716546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.717214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.717328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.717498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.717779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.718187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.718475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.718756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.719480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:52:58.719804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.721462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.725453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.739076 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1231/2438] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:52:58.740024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.751058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1c3d-70bb-436a-8acd-dfe90af9f8b0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.757904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.758571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.758856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.759132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.759819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.761921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.798250 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1232/2439] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:58 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:58.802666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.809611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.812134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.828530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1208/2440] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:58.846169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.848621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:58.865245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270a7b8-1698-4860-9155-d400a82d5e71 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.921175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b10854-3576-40c3-a60b-1fdcb04d74a6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.928760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.930146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.930487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.930767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.932323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.936019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.966393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.967382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.967665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.967942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] PATH_INFO: `/v3/users/b2acbd3c9ddf41dd8577b9d3049bd7ec` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.969426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1233/2441] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:58 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:58.972800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2acbd3c9ddf41dd8577b9d3049bd7ec)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.973581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:58.974809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:58.988282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898d90-5105-46b7-b0a2-b4d19a19c32d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:58.995301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:58.996147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:58.996590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:58.996970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:58.997794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:58.999520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.011992 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1234/2442] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:59.016939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.036242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526764-5465-4d0f-b820-43db475f5225 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.040199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2acbd3c9ddf41dd8577b9d3049bd7ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:59.043857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.044644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.045004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.045513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.046301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.049155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.055904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2acbd3c9ddf41dd8577b9d3049bd7ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:59.057423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2acbd3c9ddf41dd8577b9d3049bd7ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:59.068683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1235/2443] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:52:59.070602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.072962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:59.073957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2acbd3c9ddf41dd8577b9d3049bd7ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:59.083194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f36bfb7-cdbc-41ba-ace4-a48863f81d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2acbd3c9ddf41dd8577b9d3049bd7ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:52:59.089928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e451-a5fe-4cef-833e-c26503c861ba admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.095220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.096233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1209/2444] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:52:58 2022] DELETE /identity/v3/users/b2acbd3c9ddf41dd8577b9d3049bd7ec => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:52:59.096574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.096910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.097195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] PATH_INFO: `/v3/projects/dcd560b43be74b8695b2a917defd0497/users/2657b02ed69e469fafafc9127b5058cb/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.097698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.097992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.098284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.116983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd560b43be74b8695b2a917defd0497, user_id=2657b02ed69e469fafafc9127b5058cb, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.119390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:59.120125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe2f44-6cf2-4283-9450-c69ae6235e41 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.120701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:59.138289 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1236/2445] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:59 2022] PUT /identity/v3/projects/dcd560b43be74b8695b2a917defd0497/users/2657b02ed69e469fafafc9127b5058cb/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:59.149539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.150091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.150587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.185076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] MFA Rules not processed for user `2657b02ed69e469fafafc9127b5058cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:59.186826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:59.212559 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1210/2446] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:52:59.219165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.221385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:52:59.272416 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1237/2447] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:52:59.278002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.314522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f02d1-fc0e-424c-bbd5-8ddb617b6854 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.364298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f9ecf-e966-443d-835d-07378f020f28 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.370530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.371214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.371497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.371775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.372643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.374535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.398727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.399400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.399746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.399992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.408892 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1238/2448] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:52:59 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:52:59.410415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.412195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.412684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.436485 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1211/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:52:59.528293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605dd32-caa0-47d5-960a-d2cd5fade015 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.533998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.534964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.535550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.535741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.536597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.539731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.569407 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1239/2450] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:52:59 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:52:59.572938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.591105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2aff1-d7f8-41ec-b827-6aa8085e2979 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.596285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.597539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.597539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.597924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.598918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.601447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.613436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1212/2451] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:59.617776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.629324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab016371-ee3a-43a7-9b80-60fd2ea065b0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.635836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.636790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.637078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.637357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] PATH_INFO: `/v3/projects/3cd060f313a04b86bd019ead7321a583/users/3efefc97aadf4e059837766569185ff4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.655162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd060f313a04b86bd019ead7321a583, user_id=3efefc97aadf4e059837766569185ff4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.658038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.675850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1240/2452] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:59 2022] PUT /identity/v3/projects/3cd060f313a04b86bd019ead7321a583/users/3efefc97aadf4e059837766569185ff4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:59.680171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.693754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b66e9-bc07-4855-89aa-a84f44903b79 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.791189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.791993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.792278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.792617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.793522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.796497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230547-bcbc-4ddc-b1a0-585eb77463fe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.808547 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1213/2453] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:52:59.812932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:52:59.831209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64728384-9d5b-42cf-bfbe-33cbeb8fc913 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:52:59.844771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:52:59.845683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.845972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.846250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] PATH_INFO: `/v3/projects/3cd060f313a04b86bd019ead7321a583/users/3efefc97aadf4e059837766569185ff4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.848567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd060f313a04b86bd019ead7321a583, user_id=3efefc97aadf4e059837766569185ff4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:52:59.851476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:52:59.863352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1241/2454] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:52:59 2022] PUT /identity/v3/projects/3cd060f313a04b86bd019ead7321a583/users/3efefc97aadf4e059837766569185ff4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:52:59.874821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:52:59.875349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:52:59.875349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:52:59.910364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] MFA Rules not processed for user `3efefc97aadf4e059837766569185ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:52:59.911643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.006156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1214/2455] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:00.013145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.027603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3255fd9-ea4c-4ca8-84d0-259dc0912b73 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.034209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.034882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.035219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.035504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.037239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:00.037711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.039433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.060952 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1242/2456] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:00.062083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.081105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ab92e-22ff-470f-8b73-e039a9293cd6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.090669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.091428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.092310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.092310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.101507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.103704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.140244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.141030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1215/2457] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:00 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:00.145100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.147665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.251374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a62526-170e-4761-a4a0-2e3f67f9b22c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.275146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.276277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.276698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.278848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.278848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:00.278848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.282121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.284702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530787-4fe1-471b-a949-1032fe6ff1ad tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.321180 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1216/2458] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:00.364944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.365947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.366823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.367182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] PATH_INFO: `/v3/projects/3f5ee31cb0954403a80a9edea439fdda` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.369752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5ee31cb0954403a80a9edea439fdda)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.370715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.371950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.373038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.393448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89038197-faa5-48ca-a915-a066b469f049 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.399706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.400772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.401929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.402195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] PATH_INFO: `/v3/users/dd4bff9a3a2e410aa9c2921987c1b7cd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.404046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4bff9a3a2e410aa9c2921987c1b7cd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.406879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.425658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5ee31cb0954403a80a9edea439fdda', 'request_id': 'req-cd07abc1-4823-425b-9c16-7aad606158d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.432404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5ee31cb0954403a80a9edea439fdda', 'request_id': 'req-cd07abc1-4823-425b-9c16-7aad606158d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.442638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5ee31cb0954403a80a9edea439fdda', 'request_id': 'req-cd07abc1-4823-425b-9c16-7aad606158d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.458417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] The token cache is being invalidate because project 3f5ee31cb0954403a80a9edea439fdda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:00.459040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.459936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.466009 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1243/2459] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:00 2022] DELETE /identity/v3/projects/3f5ee31cb0954403a80a9edea439fdda => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:00.466562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.468790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.474144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4bff9a3a2e410aa9c2921987c1b7cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.493675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4bff9a3a2e410aa9c2921987c1b7cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.494626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4bff9a3a2e410aa9c2921987c1b7cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.509885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4bff9a3a2e410aa9c2921987c1b7cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.526228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4bff9a3a2e410aa9c2921987c1b7cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.532802 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1217/2460] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:00 2022] DELETE /identity/v3/users/dd4bff9a3a2e410aa9c2921987c1b7cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:00.533555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.534925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.584250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07abc1-4823-425b-9c16-7aad606158d2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.637441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd0cba-2562-44cb-95e3-45c1d93de36e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:00.643395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.644490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.644835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.645093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] PATH_INFO: `/v3/users/c262b1d620364ccfa45859abb1229ea3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.646371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c262b1d620364ccfa45859abb1229ea3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.648351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.717810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c262b1d620364ccfa45859abb1229ea3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.728913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:00.729866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.730304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.730646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.733930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c262b1d620364ccfa45859abb1229ea3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.735223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.735353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c262b1d620364ccfa45859abb1229ea3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.752091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c262b1d620364ccfa45859abb1229ea3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.764903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a71f23b2-e810-4709-8632-e1cb8aaebc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c262b1d620364ccfa45859abb1229ea3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:00.775117 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1218/2461] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:00 2022] DELETE /identity/v3/users/c262b1d620364ccfa45859abb1229ea3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:00.777148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.777578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.778239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.805606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:00.807370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.908111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1219/2462] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:00.908707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:00.910188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98e1f3-b14e-4c71-be49-caf617e3dfee service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:00.933597 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1244/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:00.935381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:00.943742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:00.949996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:00.950341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:00.950625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:00.952467 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1245/2464] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:53:00.959240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:53:00.962008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.086079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c2d63-0fea-4d1d-b2cf-58a5e4700b5d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.090096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.092615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.093299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.094616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.095845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.096484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.117911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.120558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.136581 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1220/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:01.137477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.139943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.163299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c379e-8136-401b-b838-b9dfdc485ad4 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.168738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.170052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.170513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.171608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] PATH_INFO: `/v3/users/d3e44392fbac42388dd99c039d470029` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.173337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e44392fbac42388dd99c039d470029)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.175538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.180797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b43d-8e0e-4ea8-98c7-35a260ff0608 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.188068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.189274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.189997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.190428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects/ce70ee8fbea64070b76ff7540377a9c9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.195603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce70ee8fbea64070b76ff7540377a9c9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.197735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824036ee-4c03-44e3-9aca-8583f6c817e2 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.200033 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1246/2466] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:53:00 2022] GET /identity/v3/projects/ce70ee8fbea64070b76ff7540377a9c9 => generated 371 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:01.261682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e44392fbac42388dd99c039d470029'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.284271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e44392fbac42388dd99c039d470029'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.287839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e44392fbac42388dd99c039d470029'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.306272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e44392fbac42388dd99c039d470029'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.316052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-199bf0bd-0821-442d-bcff-0a15a51df2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e44392fbac42388dd99c039d470029'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.324524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1221/2467] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:01 2022] DELETE /identity/v3/users/d3e44392fbac42388dd99c039d470029 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:01.325523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.325819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.326096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.327839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1247/2468] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:53:01.330329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.330620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.330899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.337298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:53:01.341959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.353758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:01.355137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.434705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1222/2469] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:01.466038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.469092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.492575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.496235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.559827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ae249-dfeb-4fd9-ac07-3da54459f288 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.566549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.570289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.570655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.570948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects/ce70ee8fbea64070b76ff7540377a9c9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.575812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce70ee8fbea64070b76ff7540377a9c9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.578386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.580748 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1248/2470] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:53:01 2022] GET /identity/v3/projects/ce70ee8fbea64070b76ff7540377a9c9 => generated 371 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:53:01.610806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e9d2b-9da9-4998-a4fd-c2ff9164ca62 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.612760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.614849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.625258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.626564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.627401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.628576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.649284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f21a8-ec2a-4f7e-8449-57dceab1619c tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.658035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.662650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.664125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.667633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.667920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.669970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] PATH_INFO: `/v3/projects/09f879d952994286b2cc4335f43a0843` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.671321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f879d952994286b2cc4335f43a0843)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.675519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.686183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1223/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:01.687000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.712758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b46d21-5361-4d86-99da-87b2963ce5ae service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.717887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.718773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.719057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.719323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.720158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:01.720503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.722384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.747766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1224/2472] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:01.750521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f879d952994286b2cc4335f43a0843', 'request_id': 'req-306d7609-dada-4717-99a8-399e4119711e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.751650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.759296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f879d952994286b2cc4335f43a0843', 'request_id': 'req-306d7609-dada-4717-99a8-399e4119711e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.768594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f879d952994286b2cc4335f43a0843', 'request_id': 'req-306d7609-dada-4717-99a8-399e4119711e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.769185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca65fec-dae3-4044-b9e6-9607ecf0856f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.789031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] The token cache is being invalidate because project 09f879d952994286b2cc4335f43a0843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:01.789616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.790803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:01.795124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1249/2473] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:01 2022] DELETE /identity/v3/projects/09f879d952994286b2cc4335f43a0843 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:01.797002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.803909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.873622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.874558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.874917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.875515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.876532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.879161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2be2-18f5-4d1c-a413-587d6ae4a100 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.907952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d7609-dada-4717-99a8-399e4119711e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:01.914906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:01.915922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.916313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.916969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] PATH_INFO: `/v3/projects/53a52cc441fb4933bc02b16d4327307d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.917190 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1225/2474] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:01 2022] POST /identity/v3/users => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:01.918506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a52cc441fb4933bc02b16d4327307d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:01.918626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:01.918905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:01.919162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:01.921118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:01.959760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:01.961659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:01.973591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1226/2475] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:01.974223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:01.977111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.002058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a52cc441fb4933bc02b16d4327307d', 'request_id': 'req-b1189386-68a9-49e0-ba75-17d513e7a021'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.015791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a6824-42f2-4d2b-8455-c95c67740ea4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.019352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a52cc441fb4933bc02b16d4327307d', 'request_id': 'req-b1189386-68a9-49e0-ba75-17d513e7a021'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.028308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a52cc441fb4933bc02b16d4327307d', 'request_id': 'req-b1189386-68a9-49e0-ba75-17d513e7a021'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.042962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] The token cache is being invalidate because project 53a52cc441fb4933bc02b16d4327307d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:02.043251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.044335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1189386-68a9-49e0-ba75-17d513e7a021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.046839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1250/2476] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:01 2022] DELETE /identity/v3/projects/53a52cc441fb4933bc02b16d4327307d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:02.049060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894813b-d18a-4dc3-933f-0f48be865658 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.049389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894813b-d18a-4dc3-933f-0f48be865658 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.049852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894813b-d18a-4dc3-933f-0f48be865658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.111543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2894813b-d18a-4dc3-933f-0f48be865658 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:02.114343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2894813b-d18a-4dc3-933f-0f48be865658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.154528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.156600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.158301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.158670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.161035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:02.161441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.165779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f60f25-4eaf-4817-908a-ad308cfde293 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.191801 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1227/2477] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:02.193407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.193821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.195027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.221544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1251/2478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:02.223375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fcd9b-08e9-454c-9258-a2291c9d3c31 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.223831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fcd9b-08e9-454c-9258-a2291c9d3c31 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.224947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fcd9b-08e9-454c-9258-a2291c9d3c31 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.228862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:02.229959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1252/2479] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:53:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:53:02.230490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.231465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fcd9b-08e9-454c-9258-a2291c9d3c31 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.249623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fcd9b-08e9-454c-9258-a2291c9d3c31 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.254608 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1228/2480] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:02.255459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.255721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:53:02.256657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.257318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.257876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.259054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:02.259512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.260998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.261827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d0e0-0c54-49ad-b5d4-6c7dbd0fff05 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.284152 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1253/2481] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:02.286748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.287267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.289275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.379711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:02.381724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.398796 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1254/2482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:02.398796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.407990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16751ad2-1700-4886-b867-cfa1810ff35a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.414603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.415276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.415595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.415816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.416528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.418646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.451206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.461421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.502833 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1255/2483] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:02.503626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a4c1-3d42-4cd9-87d3-e2e20863f6a9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.503886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.506714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.600259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.602782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.603177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.603558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects/ce70ee8fbea64070b76ff7540377a9c9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.606012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce70ee8fbea64070b76ff7540377a9c9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.608444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.615888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1229/2484] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:53:02 2022] GET /identity/v3/projects/ce70ee8fbea64070b76ff7540377a9c9 => generated 371 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:02.617526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.675434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7fad-e29e-4bad-9986-1aa1f7fdb4a5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.681889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.683225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.683376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.684493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] PATH_INFO: `/v3/projects/ad36f69b8e4e4691ad078f8f626f41df` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.686990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad36f69b8e4e4691ad078f8f626f41df)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.688948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.717042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b824c-a2cc-487b-aeeb-b6081017d47b tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.729899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.730447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.730732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.731000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.731721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:02.732024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.733656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.745921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1230/2485] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:02.746964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.757743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64ea8a-b6c4-41f4-86a6-b2e7f4509c49 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.766232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad36f69b8e4e4691ad078f8f626f41df', 'request_id': 'req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.773915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad36f69b8e4e4691ad078f8f626f41df', 'request_id': 'req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.785989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad36f69b8e4e4691ad078f8f626f41df', 'request_id': 'req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.801518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] The token cache is being invalidate because project ad36f69b8e4e4691ad078f8f626f41df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:02.802132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.803305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:02.805349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1256/2486] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:02 2022] DELETE /identity/v3/projects/ad36f69b8e4e4691ad078f8f626f41df => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:02.806549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.809623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.829738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.830567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.831101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.831479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.832683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.835934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269306c-52be-4ea0-bb73-56df2a5c498c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.864347 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1231/2487] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:02.869127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cee30-4e22-453b-9918-f95e6d2629ba None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.869640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cee30-4e22-453b-9918-f95e6d2629ba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.869930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cee30-4e22-453b-9918-f95e6d2629ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.891221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-010cee30-4e22-453b-9918-f95e6d2629ba None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:02.893059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-010cee30-4e22-453b-9918-f95e6d2629ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.902828 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1232/2488] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:02.904566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.904861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.905144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.907159 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1233/2489] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:53:02.907928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:02.909936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.919110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a5ba0-ab76-4031-b243-02a14ee9e7e0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.924000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.924782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.925063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.925337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.926178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.928118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275aa17-426b-4644-8dfb-e75eb0380347 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.931265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5baa203-62cc-4589-a649-a507d1aad301 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:02.938174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:02.939838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.941074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.941541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.943574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:02.947001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:02.964242 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1257/2490] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:02.968021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:02.968021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:02.968021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:02.969315 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1234/2491] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:02.970575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:53:02.973092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:02.990170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:02.992028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:03.095091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1258/2492] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:03.096909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.112967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e05f11-124c-4e90-b91c-c29b79d98c95 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.119682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.120367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.120889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.121798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.121798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.123323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.127743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.129221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:03.156505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1259/2493] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:03.156505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.168313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7ced0-0d45-4ea2-ae8d-7d93b95397b9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.173767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.174619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.175264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.175634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.176421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.179647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.210574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1260/2494] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:03 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:03.211688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.224715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427563b-1985-468e-abd8-143814b6f22f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.231696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.232237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.232575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.233360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.234289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:03.234289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.236560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.241094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0af9a-92e6-4e1e-8b61-921bf49f72b3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.261820 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1261/2495] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:03.263027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.289344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464ce25-00dd-4765-9fde-0e2895660a67 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.305235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.306159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.306443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.306719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] PATH_INFO: `/v3/projects/6e2a80eb708d4a2b8aab54b268dc218d/users/cf5e0bd625644d9eabf92db0624219e9/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.329084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a80eb708d4a2b8aab54b268dc218d, user_id=cf5e0bd625644d9eabf92db0624219e9, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.332949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.334027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.334939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.335228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.335511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects/ce70ee8fbea64070b76ff7540377a9c9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.338698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce70ee8fbea64070b76ff7540377a9c9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.340494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.342401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1235/2496] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:53:02 2022] GET /identity/v3/projects/ce70ee8fbea64070b76ff7540377a9c9 => generated 371 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:03.355810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.358705 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1262/2497] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:03 2022] PUT /identity/v3/projects/6e2a80eb708d4a2b8aab54b268dc218d/users/cf5e0bd625644d9eabf92db0624219e9/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:03.360097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.386571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87510-df7f-4dcb-9e2c-f0c5b68ef944 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.481751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.482889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.483377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.483904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.485373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.487314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ed00f-e9e1-4c5d-a665-426b6697c963 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.490636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a57912-ec03-42e2-8f67-6bc86fa808da admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.506538 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1236/2498] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:03.508429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.508847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.509291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.520084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.521312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.524427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.524904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.525756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.529542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:03.530620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.535372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:03.606540 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1237/2499] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:03.607549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.622731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1263/2500] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:03 2022] POST /identity/v3/projects => generated 389 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:03.622731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.758621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b52e-f3f9-4c82-a2a8-a9a28413fdf9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.764773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.765590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.765998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.766377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.767218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.769163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.784654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a755e8-f1e2-4dec-883e-e997198454ad None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.791791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1264/2501] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:03.792831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.794899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:03.891801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c847b4-4493-41a8-81ae-9fca5e5a41e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.896410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.897109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.897919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.898199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.908213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.909687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.922088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1265/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:03.922574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.932743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dbe1a-248a-4377-ae6e-261b37fa10e6 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.935094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.936875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.937286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.937570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/users/6fab18174a2c4635ad8a606f03c964ab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.937701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.938444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.938733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.939010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:03.939685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.942247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.972888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6fab18174a2c4635ad8a606f03c964ab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:03.979618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:03.980247 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1266/2503] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:03 2022] POST /identity/v3/users => generated 295 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:03.981354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:03.992908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f99e-088d-41ce-a3d1-77a745bff555 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:03.998343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:03.999347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:03.999636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:03.999988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] PATH_INFO: `/v3/projects/ee534be172494c1b842d8749d1dfe969/users/481d41af70a54782ad2d569d058d6fdc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.024320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee534be172494c1b842d8749d1dfe969, user_id=481d41af70a54782ad2d569d058d6fdc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.040262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.063177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fab18174a2c4635ad8a606f03c964ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.076224 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1267/2504] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:03 2022] PUT /identity/v3/projects/ee534be172494c1b842d8749d1dfe969/users/481d41af70a54782ad2d569d058d6fdc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:04.077437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.095232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fab18174a2c4635ad8a606f03c964ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.096092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fab18174a2c4635ad8a606f03c964ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.110282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fab18174a2c4635ad8a606f03c964ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.125316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-71bedb24-f204-4b1a-9e06-8b66b7491d15 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fab18174a2c4635ad8a606f03c964ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.145700 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1238/2505] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:03 2022] DELETE /identity/v3/users/6fab18174a2c4635ad8a606f03c964ab => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:04.148675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.148978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.149965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.189084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] MFA Rules not processed for user `481d41af70a54782ad2d569d058d6fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:04.190321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.197339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634abcd2-dd8f-4895-a5d4-9b271252f665 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.264024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.265004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.265359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.265771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.266586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.268529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.282732 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1268/2506] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:04.282732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.282732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.294112 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1239/2507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:04.294993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.296866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.329099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e0bd0-a9f3-4567-bf0f-81a317884a9d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.341294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.345443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.345817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.346803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.348597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.353601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fb0da-36a4-4ef5-a1c1-1b9c53af836e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.383461 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1240/2508] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:04.387027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.389435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.391257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.420440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] MFA Rules not processed for user `481d41af70a54782ad2d569d058d6fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:04.423100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.423940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e781f2-36ae-496e-9d3c-0ead1bab6ce1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.431534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1241/2509] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:04.432397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.442499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3efefc97aadf4e059837766569185ff4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd060f313a04b86bd019ead7321a583', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.443388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.443679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.443959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] PATH_INFO: `/v3/projects/ce70ee8fbea64070b76ff7540377a9c9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.448261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce70ee8fbea64070b76ff7540377a9c9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.448977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045eee6-8ac7-414c-bef3-54922f07e882 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.450607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.455042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.456899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.457396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.457870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] PATH_INFO: `/v3/projects/89b61101b5644010bc714c2cdeba96eb/users/82d0dd5279384016ba00c5688ce1d615/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.482722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b61101b5644010bc714c2cdeba96eb, user_id=82d0dd5279384016ba00c5688ce1d615, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.486403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.508894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1242/2510] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:04 2022] PUT /identity/v3/projects/89b61101b5644010bc714c2cdeba96eb/users/82d0dd5279384016ba00c5688ce1d615/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:04.518339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.521861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.548214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce70ee8fbea64070b76ff7540377a9c9', 'request_id': 'req-9275df56-9390-4a2b-a96d-85a44ca9340f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.570614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce70ee8fbea64070b76ff7540377a9c9', 'request_id': 'req-9275df56-9390-4a2b-a96d-85a44ca9340f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.582398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce70ee8fbea64070b76ff7540377a9c9', 'request_id': 'req-9275df56-9390-4a2b-a96d-85a44ca9340f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.611877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] The token cache is being invalidate because project ce70ee8fbea64070b76ff7540377a9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:04.612337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.614288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9275df56-9390-4a2b-a96d-85a44ca9340f tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.616510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1269/2511] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:04 2022] DELETE /identity/v3/projects/ce70ee8fbea64070b76ff7540377a9c9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:04.618500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.620931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.620931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.642170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:04.643954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.671305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070dd32-713b-4336-8700-ca1292690b3a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.740073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1270/2512] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:04.741662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.743139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.758781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240495f3-3643-4f35-acbf-c5dea079b2a6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:04.762600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.763531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.763823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.764104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.765038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:04.769395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.769486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.769702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.771023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] PATH_INFO: `/v3/users/2657b02ed69e469fafafc9127b5058cb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:04.773876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2657b02ed69e469fafafc9127b5058cb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.776292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.845145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2657b02ed69e469fafafc9127b5058cb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.846210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:04.848808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:04.865782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2657b02ed69e469fafafc9127b5058cb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.870227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1243/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:04.871213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:04.886497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:04.891355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2657b02ed69e469fafafc9127b5058cb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.894623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2657b02ed69e469fafafc9127b5058cb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.920319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b933d1a-61b6-4ce8-84a8-0f31dc4cbb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2657b02ed69e469fafafc9127b5058cb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:04.980673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1271/2514] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:04 2022] DELETE /identity/v3/users/2657b02ed69e469fafafc9127b5058cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:04.986624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:04.986983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:04.999556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:05.071348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5176cc-4de7-4825-9604-6cdf79757a6d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:05.098025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:05.100057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:05.186364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:05.187128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:05.187415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:05.187687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:05.190015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:05.232185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1272/2515] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:05.273083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:05.274608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:05.285000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1244/2516] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:05.293830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:05.295479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:05.311243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609944a-e000-4388-9e07-55f8757aa319 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:05.316980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:05.317830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:05.318122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:05.318723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:05.331861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:05.332690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:05.348089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1273/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:06.703668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:06.705394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:06.732141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf4e0b-7537-4adc-847a-c9aef431a93c service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:06.737716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:06.738823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:06.739137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:06.739479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] PATH_INFO: `/v3/projects/dcd560b43be74b8695b2a917defd0497` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:06.740769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd560b43be74b8695b2a917defd0497)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:06.743406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:06.809844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd560b43be74b8695b2a917defd0497', 'request_id': 'req-34e9051a-9dcc-42c1-a8e5-43566be92eba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:06.831187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd560b43be74b8695b2a917defd0497', 'request_id': 'req-34e9051a-9dcc-42c1-a8e5-43566be92eba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:06.837555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd560b43be74b8695b2a917defd0497', 'request_id': 'req-34e9051a-9dcc-42c1-a8e5-43566be92eba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:06.853416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] The token cache is being invalidate because project dcd560b43be74b8695b2a917defd0497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:06.853732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:06.855247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:06.861285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1245/2518] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:06 2022] DELETE /identity/v3/projects/dcd560b43be74b8695b2a917defd0497 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:06.863698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:06.877107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f270-391a-49d0-8440-375b29beaa6e service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:06.949658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:06.950615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:06.950897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:06.951994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] PATH_INFO: `/v3/users/3efefc97aadf4e059837766569185ff4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:06.954153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efefc97aadf4e059837766569185ff4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:06.956284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:07.007837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efefc97aadf4e059837766569185ff4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:07.019950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efefc97aadf4e059837766569185ff4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:07.021036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efefc97aadf4e059837766569185ff4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:07.021841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efefc97aadf4e059837766569185ff4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:07.040556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efefc97aadf4e059837766569185ff4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:07.073676 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1274/2519] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:06 2022] DELETE /identity/v3/users/3efefc97aadf4e059837766569185ff4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:08.149416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:08.150943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.168880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:08.170983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.193502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9051a-9dcc-42c1-a8e5-43566be92eba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:08.360406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66381b24-e92f-4ef5-af44-9d854d08ff75 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:08.371522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:08.372426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.372910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.373331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] PATH_INFO: `/v3/users/34854e39546b41e98704f26501d8c8ab` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.374210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:08.374945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34854e39546b41e98704f26501d8c8ab)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:08.375449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.375950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.376484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] PATH_INFO: `/v3/projects/3cd060f313a04b86bd019ead7321a583` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.377693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:08.379543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd060f313a04b86bd019ead7321a583)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:08.382937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:08.535533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34854e39546b41e98704f26501d8c8ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.545762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd060f313a04b86bd019ead7321a583', 'request_id': 'req-74ba84b2-d994-4b97-9343-a215295920eb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.560725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34854e39546b41e98704f26501d8c8ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.562416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34854e39546b41e98704f26501d8c8ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.563943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34854e39546b41e98704f26501d8c8ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.564688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd060f313a04b86bd019ead7321a583', 'request_id': 'req-74ba84b2-d994-4b97-9343-a215295920eb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.581411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd060f313a04b86bd019ead7321a583', 'request_id': 'req-74ba84b2-d994-4b97-9343-a215295920eb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.588699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a7bf6c31-a142-43ff-96a7-e718d894b1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34854e39546b41e98704f26501d8c8ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.614789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] The token cache is being invalidate because project 3cd060f313a04b86bd019ead7321a583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:08.615102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.615846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-74ba84b2-d994-4b97-9343-a215295920eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:08.619350 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1246/2520] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:08 2022] DELETE /identity/v3/projects/3cd060f313a04b86bd019ead7321a583 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:08.621472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.621764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.622042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.633396 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1275/2521] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:08 2022] DELETE /identity/v3/users/34854e39546b41e98704f26501d8c8ab => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:08.639631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d2a5-f0ee-4c2d-b999-c3e469b7a598 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.640200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d2a5-f0ee-4c2d-b999-c3e469b7a598 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.640690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d2a5-f0ee-4c2d-b999-c3e469b7a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.724163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] MFA Rules not processed for user `82d0dd5279384016ba00c5688ce1d615`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:08.727709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.729083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7d77d2a5-f0ee-4c2d-b999-c3e469b7a598 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:08.730782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d77d2a5-f0ee-4c2d-b999-c3e469b7a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.873960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1276/2522] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:08.883182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd622-e73f-4ae6-9d1f-765b0a2f09cd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.883624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd622-e73f-4ae6-9d1f-765b0a2f09cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.884003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd622-e73f-4ae6-9d1f-765b0a2f09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.910372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-280bd622-e73f-4ae6-9d1f-765b0a2f09cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:08.912139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-280bd622-e73f-4ae6-9d1f-765b0a2f09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.925395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1247/2523] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:08.929979 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1277/2524] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:08.934106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:08.935988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.936274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.936577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.955715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5baca8-6321-4d12-a1d2-43f557fc657d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:08.960053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] MFA Rules not processed for user `82d0dd5279384016ba00c5688ce1d615`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:08.961367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:08.962879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:08.964645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:08.965293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:08.965777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:08.967060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:08.967469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:08.969812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:08.978153 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1278/2525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:08.985813 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1248/2526] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:08.990036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.003478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00339f-8dec-42df-85a7-f9a8fe4aa501 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.008627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.009322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.009608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.009887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.010593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.013144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.055517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1279/2527] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:08 2022] POST /identity/v3/projects => generated 407 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:09.056916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.083338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818199-20f7-4f62-9108-968673da0fad admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.180752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.196827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.197546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.197986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.198897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.202132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.255049 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1249/2528] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:09 2022] POST /identity/v3/users => generated 304 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:09.257012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.259208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:09.263480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.287079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4642897-89fe-411e-84e3-83fcc03eb1e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.296218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c211-6d43-466d-ad9d-3691f7f69e55 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.299691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.300608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.301379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.301678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] PATH_INFO: `/v3/projects/38e81bc12e244167b6e8410e634607aa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.303358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e81bc12e244167b6e8410e634607aa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.306464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.310720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.311794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.312267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.312750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.313689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.321915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.346333 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1250/2529] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:09.349165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.383384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45014b-5ad4-4b5e-9582-964900aaaaa7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.394361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.399823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.401409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.401920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.414158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.416803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.480410 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1251/2530] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:09.484242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.485570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e81bc12e244167b6e8410e634607aa', 'request_id': 'req-c1308a99-da5d-4678-8956-1e6a979178d3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:09.502863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e81bc12e244167b6e8410e634607aa', 'request_id': 'req-c1308a99-da5d-4678-8956-1e6a979178d3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:09.509492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f3df6-a3bc-450b-93e6-a8f05b86678a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.516762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e81bc12e244167b6e8410e634607aa', 'request_id': 'req-c1308a99-da5d-4678-8956-1e6a979178d3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:09.533882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] The token cache is being invalidate because project 38e81bc12e244167b6e8410e634607aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:09.534427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:09.537312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:09.539977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1280/2531] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:09 2022] DELETE /identity/v3/projects/38e81bc12e244167b6e8410e634607aa => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:09.541174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:09.544820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:09.632922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1308a99-da5d-4678-8956-1e6a979178d3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:09.642612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.643285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.643571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.643850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.649468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:09.669162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:09.670347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.670531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.670801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] PATH_INFO: `/v3/projects/88c7e099234e4d2d84e2cdfe1908dfa1/users/4b7ba07d26e8487591c3cf85e90e5b2f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.710519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c7e099234e4d2d84e2cdfe1908dfa1, user_id=4b7ba07d26e8487591c3cf85e90e5b2f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.717302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235b96-98bd-40be-a87e-c7279de6c0de admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.751293 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1252/2532] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:09 2022] PUT /identity/v3/projects/88c7e099234e4d2d84e2cdfe1908dfa1/users/4b7ba07d26e8487591c3cf85e90e5b2f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:09.753737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8536e5-0473-4b50-80e6-224c8dac4a54 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.754236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8536e5-0473-4b50-80e6-224c8dac4a54 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.754722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8536e5-0473-4b50-80e6-224c8dac4a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.788116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:09.790030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5a769-2019-45cc-947b-6172e12e5c78 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:09.807986 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1281/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:09.808572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1b8536e5-0473-4b50-80e6-224c8dac4a54 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:09.809921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b8536e5-0473-4b50-80e6-224c8dac4a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:09.810155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.810450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.810728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:09.852058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] MFA Rules not processed for user `4b7ba07d26e8487591c3cf85e90e5b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:09.853814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:09.952499 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1253/2534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:09.957104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3136-0f5c-4dd6-ac85-0da022b57a80 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:09.959819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3136-0f5c-4dd6-ac85-0da022b57a80 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:09.960335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3136-0f5c-4dd6-ac85-0da022b57a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.013403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1282/2535] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:10.030169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.032535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:10.056010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11165-2ec4-4532-86c5-feb87c7eadf1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.071382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.072472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.073086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.074306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.076064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.080740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.170065 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1283/2536] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:10 2022] POST /identity/v3/projects => generated 407 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:10.171268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.367272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a57c78-396c-4ff2-947f-b9862ad0ddf1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.378909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9fff3136-0f5c-4dd6-ac85-0da022b57a80 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:10.380139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9fff3136-0f5c-4dd6-ac85-0da022b57a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:10.402191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.403890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.404190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.404599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.405309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.409230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.418763 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1254/2537] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:10.422304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.423949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.426152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.472879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] MFA Rules not processed for user `a2e061bb9a054fb1945417baf444eaee`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:10.474583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:10.494124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1284/2538] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:10 2022] POST /identity/v3/users => generated 310 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:10.500751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.536333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14f0c-d6bb-4ec2-b9a6-f299d25b49fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.552704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.553136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.553467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.553752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.554485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:10.554798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.556416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.591149 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1255/2539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:10.591342 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1285/2540] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:10.592075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.592198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.610827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd303a4-5eff-4652-9434-6caec54ac2fd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.611471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c35593-8bdb-4d6c-94b4-bc848b0bbe43 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.615959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.616679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.616963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.617240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.618133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.618274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.619174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.619707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.619815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.620425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.621618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.626291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.646118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1256/2541] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:10.646995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.677359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263f4e-79ce-4469-b50a-b17aef01a257 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.688720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.689799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.690137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.690683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] PATH_INFO: `/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3/users/931c8cac1c1a46a2b914eea15371083a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.691298 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1286/2542] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:10 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:10.696068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.746498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3f37d42d5d4616a3f3224fa72fdff3, user_id=931c8cac1c1a46a2b914eea15371083a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.751295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.780371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b569-3614-49e0-8201-dc17d3d4cc66 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.804267 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1257/2543] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:10 2022] PUT /identity/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3/users/931c8cac1c1a46a2b914eea15371083a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:10.810473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.918985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.919677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.919965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.920241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.921547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.928540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.960723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c13899-5f36-4421-97bf-3062740a219a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.965363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.966023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.966399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.966742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.970797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.970797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:10.971384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1287/2544] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:10 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:53:10.972718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.983276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4305e-37fc-47e9-8ffc-e1d85585974e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:10.990395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:10.991064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1258/2545] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:10.991956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:10.992119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:10.992719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:10.993288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:10.994753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:10.997550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:11.016728 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1288/2546] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:11.018221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:11.020393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38cb94-0b18-46af-969d-bf6295ae06df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:11.027061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:11.028205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.028528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.028813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] PATH_INFO: `/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3/users/931c8cac1c1a46a2b914eea15371083a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.031131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3f37d42d5d4616a3f3224fa72fdff3, user_id=931c8cac1c1a46a2b914eea15371083a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:11.031933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a85b-3cfd-4d38-bb9e-359e07775113 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:11.034139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7fa82-9ff7-4917-8800-8f75eb1b2f7d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:11.038784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:11.039976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.040445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.040950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.042323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:11.044264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:11.063607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1259/2547] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:10 2022] PUT /identity/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3/users/931c8cac1c1a46a2b914eea15371083a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:11.064304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1289/2548] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:11.065954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:11.066725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.067127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.067491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.092682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f57a5-3377-486c-b015-840b671be8a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:11.135977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] MFA Rules not processed for user `931c8cac1c1a46a2b914eea15371083a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:11.139438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:11.220936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:11.222082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.222372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.224239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] PATH_INFO: `/v3/projects/a2b5a50c00394b35b72f313d4ce7bc59/users/ae43673ecf98455daa8fd07819c409ab/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.257028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1260/2549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:11.268099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:11.269647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b5a50c00394b35b72f313d4ce7bc59, user_id=ae43673ecf98455daa8fd07819c409ab, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:11.272404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d62882-eb1f-4467-b31a-95f5f565efde admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:11.301573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe2d9f-473c-4160-8de9-5baf11934b34 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:11.315984 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1290/2550] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:11 2022] PUT /identity/v3/projects/a2b5a50c00394b35b72f313d4ce7bc59/users/ae43673ecf98455daa8fd07819c409ab/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:11.321736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.322159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.322311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.419880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:11.420315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.420619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.420834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] PATH_INFO: `/v3/users/4b7ba07d26e8487591c3cf85e90e5b2f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.422058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7ba07d26e8487591c3cf85e90e5b2f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:11.425571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:11.435344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] MFA Rules not processed for user `ae43673ecf98455daa8fd07819c409ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:11.461057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:11.504153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7ba07d26e8487591c3cf85e90e5b2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:11.524761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7ba07d26e8487591c3cf85e90e5b2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:11.526102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7ba07d26e8487591c3cf85e90e5b2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:11.539132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7ba07d26e8487591c3cf85e90e5b2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:11.556360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88818639-0b57-4be9-b262-76f13d666af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7ba07d26e8487591c3cf85e90e5b2f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:11.586042 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1261/2551] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:11 2022] DELETE /identity/v3/users/4b7ba07d26e8487591c3cf85e90e5b2f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:11.587731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:11.588031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:11.588318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:11.649532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:11.652791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:11.654635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1291/2552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:11.758209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:11.759801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:11.823653 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1262/2553] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:11.869576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:11.871390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:11.951657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7946c3f-4114-4585-a790-46b7b94a3a3a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:12.000432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b876-30c3-4f00-8d34-4e31018ff463 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:12.010814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:12.010814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:12.010814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:12.011166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:12.033456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:12.035053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:12.057257 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1263/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:12.086106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:12.088403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:12.089628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:12.090445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:12.270072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:12.271903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:12.285722 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1292/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:13.005741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:13.009531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:13.046074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917389e9-7de3-4914-8e30-dd4e83381017 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:13.080257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:13.084021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:13.084444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:13.085762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] PATH_INFO: `/v3/projects/88c7e099234e4d2d84e2cdfe1908dfa1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:13.093237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c7e099234e4d2d84e2cdfe1908dfa1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:13.100908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:13.288029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c7e099234e4d2d84e2cdfe1908dfa1', 'request_id': 'req-809fec2b-9554-48b3-8043-6fec56daf498'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.308241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c7e099234e4d2d84e2cdfe1908dfa1', 'request_id': 'req-809fec2b-9554-48b3-8043-6fec56daf498'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.327084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c7e099234e4d2d84e2cdfe1908dfa1', 'request_id': 'req-809fec2b-9554-48b3-8043-6fec56daf498'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.370183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] The token cache is being invalidate because project 88c7e099234e4d2d84e2cdfe1908dfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:13.370485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.372099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.385841 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1264/2556] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:13 2022] DELETE /identity/v3/projects/88c7e099234e4d2d84e2cdfe1908dfa1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:13.389999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:13.407711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd3dd-1a53-4f4b-9bf6-3b07473df663 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:13.607714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:13.609175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:13.609462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:13.609826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] PATH_INFO: `/v3/users/931c8cac1c1a46a2b914eea15371083a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:13.611145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931c8cac1c1a46a2b914eea15371083a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:13.615102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:13.719021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:13.719332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931c8cac1c1a46a2b914eea15371083a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.720510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:13.740881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931c8cac1c1a46a2b914eea15371083a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.742309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931c8cac1c1a46a2b914eea15371083a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.743459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931c8cac1c1a46a2b914eea15371083a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.745328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fec2b-9554-48b3-8043-6fec56daf498 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:13.756863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:13.758096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:13.760622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:13.760917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] PATH_INFO: `/v3/users/ae43673ecf98455daa8fd07819c409ab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:13.763238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae43673ecf98455daa8fd07819c409ab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:13.766075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:13.779265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90969c22-9748-4f94-8dd0-7d1468587a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931c8cac1c1a46a2b914eea15371083a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.820248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1293/2557] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:13 2022] DELETE /identity/v3/users/931c8cac1c1a46a2b914eea15371083a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:13.908226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae43673ecf98455daa8fd07819c409ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.945352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae43673ecf98455daa8fd07819c409ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.947565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae43673ecf98455daa8fd07819c409ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.967057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae43673ecf98455daa8fd07819c409ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:13.998524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae43673ecf98455daa8fd07819c409ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:14.028906 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1265/2558] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:13 2022] DELETE /identity/v3/users/ae43673ecf98455daa8fd07819c409ab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:14.035020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:14.035203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:14.035460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:14.089265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:14.090530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:14.273541 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1294/2559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:14.286609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:14.289042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:14.492714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e85-14f3-413d-abaa-05a8ec0faf92 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:14.501333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:14.502389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:14.503741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:14.504215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:14.526912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:14.529525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975fd3c-fdce-4122-89ee-d9cca43de74c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:14.548285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1266/2560] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:16.129247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.130829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.154759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30325-a0a8-423c-89cb-db5b42c68d9f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.165704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.167730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.168086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.168682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] PATH_INFO: `/v3/projects/a2b5a50c00394b35b72f313d4ce7bc59` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.170834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b5a50c00394b35b72f313d4ce7bc59)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:16.176269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:16.266734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b5a50c00394b35b72f313d4ce7bc59', 'request_id': 'req-91a316a1-363b-4a05-8fb5-8d710099aa89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.280079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b5a50c00394b35b72f313d4ce7bc59', 'request_id': 'req-91a316a1-363b-4a05-8fb5-8d710099aa89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.311356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b5a50c00394b35b72f313d4ce7bc59', 'request_id': 'req-91a316a1-363b-4a05-8fb5-8d710099aa89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.328781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] The token cache is being invalidate because project a2b5a50c00394b35b72f313d4ce7bc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:16.329069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.329833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.332305 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1295/2561] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:16 2022] DELETE /identity/v3/projects/a2b5a50c00394b35b72f313d4ce7bc59 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:16.337119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b60a9-5ec9-4ee0-af7a-a2e8966967b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.338057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b60a9-5ec9-4ee0-af7a-a2e8966967b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.338540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b60a9-5ec9-4ee0-af7a-a2e8966967b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.378906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6a6b60a9-5ec9-4ee0-af7a-a2e8966967b7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:16.382974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6a6b60a9-5ec9-4ee0-af7a-a2e8966967b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.389194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.391515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.532727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a316a1-363b-4a05-8fb5-8d710099aa89 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.544746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.546341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.547146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.547446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] PATH_INFO: `/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.549117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3f37d42d5d4616a3f3224fa72fdff3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:16.551063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:16.570264 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1267/2562] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:16.571924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.572771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.572771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.608990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:16.612034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.636846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3f37d42d5d4616a3f3224fa72fdff3', 'request_id': 'req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.644954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3f37d42d5d4616a3f3224fa72fdff3', 'request_id': 'req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.657306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3f37d42d5d4616a3f3224fa72fdff3', 'request_id': 'req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.688783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] The token cache is being invalidate because project ca3f37d42d5d4616a3f3224fa72fdff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:16.689999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.690892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2ae2f997-b9f4-43c1-b0a5-69eddb5b44f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:16.693818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1296/2563] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:16 2022] DELETE /identity/v3/projects/ca3f37d42d5d4616a3f3224fa72fdff3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:16.700265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f60b-4284-4a9a-ac1a-ecb6ea1382c1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.700578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f60b-4284-4a9a-ac1a-ecb6ea1382c1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.700858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f60b-4284-4a9a-ac1a-ecb6ea1382c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.747299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-79b7f60b-4284-4a9a-ac1a-ecb6ea1382c1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:16.749287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-79b7f60b-4284-4a9a-ac1a-ecb6ea1382c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.760627 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1268/2564] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:16.763294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.768042 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1297/2565] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:16.773732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ad9fb-b9ac-450c-a7f9-6b11acf52374 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.776791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.777292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.777576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.782833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.782833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.782833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.782833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.784396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:16.784396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:16.784396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:16.799614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1269/2566] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:53:16.803530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.810832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:16.812625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:16.814174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d262e-fc31-4b53-bb6d-2e83ef63a1c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.819460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.820639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.820784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.821290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.822112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:16.824136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:16.829194 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1298/2567] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:16.830765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.848958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ceb0a-831c-4125-bda0-f9934e86ea21 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.859110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.860238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.860751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.861646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.862562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:16.863098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:16.865199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:16.866971 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1270/2568] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:53:16.870972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.893297 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1299/2569] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:16.895954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:16.924719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd95eb-6ba0-4fe0-b0a0-6b1eba91a1f2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.979918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737009b-f447-4f34-8312-2fe1cd9564d3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:16.991945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:16.992799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:16.994040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:16.994417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:16.995351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.000030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d0dd5-2447-4669-b3e2-f6adac3727a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.036407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1271/2570] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:17.041034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.041272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.041397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.042302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.042583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.043150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.043748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.044933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.047650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.094756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] MFA Rules not processed for user `cf5e0bd625644d9eabf92db0624219e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:17.096043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:17.099283 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1300/2571] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:16 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:17.100929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.218465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a80fb-655a-4147-a10b-6e725e708107 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.246976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.247670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.256762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.256762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.257110 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1272/2572] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:17.257110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.257263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.259264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.282943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b64879-1260-48f6-83d6-9e842d081a6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.289360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1301/2573] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:17.290966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.293570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:17.298706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.300313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.300691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.300978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.301867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.306937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.326065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3027f-de9b-4499-9475-8d0dc7b92311 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.339838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.340664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.340941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.341216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.341912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.343833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.354003 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1273/2574] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:17 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:17.354003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.380080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985dd-6830-426e-aa36-9608e3e13094 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.388856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1302/2575] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:17 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:17.390056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.463311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.464180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.464567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.464919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.465914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.467412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.482981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1274/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:17.484243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.495812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335d60-5974-442f-a445-ca6437c8e224 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.505177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.506156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.506512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.507301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.507611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.510099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.531326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28373-bf89-4980-ac19-459e931aedbe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.545517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.546341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.546477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.546777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.548048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.557588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.559188 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1275/2577] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:17 2022] POST /identity/v3/users => generated 298 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:17.568487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.591228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670703e-bfa5-41e4-b5ba-8311ac6554a4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.592972 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1303/2578] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:17.596826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.597494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.598507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.598860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.599213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] PATH_INFO: `/v3/projects/abb6d9d53aaf43509015709451572a4b/users/1dc0fadfca884ab68a93a3f7ccab060d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.622216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb6d9d53aaf43509015709451572a4b, user_id=1dc0fadfca884ab68a93a3f7ccab060d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.625196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9caf6-f013-4cb6-988c-15267eecb3c9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.625353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.644949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.647642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.647995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.648286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.650843 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1276/2579] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:17 2022] PUT /identity/v3/projects/abb6d9d53aaf43509015709451572a4b/users/1dc0fadfca884ab68a93a3f7ccab060d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:17.652341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.654565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.655214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793547-005f-479d-8eaa-033b21ca7f06 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.688538 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1304/2580] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:17.695466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.695760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.696038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.773684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3674a-1986-4131-ac50-bf9af17264fb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.779876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] MFA Rules not processed for user `1dc0fadfca884ab68a93a3f7ccab060d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:17.780827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.782715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.783096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.783455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.783574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:17.784287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.787247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.800648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1277/2581] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:17.801901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.816603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78f97-22aa-4d0b-aec8-f8b341939279 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:17.822118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:17.823600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:17.823890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:17.824250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] PATH_INFO: `/v3/projects/f13f1d267fc04ac989b506aaa7708ddc/users/2f721650b0c6470eb76943460ae60b2b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:17.844095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13f1d267fc04ac989b506aaa7708ddc, user_id=2f721650b0c6470eb76943460ae60b2b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:17.847639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:17.871784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1278/2582] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:17 2022] PUT /identity/v3/projects/f13f1d267fc04ac989b506aaa7708ddc/users/2f721650b0c6470eb76943460ae60b2b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:17.874224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.917143 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1305/2583] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:17.919725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:17.953725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed302-f37f-4275-8ee4-9346c4ce613e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.023534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60547572-63c3-45df-8d99-edf6fb9154bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.036739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.040293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.040749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.042371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] PATH_INFO: `/v3/projects/0e3659a4fe104604ab6161e28854b4a6/users/c24dff48d3544e049af02871f27b2a2c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.071803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3659a4fe104604ab6161e28854b4a6, user_id=c24dff48d3544e049af02871f27b2a2c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.095695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.117698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.118536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.118926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.119276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.120360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.122368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ae074-3baf-4b5c-9ae8-f387c390b5f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.137255 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1279/2584] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:17 2022] PUT /identity/v3/projects/0e3659a4fe104604ab6161e28854b4a6/users/c24dff48d3544e049af02871f27b2a2c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:18.138289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.140112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:18.151715 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1306/2585] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:18.151715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.151715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.151715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.229101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] MFA Rules not processed for user `c24dff48d3544e049af02871f27b2a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:18.231143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:18.261696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0316-e483-4822-bec7-9a13c48ed2cf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.276830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.277702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.278092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.278468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.376379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.378823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.384129 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1307/2586] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:18.385045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.391347 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1280/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:18.392303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.483235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0de43-c4ad-4876-a57b-17a15b31764a service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.498838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.499938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.499938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.500385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.501205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.503337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.562960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc232-8d91-4783-a644-8df0c123ad8b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.568943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.570017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.570406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.570788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] PATH_INFO: `/v3/projects/f13f1d267fc04ac989b506aaa7708ddc/users/2f721650b0c6470eb76943460ae60b2b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.577946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13f1d267fc04ac989b506aaa7708ddc, user_id=2f721650b0c6470eb76943460ae60b2b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.581156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.608656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1281/2589] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:18 2022] POST /identity/v3/projects => generated 395 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:18.608656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.609088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1308/2589] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:18 2022] PUT /identity/v3/projects/f13f1d267fc04ac989b506aaa7708ddc/users/2f721650b0c6470eb76943460ae60b2b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:18.610521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.765961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d7e3a-ad7f-4e66-95b1-53f0425e5534 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.782769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.783721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.784214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.784633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.785770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.790916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.795492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340505d-2b29-4cf4-a238-188c939cc917 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.809467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.811918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.812420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.813170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] PATH_INFO: `/v3/users/1dc0fadfca884ab68a93a3f7ccab060d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.826567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc0fadfca884ab68a93a3f7ccab060d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.828669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.833170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1309/2590] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:18 2022] POST /identity/v3/users => generated 304 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:18.839948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.872270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1ce9-101f-4524-8960-7588482aada2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.880906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.882503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.882961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.883426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.884652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.887289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.909806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc0fadfca884ab68a93a3f7ccab060d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:18.910034 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1310/2591] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:18.910983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:18.926078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c3141-52d6-427e-8752-6a8aeadf1338 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:18.932849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:18.933185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc0fadfca884ab68a93a3f7ccab060d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:18.933888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.934233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.934515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] PATH_INFO: `/v3/projects/e05922789c9541b695a41ac4ef91c389/users/791c932b1f4f4a46927e0f2bc0e7b171/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.935404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc0fadfca884ab68a93a3f7ccab060d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:18.956302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc0fadfca884ab68a93a3f7ccab060d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:18.957575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05922789c9541b695a41ac4ef91c389, user_id=791c932b1f4f4a46927e0f2bc0e7b171, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:18.964521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:18.969171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a06296b-a222-4701-b2b2-8877f3acc87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc0fadfca884ab68a93a3f7ccab060d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:18.982076 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1282/2592] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:18 2022] DELETE /identity/v3/users/1dc0fadfca884ab68a93a3f7ccab060d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:18.987887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d510-4673-496d-9197-f2858e3d705a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:18.988504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d510-4673-496d-9197-f2858e3d705a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:18.989812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d510-4673-496d-9197-f2858e3d705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:18.998039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1311/2593] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:18 2022] PUT /identity/v3/projects/e05922789c9541b695a41ac4ef91c389/users/791c932b1f4f4a46927e0f2bc0e7b171/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:19.001802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:19.004042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.080205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5d53d510-4673-496d-9197-f2858e3d705a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:19.082847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d53d510-4673-496d-9197-f2858e3d705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.122252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c9c3e-9bca-4b2c-84c2-226b9e334bff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:19.133509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:19.135126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.137167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.137558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.138688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:19.143020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:19.174279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1312/2594] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:19.176387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:19.205496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f487-728b-45f5-a7ad-e5b97151a80d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:19.217908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:19.219150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.220939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.222063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] PATH_INFO: `/v3/projects/e05922789c9541b695a41ac4ef91c389/users/791c932b1f4f4a46927e0f2bc0e7b171/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.227139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05922789c9541b695a41ac4ef91c389, user_id=791c932b1f4f4a46927e0f2bc0e7b171, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:19.233673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:19.244698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1283/2595] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:19.251537 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1313/2596] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:19 2022] PUT /identity/v3/projects/e05922789c9541b695a41ac4ef91c389/users/791c932b1f4f4a46927e0f2bc0e7b171/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:19.262554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9968e-55f7-4253-a033-4079601e007f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.262887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9968e-55f7-4253-a033-4079601e007f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.263123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9968e-55f7-4253-a033-4079601e007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.294184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5cc9968e-55f7-4253-a033-4079601e007f None None] MFA Rules not processed for user `791c932b1f4f4a46927e0f2bc0e7b171`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:19.295316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5cc9968e-55f7-4253-a033-4079601e007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.305366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:19.308146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.392508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1284/2597] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:19.403288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.403573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.403854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.462272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] MFA Rules not processed for user `c24dff48d3544e049af02871f27b2a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:19.464416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.485092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75d9b7-02d8-47c2-a0a7-478eb0a19346 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:19.496289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:19.497032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.497319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.498492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.601084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1285/2598] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:19.639523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:19.641049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:19.668984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:19.670346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.683360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1314/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:53:19.784844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5b3c2-c359-4a56-ad24-eebd24a4ab30 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:19.792129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:19.792830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:19.793117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:19.793396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:19.795232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:19.808486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:19.810711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4f77-945a-472c-a047-0379bdd0a24f service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:19.824320 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1286/2600] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:20.873300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:20.876210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:20.896351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990008-62f4-41c9-8b7c-b325811340a5 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:20.902780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:20.903984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:20.904366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:20.907185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] PATH_INFO: `/v3/projects/abb6d9d53aaf43509015709451572a4b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:20.914770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb6d9d53aaf43509015709451572a4b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:20.918733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:21.047122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb6d9d53aaf43509015709451572a4b', 'request_id': 'req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:21.065744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb6d9d53aaf43509015709451572a4b', 'request_id': 'req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:21.088281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb6d9d53aaf43509015709451572a4b', 'request_id': 'req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:21.114580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] The token cache is being invalidate because project abb6d9d53aaf43509015709451572a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:21.114892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:21.118096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b89c8d9-97ae-4c94-af7a-fd6200cebd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:21.124211 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1315/2601] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:20 2022] DELETE /identity/v3/projects/abb6d9d53aaf43509015709451572a4b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:21.128868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:21.129384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:21.129471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:21.193084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:21.194903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:21.413833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1287/2602] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:21.423357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:21.423913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:21.424204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:21.476522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:21.480663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:21.511544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1316/2603] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:21.516695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:21.530190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7632ec-675a-4271-a74e-c88417a0f081 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:21.548540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:21.549225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:21.549478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:21.549756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:21.550483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:21.550793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:21.552444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:21.608227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1288/2604] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:21.612694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:21.629764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2041e-b6d3-400b-98c7-3b7791076173 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:21.643160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:21.643841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:21.644124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:21.644400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:21.645516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:21.647477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:21.725954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1317/2605] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:21 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:21.729817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:21.740173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febc51-e97b-44aa-a3d8-7e995629fe79 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:21.908394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:21.909114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:21.909416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:21.916751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:21.918138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:21.925253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:21.966915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1289/2606] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:21 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:21.971306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:21.994216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e30f8-eccc-4ee8-8140-09903cc0b8e1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.009726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.010429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.010808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.011532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.012282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.014007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.070854 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1318/2607] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:22.072053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:22.086303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a3331-bb0e-42e9-99df-0424efffc308 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.103361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.104275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.105711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.105711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.105711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.107601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.130392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1290/2608] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:22.131565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:22.133833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:22.133979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:22.173887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f449b-e6ff-45d8-9ee3-885b2825244d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.179191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.180844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.181289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.181744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] PATH_INFO: `/v3/users/b6bd66a0c09642dc91a334698fbd4daa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.183304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bd66a0c09642dc91a334698fbd4daa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.185255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd16d-1c59-4665-a1bb-0519263aea20 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.187540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.215591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.218242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.222454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.226486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] PATH_INFO: `/v3/projects/8d12a2c8ad9a43f2bded1c2804915030/users/67d48665a950454aa634b35c21bbb279/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.265267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bd66a0c09642dc91a334698fbd4daa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:22.282426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bd66a0c09642dc91a334698fbd4daa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:22.283693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bd66a0c09642dc91a334698fbd4daa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:22.285982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bd66a0c09642dc91a334698fbd4daa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:22.290886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d12a2c8ad9a43f2bded1c2804915030, user_id=67d48665a950454aa634b35c21bbb279, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.301760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa92ade-9a1e-4d4b-a640-30db37b2f465 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.309622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-972fcfc3-9cab-49b2-a483-3c5c935fc7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bd66a0c09642dc91a334698fbd4daa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:22.345641 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1291/2609] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:22 2022] PUT /identity/v3/projects/8d12a2c8ad9a43f2bded1c2804915030/users/67d48665a950454aa634b35c21bbb279/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:22.348954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.350076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.350326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1319/2610] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:22 2022] DELETE /identity/v3/users/b6bd66a0c09642dc91a334698fbd4daa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:22.350848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.354455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.354690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.354903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.390133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:22.391394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:22.433941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:22.435507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:22.508335 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1320/2611] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:22.574797 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1292/2612] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:22.616013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:22.617834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:22.626756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:22.629363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:22.730606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678d24a-c7ae-43bd-8cf9-0de2b0868e11 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.734858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.735797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.736235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.736719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.747526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.749456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.757533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c80444-21be-412c-a94b-0d98e0ee831b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:22.764645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:22.765662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:22.766128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:22.766688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:22.767899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1321/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:22.779232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:22.781038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:22.799414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1293/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:24.244833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:24.246760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:24.273157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae16bf9-bdeb-43a1-968a-7893b080dbc5 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:24.287830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:24.288789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:24.289071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:24.289538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] PATH_INFO: `/v3/projects/7755ff4a52a843d5afe245dd067d37fb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:24.294820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7755ff4a52a843d5afe245dd067d37fb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:24.297247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:24.456850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7755ff4a52a843d5afe245dd067d37fb', 'request_id': 'req-59ece0fc-d886-4862-a0d6-76a5cbb8353b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.469548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7755ff4a52a843d5afe245dd067d37fb', 'request_id': 'req-59ece0fc-d886-4862-a0d6-76a5cbb8353b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.483648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7755ff4a52a843d5afe245dd067d37fb', 'request_id': 'req-59ece0fc-d886-4862-a0d6-76a5cbb8353b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.508659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] The token cache is being invalidate because project 7755ff4a52a843d5afe245dd067d37fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:24.509145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.509953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.516249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1322/2615] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:24 2022] DELETE /identity/v3/projects/7755ff4a52a843d5afe245dd067d37fb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:24.517050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:24.533257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82715ad-e8cf-4c26-90d8-15aa01d2d9bd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:24.693991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:24.698178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:24.698452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:24.698734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] PATH_INFO: `/v3/users/00a52964722e4547a7f8daf32cd39476` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:24.705671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a52964722e4547a7f8daf32cd39476)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:24.708621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:24.809004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a52964722e4547a7f8daf32cd39476'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.832412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a52964722e4547a7f8daf32cd39476'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.833701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a52964722e4547a7f8daf32cd39476'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.847985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a52964722e4547a7f8daf32cd39476'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.870944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e1d81ac6-c3f8-4bf7-8513-ff9e7e4c481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a52964722e4547a7f8daf32cd39476'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:24.892764 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1294/2616] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:24 2022] DELETE /identity/v3/users/00a52964722e4547a7f8daf32cd39476 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:26.271044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:26.273228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:26.298198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ece0fc-d886-4862-a0d6-76a5cbb8353b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:26.500294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:26.501541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:26.502045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:26.502537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] PATH_INFO: `/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:26.503976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d66d2af87345d38fa807f9c3d25bf2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:26.508610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:26.607762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d66d2af87345d38fa807f9c3d25bf2', 'request_id': 'req-c4822119-a7e6-4780-baac-e49ecb15c9ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:26.617534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d66d2af87345d38fa807f9c3d25bf2', 'request_id': 'req-c4822119-a7e6-4780-baac-e49ecb15c9ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:26.644766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d66d2af87345d38fa807f9c3d25bf2', 'request_id': 'req-c4822119-a7e6-4780-baac-e49ecb15c9ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:26.669654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] The token cache is being invalidate because project c6d66d2af87345d38fa807f9c3d25bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:26.670872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:26.681382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4822119-a7e6-4780-baac-e49ecb15c9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:26.683673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1323/2617] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:26 2022] DELETE /identity/v3/projects/c6d66d2af87345d38fa807f9c3d25bf2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:26.688731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:26.689628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:26.690363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:26.730488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:26.731753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:26.827781 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1295/2618] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:26.837285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:26.837573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:26.837852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:26.869756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:26.871283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:26.882706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1324/2619] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:26.886862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:26.898065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7202c-863c-4d67-9ea4-fae412450dc1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:26.904524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:26.906109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:26.906616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:26.907222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:26.908273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:26.908795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:26.911182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:26.929281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1296/2620] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:26.934036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:26.947699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4592-be84-4230-b7a4-a44be0c46996 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:26.954765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:26.955984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:26.956394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:26.956774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:26.958968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:26.961376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.023873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1325/2621] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:26 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:53:27.024955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.039390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4705-f5f1-4845-bde7-bf6c665944f9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.137936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.138626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.139123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.139559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.140402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.142615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.178806 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1297/2622] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:27 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:27.182503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.198665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6415c-e9e4-4571-9339-18ea50acb2f3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.205544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.206772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.207063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.207344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.208177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.210653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.243899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.259625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1326/2623] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:27.260174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec55773-2818-41e5-9355-f3201168bd8c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.268280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.269060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.269377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.269662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.270580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.273137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639527-6457-4841-b29d-9eacf9c92926 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.291047 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1298/2624] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:27.295724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.310630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26847-e439-4252-a2b8-a79071ce4fd7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.317955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.319236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.319688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.320121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] PATH_INFO: `/v3/projects/98cc0bc9ea444d929db8bfb87ed4d6d5/users/bc678c07d6cd4b77a70ca88f185c6a2e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.353623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cc0bc9ea444d929db8bfb87ed4d6d5, user_id=bc678c07d6cd4b77a70ca88f185c6a2e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.358267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.390277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1327/2625] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:27 2022] PUT /identity/v3/projects/98cc0bc9ea444d929db8bfb87ed4d6d5/users/bc678c07d6cd4b77a70ca88f185c6a2e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:27.391342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.391631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.392076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.431017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] MFA Rules not processed for user `bc678c07d6cd4b77a70ca88f185c6a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:27.433104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:27.542941 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1299/2626] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:27.549040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.633324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2584e-d833-4c8c-9fa6-031d4ef95b50 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.640871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.643605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.644097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.644606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.645486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.649869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.694759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.696691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1328/2627] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:27 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:27.712488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8802fb-a940-4d45-9bcd-1a65cdeb3984 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.856592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.857588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.858024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.860297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.861827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.866144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.913871 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1300/2628] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:27 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:27.914858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.954026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501a964-45b3-480e-aafa-6f099efc262e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:27.964359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:27.966444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:27.966988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:27.967974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:27.968932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:27.970833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:27.992200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:27.998476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1329/2629] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:28.007388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c364303-806d-4221-b941-7a81b64176ae admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:28.033773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:28.035085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:28.035373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:28.035653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] PATH_INFO: `/v3/projects/da1d6d7095bf4102889aabebcd5cb05b/users/5505dd14fc234d57bf3a681b811c825a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:28.070990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1d6d7095bf4102889aabebcd5cb05b, user_id=5505dd14fc234d57bf3a681b811c825a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:28.073719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:28.106082 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1301/2630] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:27 2022] PUT /identity/v3/projects/da1d6d7095bf4102889aabebcd5cb05b/users/5505dd14fc234d57bf3a681b811c825a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:28.107354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:28.121967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443253e-d741-41e7-876b-ddfc2a13d49a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:28.220492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:28.221164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:28.221569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:28.221957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:28.222932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:28.225802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09b7a3-2686-409f-a760-3e2777a315d0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:28.240579 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1330/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:28.243159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:28.270205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10bf38-8291-4b3d-8c4f-1e450c8f3106 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:28.288309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:28.291214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:28.292698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:28.293174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] PATH_INFO: `/v3/projects/da1d6d7095bf4102889aabebcd5cb05b/users/5505dd14fc234d57bf3a681b811c825a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:28.301478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1d6d7095bf4102889aabebcd5cb05b, user_id=5505dd14fc234d57bf3a681b811c825a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:28.310262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:28.332613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1302/2632] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:28 2022] PUT /identity/v3/projects/da1d6d7095bf4102889aabebcd5cb05b/users/5505dd14fc234d57bf3a681b811c825a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:28.343117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:28.344399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:28.345021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:28.417683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] MFA Rules not processed for user `5505dd14fc234d57bf3a681b811c825a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:28.420409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:28.588695 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1331/2633] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:29.113050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:29.116029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:29.220672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5d173-7514-47e8-b7be-d2ede34cb69b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:29.231792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:29.234870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:29.235737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:29.236143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:29.250565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:29.252709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad5b2c-faaf-4f1d-a93e-9d7bf48b6a69 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:29.293531 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1303/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:30.624654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:30.664879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43427382-b248-4902-bdfe-b35f53a54351 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:30.705516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:30.706512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:30.706966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:30.707419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:30.881506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:30.883360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:30.908569 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1332/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:33.717197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:33.718773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:33.719244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:33.764354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] MFA Rules not processed for user `2f721650b0c6470eb76943460ae60b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:33.764354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:33.896669 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1304/2636] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:33.913967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:33.915717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:34.002390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:34.050568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b636084-4097-4442-b630-f9fd1c6115e9 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:34.058767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:34.059725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:34.060501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:34.060754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:34.072099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:34.073598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02366c87-1807-4e60-804b-50d14190f5fe service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:34.087640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1333/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:34.103373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d4bcc-0da7-44f9-bdc0-abc53c4e97cf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:34.109483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:34.110785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:34.111227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:34.111757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] PATH_INFO: `/v3/users/bc678c07d6cd4b77a70ca88f185c6a2e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:34.117820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc678c07d6cd4b77a70ca88f185c6a2e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:34.119847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:34.227502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc678c07d6cd4b77a70ca88f185c6a2e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:34.259406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc678c07d6cd4b77a70ca88f185c6a2e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:34.260250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc678c07d6cd4b77a70ca88f185c6a2e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:34.269358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc678c07d6cd4b77a70ca88f185c6a2e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:34.285469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc678c07d6cd4b77a70ca88f185c6a2e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:34.313886 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1305/2638] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:34 2022] DELETE /identity/v3/users/bc678c07d6cd4b77a70ca88f185c6a2e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:34.317174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7496-c319-4b60-9aff-4e458b3158e0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:34.317174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7496-c319-4b60-9aff-4e458b3158e0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:34.317174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7496-c319-4b60-9aff-4e458b3158e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:34.382088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0fa7496-c319-4b60-9aff-4e458b3158e0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:34.383739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0fa7496-c319-4b60-9aff-4e458b3158e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:34.609771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1334/2639] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:34.674143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:34.675858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:34.819452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:34.820224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:34.820762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:34.872956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057aec-ab11-44ed-8c29-c5a3f11abfc7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:34.876804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:34.877343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:34.877629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:34.877908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:34.889716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:34.890355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] MFA Rules not processed for user `67d48665a950454aa634b35c21bbb279`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:34.891164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:34.891583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:34.939833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1306/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:35.012917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1335/2641] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:35.147356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:35.149103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:35.358035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bcab-8cfc-45af-b7e1-1e7f7cd3c39d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:35.372962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:35.373592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:35.378086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:35.378397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:35.402810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:35.404573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:35.423651 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1307/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:35.899716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:35.902578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:35.932795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f119f-51b7-41ac-85d3-c9b085da34c5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:35.969906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:35.973273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:35.973574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:35.974363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] PATH_INFO: `/v3/projects/98cc0bc9ea444d929db8bfb87ed4d6d5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:35.981139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cc0bc9ea444d929db8bfb87ed4d6d5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:35.983134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:36.156930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cc0bc9ea444d929db8bfb87ed4d6d5', 'request_id': 'req-f0df9412-2151-469b-a4c7-cec645a142c5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.178629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cc0bc9ea444d929db8bfb87ed4d6d5', 'request_id': 'req-f0df9412-2151-469b-a4c7-cec645a142c5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.192364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cc0bc9ea444d929db8bfb87ed4d6d5', 'request_id': 'req-f0df9412-2151-469b-a4c7-cec645a142c5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.300794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] The token cache is being invalidate because project 98cc0bc9ea444d929db8bfb87ed4d6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:36.301454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.305278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0df9412-2151-469b-a4c7-cec645a142c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.318857 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1336/2643] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:35 2022] DELETE /identity/v3/projects/98cc0bc9ea444d929db8bfb87ed4d6d5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:36.322693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:36.373999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383a9-587f-4cb3-9258-70ff34a00936 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:36.618749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:36.620276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:36.620603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:36.621209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] PATH_INFO: `/v3/users/5505dd14fc234d57bf3a681b811c825a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:36.623200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5505dd14fc234d57bf3a681b811c825a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:36.625585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:36.775338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5505dd14fc234d57bf3a681b811c825a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.847880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5505dd14fc234d57bf3a681b811c825a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.851369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5505dd14fc234d57bf3a681b811c825a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.871755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5505dd14fc234d57bf3a681b811c825a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.931922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5505dd14fc234d57bf3a681b811c825a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:36.960254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1308/2644] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:36 2022] DELETE /identity/v3/users/5505dd14fc234d57bf3a681b811c825a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:38.111478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:38.112080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:38.112080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:38.409656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:38.415558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:38.685870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1337/2645] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:39.072294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:39.074048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:39.166710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:39.168260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:39.459989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eddee2-a80b-4626-841b-6f421406b19b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:39.498744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:39.499651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:39.499942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:39.500225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] PATH_INFO: `/v3/projects/da1d6d7095bf4102889aabebcd5cb05b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:39.502670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1d6d7095bf4102889aabebcd5cb05b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:39.504623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:39.510849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d885e-44d0-4c94-bba0-296fa54cac6d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:39.537013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:39.541464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:39.547543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:39.548107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:39.603414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:39.605076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444baefe-e2d8-47be-8692-652e01afa494 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:39.697532 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1309/2646] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 20:53:39.812301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1d6d7095bf4102889aabebcd5cb05b', 'request_id': 'req-b345f2c3-a139-476e-bfa6-cbb223b5655a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:39.851402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1d6d7095bf4102889aabebcd5cb05b', 'request_id': 'req-b345f2c3-a139-476e-bfa6-cbb223b5655a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:39.872125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7928c3-67d1-463c-8620-41504b5d08ad None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:39.872274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7928c3-67d1-463c-8620-41504b5d08ad None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:39.872715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7928c3-67d1-463c-8620-41504b5d08ad None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:39.874641 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1310/2647] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:53:39.880588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:39.880900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:39.881145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:39.886714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1d6d7095bf4102889aabebcd5cb05b', 'request_id': 'req-b345f2c3-a139-476e-bfa6-cbb223b5655a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:39.935167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] The token cache is being invalidate because project da1d6d7095bf4102889aabebcd5cb05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:39.935725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:39.936843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b345f2c3-a139-476e-bfa6-cbb223b5655a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:39.938218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:39.943505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1338/2648] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:39 2022] DELETE /identity/v3/projects/da1d6d7095bf4102889aabebcd5cb05b => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:39.948123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586d09-f58f-41f6-bc65-b33d602a68e5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:39.949242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:39.949697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586d09-f58f-41f6-bc65-b33d602a68e5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:39.952812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586d09-f58f-41f6-bc65-b33d602a68e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.032996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ec586d09-f58f-41f6-bc65-b33d602a68e5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:40.034254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec586d09-f58f-41f6-bc65-b33d602a68e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:40.214080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1311/2649] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:40.252174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.253926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:40.277282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51c22-50f1-4926-bbc1-d82d303ab2d1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:40.292844 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1339/2650] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:40.295107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.297375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.297895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.309138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be472-2008-421e-911b-29369534bc16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:40.313015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be472-2008-421e-911b-29369534bc16 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.314306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be472-2008-421e-911b-29369534bc16 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.315041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be472-2008-421e-911b-29369534bc16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.353306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be472-2008-421e-911b-29369534bc16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:40.362317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be472-2008-421e-911b-29369534bc16 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:40.368331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:40.374103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:40.396146 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1312/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:53:40.400950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1340/2652] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:40.405984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be472-2008-421e-911b-29369534bc16 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.432918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be472-2008-421e-911b-29369534bc16 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:40.445853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:40.446838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.447446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.447938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.449076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:40.449629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:40.451467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:40.480685 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1313/2653] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:40.484316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.495478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0a59d-30d4-4578-98ec-a0c14615fda1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:40.503432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:40.504492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.505055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.505566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.506478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:40.509494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:40.559762 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1341/2654] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:40 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:40.563955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.590273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559648f-a4b0-46c5-95ec-018fbd762a31 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:40.749171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:40.750264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.750909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.751426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.752352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:40.761602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:40.825944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.831521 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1314/2655] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:40 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:53:40.860430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719ef61-3c2e-4d6b-83c9-5a55c15a0846 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:40.882415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:40.897054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:40.897961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:40.900785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:40.902290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:40.914774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:40.966157 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1342/2656] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:40.969228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:40.988151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3341-6998-47ac-9263-88a269a23289 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:41.011308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:41.014416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:41.014711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:41.014995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:41.021401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:41.026849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53175b1-fd20-4768-91bc-57d3ea6afbf0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:41.094753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:41.099389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1315/2657] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:41.116881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c922e10-ccf1-4765-96e3-931e43411feb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:41.138307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:41.139419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:41.139768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:41.140117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] PATH_INFO: `/v3/projects/c3958f52713e40dab22c92ad1f806a20/users/9c1f67c91f6644fea34a0d6275c9d505/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:41.186472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3958f52713e40dab22c92ad1f806a20, user_id=9c1f67c91f6644fea34a0d6275c9d505, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:41.203726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:41.242147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1343/2658] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:41 2022] PUT /identity/v3/projects/c3958f52713e40dab22c92ad1f806a20/users/9c1f67c91f6644fea34a0d6275c9d505/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:41.252391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:41.253809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:41.254560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:41.362329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] MFA Rules not processed for user `9c1f67c91f6644fea34a0d6275c9d505`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:41.363880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:41.646886 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1316/2659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:41.647813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:41.924440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70c180-7ffe-48a5-afe9-0b9333aea48e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:41.966294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:41.967045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:41.972286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:41.972703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:41.973452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:41.979827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9e92-5fe8-4a57-9f99-be3ced190164 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:42.064189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1344/2660] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:41 2022] POST /identity/v3/projects => generated 389 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:42.069508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:42.108716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e292aa-7b95-41e6-91e2-119f5e80515e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:42.118681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:42.118978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:42.119262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:42.165631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] MFA Rules not processed for user `67d48665a950454aa634b35c21bbb279`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:42.167774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:42.274773 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1345/2661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:53:42.335014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:42.335979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:42.336375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:42.336790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:42.337604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:42.342251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:42.403260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:42.405970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1317/2662] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:42 2022] POST /identity/v3/users => generated 301 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:53:42.464613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae3ca0-9d5c-4d15-82e4-392294ae8cda None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:42.486254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:42.486962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:42.489239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:42.492977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:42.493774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:42.495417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:42.568791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1346/2663] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:42.569598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:42.582349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a8f03-8b47-4480-b56b-08ac11111caf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:42.599150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:42.600285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:42.600808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:42.601240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] PATH_INFO: `/v3/projects/172f8520d33e47999f5918c066be33d4/users/1a820843bebf4aeeac201ece683daa1b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:42.688682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172f8520d33e47999f5918c066be33d4, user_id=1a820843bebf4aeeac201ece683daa1b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:42.697525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:42.811473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:42.812708 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1318/2664] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:42 2022] PUT /identity/v3/projects/172f8520d33e47999f5918c066be33d4/users/1a820843bebf4aeeac201ece683daa1b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:42.828708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72455-efdd-4a80-8d34-8ad3dea05863 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:42.999435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:42.999867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:43.000159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:43.000439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:43.001338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:43.003035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a562ce4-5a34-4de9-a6d1-ad0e07a6a6cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:43.035916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1347/2665] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:43.039410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:43.082107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d24d5-a4f6-41e7-a633-ef8179b258f0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:43.103319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:43.104226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:43.104565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:43.104904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] PATH_INFO: `/v3/projects/172f8520d33e47999f5918c066be33d4/users/1a820843bebf4aeeac201ece683daa1b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:43.109286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172f8520d33e47999f5918c066be33d4, user_id=1a820843bebf4aeeac201ece683daa1b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:43.111939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:43.154976 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1319/2666] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:43 2022] PUT /identity/v3/projects/172f8520d33e47999f5918c066be33d4/users/1a820843bebf4aeeac201ece683daa1b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:43.165807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1d6d-e90a-471a-b9ae-0c64cbc677e4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:43.166158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1d6d-e90a-471a-b9ae-0c64cbc677e4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:43.166448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1d6d-e90a-471a-b9ae-0c64cbc677e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:43.243555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c30b1d6d-e90a-471a-b9ae-0c64cbc677e4 None None] MFA Rules not processed for user `1a820843bebf4aeeac201ece683daa1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:43.257407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c30b1d6d-e90a-471a-b9ae-0c64cbc677e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:43.448234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1348/2667] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:44.445105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:44.447753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:44.640946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68226-04b6-458b-96ac-39816ac29200 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:44.674095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:44.683679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:44.684766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:44.685196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:44.720921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:44.723137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:44.760737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1320/2668] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:46.057042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dff0c-5e3a-4217-a497-f9a5b09a76a0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:46.058226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dff0c-5e3a-4217-a497-f9a5b09a76a0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:46.058661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dff0c-5e3a-4217-a497-f9a5b09a76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:46.151172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8d7dff0c-5e3a-4217-a497-f9a5b09a76a0 None None] MFA Rules not processed for user `c42119999e6f40b487a7174dc5a7d617`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:46.155803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8d7dff0c-5e3a-4217-a497-f9a5b09a76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:46.500268 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1349/2669] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:47.525453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:47.860048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e1ee3-8d4f-4f2b-aa5b-cd33c15a7e3d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:47.890593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:47.894046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:47.897774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:47.900656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] PATH_INFO: `/v3/users/9c1f67c91f6644fea34a0d6275c9d505` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:47.911318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1f67c91f6644fea34a0d6275c9d505)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:47.920799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:48.155500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1f67c91f6644fea34a0d6275c9d505'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:48.209349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1f67c91f6644fea34a0d6275c9d505'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:48.212394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1f67c91f6644fea34a0d6275c9d505'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:48.245426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1f67c91f6644fea34a0d6275c9d505'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:48.276022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b536cdf-8957-4ffc-8768-65d4748260d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1f67c91f6644fea34a0d6275c9d505'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:48.309427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1321/2670] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:47 2022] DELETE /identity/v3/users/9c1f67c91f6644fea34a0d6275c9d505 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:48.310879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:48.311405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:48.311509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:48.357258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:48.359287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:48.524922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:48.525434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:48.527144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:48.537075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1350/2671] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:48.546377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:48.548374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:48.602357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:48.605790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:48.684903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613eeef-7114-4853-a9a2-8a91ca87cf81 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:48.696852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:48.697707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:48.697993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:48.698266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:48.721577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:48.723192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:48.764143 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1351/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:53:48.855512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1322/2673] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:48.890359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:48.891834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:49.033389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff708140-d0c9-4cb1-bc6c-369e9423c16e service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:49.046353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:49.047421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:49.047713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:49.047990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:49.087098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:49.088870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:49.100302 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1352/2674] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:49.642745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:49.644929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:49.691252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc514f-0292-4fb3-8006-e0b77b974ba9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:49.706481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:49.711984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:49.712372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:49.716484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] PATH_INFO: `/v3/projects/c3958f52713e40dab22c92ad1f806a20` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:49.724743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3958f52713e40dab22c92ad1f806a20)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:49.732049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:49.887618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3958f52713e40dab22c92ad1f806a20', 'request_id': 'req-82a5541c-69b4-4617-b947-145356a11a40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:49.900909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3958f52713e40dab22c92ad1f806a20', 'request_id': 'req-82a5541c-69b4-4617-b947-145356a11a40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:49.908051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3958f52713e40dab22c92ad1f806a20', 'request_id': 'req-82a5541c-69b4-4617-b947-145356a11a40'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:49.954500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] The token cache is being invalidate because project c3958f52713e40dab22c92ad1f806a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:49.955491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:49.976586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:49.990656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1323/2675] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:49 2022] DELETE /identity/v3/projects/c3958f52713e40dab22c92ad1f806a20 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:49.994526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:50.130793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f1a1f-3db2-404d-8ad7-9b06d5de2e20 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:50.295505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:50.296750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:50.297226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:50.297783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] PATH_INFO: `/v3/users/1a820843bebf4aeeac201ece683daa1b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:50.300115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a820843bebf4aeeac201ece683daa1b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:50.302902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:50.491911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a820843bebf4aeeac201ece683daa1b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:50.510852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a820843bebf4aeeac201ece683daa1b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:50.511577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a820843bebf4aeeac201ece683daa1b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:50.512241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a820843bebf4aeeac201ece683daa1b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:50.527919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1ca28c-d572-458d-b075-3caac25608f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a820843bebf4aeeac201ece683daa1b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:50.580400 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1353/2676] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:49 2022] DELETE /identity/v3/users/1a820843bebf4aeeac201ece683daa1b => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:54.854281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:54.855766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:54.872852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5541c-69b4-4617-b947-145356a11a40 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:54.995719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:54.996904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:54.997449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:54.998180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] PATH_INFO: `/v3/projects/172f8520d33e47999f5918c066be33d4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:55.000512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172f8520d33e47999f5918c066be33d4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:55.002581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:55.110049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172f8520d33e47999f5918c066be33d4', 'request_id': 'req-accc627d-0e49-4c13-9d99-99e6d65f8184'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:55.123105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172f8520d33e47999f5918c066be33d4', 'request_id': 'req-accc627d-0e49-4c13-9d99-99e6d65f8184'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:55.151792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172f8520d33e47999f5918c066be33d4', 'request_id': 'req-accc627d-0e49-4c13-9d99-99e6d65f8184'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:55.173444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] The token cache is being invalidate because project 172f8520d33e47999f5918c066be33d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:55.174177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:55.177670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-accc627d-0e49-4c13-9d99-99e6d65f8184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:55.185111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1324/2677] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:54 2022] DELETE /identity/v3/projects/172f8520d33e47999f5918c066be33d4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:55.191017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:55.193394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:55.193932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:55.236201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:55.237544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:55.477423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1354/2678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:55.482557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:55.501801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:55.501801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:55.600716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:55.601969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:55.621870 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1325/2679] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:55.625838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:55.643147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca844f39-59c5-46e9-b0ec-ee4940f07c59 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:55.658236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:55.659926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:55.660519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:55.661371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:55.662793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:53:55.663699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:55.670036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:55.695516 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1355/2680] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:53:55.700317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:55.713593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51b88f-80b5-49bd-8bf8-262345f19a0e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:55.740051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:55.744435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:55.745501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:55.749446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:55.751063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:55.756663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:55.859950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1326/2681] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:55 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:55.864960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:55.887839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c561b-6719-4bc6-bcad-67f984b0aa59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:56.101394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:56.102422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.102926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.103451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.104388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:56.106566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:56.150938 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1356/2682] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:55 2022] POST /identity/v3/users => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:56.154835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:56.168775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ff36-100b-4c50-961c-81f2c77fb94c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:56.187740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:56.189078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.190738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.191281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.194679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:56.197589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:56.232521 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1327/2683] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:56.236199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:56.253239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7916-bb55-4034-84e3-3320e0d5b655 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:56.275373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:56.276216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.276612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.276949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.277764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:56.279497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b07d2-879c-4475-af1f-2f0193bfa242 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:56.303623 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1357/2684] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:56.308136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:56.324301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8eebb-891d-4639-b275-ede8da185537 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:56.348516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:56.349688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.350133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.354601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] PATH_INFO: `/v3/projects/bf81401733804432b781dd367ab7bd82/users/c1d982c5db7e47a6ae521f2137af3204/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.400721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf81401733804432b781dd367ab7bd82, user_id=c1d982c5db7e47a6ae521f2137af3204, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:56.407338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:56.431770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1328/2685] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:56 2022] PUT /identity/v3/projects/bf81401733804432b781dd367ab7bd82/users/c1d982c5db7e47a6ae521f2137af3204/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:56.442940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.443376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.443766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.548059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] MFA Rules not processed for user `c1d982c5db7e47a6ae521f2137af3204`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:56.549331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:56.768263 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1358/2686] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:56.775175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:56.899121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07c79a-6442-4b1e-9302-98cb8a2a50c0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:56.915377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:56.916323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:56.916787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:56.917428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:56.924175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:56.927754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:56.976352 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1329/2687] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:53:56 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:56.978112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:56.995485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc458b-580d-436e-8b30-d03e2fcc8c8e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:57.157265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:57.158150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.158550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.158949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.159772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:57.163416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:57.230737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1359/2688] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:53:56 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:53:57.232262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:57.245454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01ac68-9084-4c5a-a4cd-00ea2948b887 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:57.264366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:57.265094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.265382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.265663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.266401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:57.268008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:57.306405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1330/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:57.308418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:57.324006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b9910-c660-4f68-a76c-9b37ba894a39 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:57.347225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:57.348854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.349147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.349428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] PATH_INFO: `/v3/projects/de86ae49fbdc45948aabfd4a403e326c/users/730601c0fd034bc481ccef6fc607dac1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.402086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de86ae49fbdc45948aabfd4a403e326c, user_id=730601c0fd034bc481ccef6fc607dac1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:57.404879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:57.436917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1360/2690] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:57 2022] PUT /identity/v3/projects/de86ae49fbdc45948aabfd4a403e326c/users/730601c0fd034bc481ccef6fc607dac1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:57.440792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:57.451932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d4ad2-3318-47cd-818b-9c137dcde582 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:57.604860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:57.605548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.608167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.608167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.608167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:57.608519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f24c1-54ab-4a2b-b663-2773cfda4b49 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:57.637919 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1331/2691] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:53:57.641175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:57.666224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ea9-10ef-41f1-badc-49b927eb18a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:57.681606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:57.687030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.687328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.687616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] PATH_INFO: `/v3/projects/de86ae49fbdc45948aabfd4a403e326c/users/730601c0fd034bc481ccef6fc607dac1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.690128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] RBAC: Authorizing `identity:create_grant(project_id=de86ae49fbdc45948aabfd4a403e326c, user_id=730601c0fd034bc481ccef6fc607dac1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:57.693395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:57.734023 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1361/2692] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:53:57 2022] PUT /identity/v3/projects/de86ae49fbdc45948aabfd4a403e326c/users/730601c0fd034bc481ccef6fc607dac1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:57.736123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c1c9-50a9-44ce-9f1e-7b6fbc07b0b3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:57.736420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c1c9-50a9-44ce-9f1e-7b6fbc07b0b3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:57.736732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5c1c9-50a9-44ce-9f1e-7b6fbc07b0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:57.818281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c2e5c1c9-50a9-44ce-9f1e-7b6fbc07b0b3 None None] MFA Rules not processed for user `730601c0fd034bc481ccef6fc607dac1`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:57.822780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2e5c1c9-50a9-44ce-9f1e-7b6fbc07b0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:58.008210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:58.010262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:58.089095 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1332/2693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:58.091127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfdff-5f99-4f99-a3b6-ee85771f7daf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:58.091586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfdff-5f99-4f99-a3b6-ee85771f7daf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:58.092019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfdff-5f99-4f99-a3b6-ee85771f7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:58.135725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-85abfdff-5f99-4f99-a3b6-ee85771f7daf None None] MFA Rules not processed for user `c1d982c5db7e47a6ae521f2137af3204`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:58.137343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85abfdff-5f99-4f99-a3b6-ee85771f7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:58.228502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993572cc-1c21-4958-a807-3297f05d34da admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:58.242909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:58.243877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:58.244167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:58.244485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] PATH_INFO: `/v3/users/c24dff48d3544e049af02871f27b2a2c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:58.245860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24dff48d3544e049af02871f27b2a2c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:58.248113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:58.306362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1333/2694] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:58.399475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24dff48d3544e049af02871f27b2a2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:58.421532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24dff48d3544e049af02871f27b2a2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:58.422169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24dff48d3544e049af02871f27b2a2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:58.422800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24dff48d3544e049af02871f27b2a2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:58.431681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24dff48d3544e049af02871f27b2a2c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:58.485481 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1362/2695] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:58 2022] DELETE /identity/v3/users/c24dff48d3544e049af02871f27b2a2c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:53:58.493528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:58.493850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:58.494165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:58.525601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:53:58.553987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:58.754251 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1334/2696] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:53:58.763891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:58.765646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:58.913205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c37f6-f773-47f5-b0bf-b5e1ad83e3cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:58.919124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:58.921546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:58.922006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:58.924753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:58.961514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:58.963300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:58.994875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1363/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:59.277496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:59.279028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:59.480434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:59.481917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:59.512372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f2e2-82b9-4691-a7c9-d667465d051c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:59.537980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:59.539403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:59.539755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:59.546723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] PATH_INFO: `/v3/projects/0e3659a4fe104604ab6161e28854b4a6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:59.552676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3659a4fe104604ab6161e28854b4a6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:59.555003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:59.601790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889477cc-d6b2-4be7-8f17-e0d91bdf5693 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:59.619170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:59.619710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:59.619999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:59.620279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:59.627211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:59.717677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3659a4fe104604ab6161e28854b4a6', 'request_id': 'req-54fe1b49-e8bb-4716-bda8-331783be07de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:59.729238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3659a4fe104604ab6161e28854b4a6', 'request_id': 'req-54fe1b49-e8bb-4716-bda8-331783be07de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:59.747180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3659a4fe104604ab6161e28854b4a6', 'request_id': 'req-54fe1b49-e8bb-4716-bda8-331783be07de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:59.765839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] The token cache is being invalidate because project 0e3659a4fe104604ab6161e28854b4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:53:59.766214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:59.769080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:53:59.775721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1364/2698] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:59 2022] DELETE /identity/v3/projects/0e3659a4fe104604ab6161e28854b4a6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:53:59.776868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:53:59.781672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:53:59.838930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:53:59.840624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:53:59.861375 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1335/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:59.976905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1b49-e8bb-4716-bda8-331783be07de admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:53:59.994161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:53:59.995128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:53:59.995557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:53:59.995962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] PATH_INFO: `/v3/users/791c932b1f4f4a46927e0f2bc0e7b171` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:53:59.998707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791c932b1f4f4a46927e0f2bc0e7b171)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:00.001071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:00.165994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791c932b1f4f4a46927e0f2bc0e7b171'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:00.178614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791c932b1f4f4a46927e0f2bc0e7b171'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:00.179403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791c932b1f4f4a46927e0f2bc0e7b171'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:00.180136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791c932b1f4f4a46927e0f2bc0e7b171'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:00.191675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2570c53-15ae-4fdb-9542-0af267451d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791c932b1f4f4a46927e0f2bc0e7b171'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:00.236015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1365/2700] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:53:59 2022] DELETE /identity/v3/users/791c932b1f4f4a46927e0f2bc0e7b171 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:01.363830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:01.377394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bcba8-7445-42ca-9412-71abdd0b6829 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:01.557982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:01.559367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:01.559858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:01.560288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] PATH_INFO: `/v3/projects/e05922789c9541b695a41ac4ef91c389` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:01.566251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05922789c9541b695a41ac4ef91c389)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:01.570304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:01.770160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05922789c9541b695a41ac4ef91c389', 'request_id': 'req-e07931dd-f7f0-4c36-8ca9-fa927cf43671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:01.779812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05922789c9541b695a41ac4ef91c389', 'request_id': 'req-e07931dd-f7f0-4c36-8ca9-fa927cf43671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:01.797467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05922789c9541b695a41ac4ef91c389', 'request_id': 'req-e07931dd-f7f0-4c36-8ca9-fa927cf43671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:01.831432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] The token cache is being invalidate because project e05922789c9541b695a41ac4ef91c389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:01.832644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:01.835468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e07931dd-f7f0-4c36-8ca9-fa927cf43671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:01.837657 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1336/2701] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:01 2022] DELETE /identity/v3/projects/e05922789c9541b695a41ac4ef91c389 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:01.842431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:01.842907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:01.842990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:01.904360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:01.905957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:02.048343 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1366/2702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:02.056468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.056768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.057052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.113526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:02.115770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:02.139166 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1337/2703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:02.145698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.169975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b08d7a-6104-43b2-add3-405037596d24 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.176385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.177407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.177892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.178363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.179281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:02.180009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.181927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.198853 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1367/2704] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:54:02.203042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.222889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34183054-ad8c-4759-a22d-65fe0039306c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.250923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.254902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.259526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.259916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.263549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.271474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.358500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.379856 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1338/2705] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:02 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:02.386220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14802be-a452-46de-9c33-d8afece44a22 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.581026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.581721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.589046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.589409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.590163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.592117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.663328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1368/2706] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:02 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:02.664636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.702517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bec141-0965-4e11-97ee-c97477c4b170 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.714554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.715130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.715416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.715692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.716429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.718106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.763902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.764354 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1339/2707] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:02.780814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3ef43-fafb-45c0-a2fb-e8216f65553d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.798384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.799025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.799312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.799585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.800574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.803947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ab692-7f0b-46ae-b839-7f0e755692fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.851061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1369/2708] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:02.865227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:02.879300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04b4db-3ffd-4b86-baa4-201c45d7ff9c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:02.885897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:02.887936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.888666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.888948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] PATH_INFO: `/v3/projects/5f8ef84a62894a7da5457cafc1bcf172/users/6bf48963161747228e3cafa0bc045729/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.917384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ef84a62894a7da5457cafc1bcf172, user_id=6bf48963161747228e3cafa0bc045729, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:02.920407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:02.945641 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1340/2709] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:02 2022] PUT /identity/v3/projects/5f8ef84a62894a7da5457cafc1bcf172/users/6bf48963161747228e3cafa0bc045729/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:02.957857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:02.958237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:02.958908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:02.995944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:02.997684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:03.078803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1370/2710] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:03.083871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.161386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c77b5-1ce4-462c-ba54-211471baa059 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.166948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.167862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.168216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.168595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.169577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.171711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.210433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.216614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1341/2711] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:03 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:03.224253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b81c10-2807-4561-854d-932a879f94ff None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.294199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.294996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.295527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.295885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.296773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.299124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.331392 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1371/2712] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:03 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:03.332091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.353527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56775-909a-4cd7-8f64-7ab98fc7715f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.361661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.362359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.362648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.362929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.364215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.369804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.403203 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1342/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:54:03.405695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.423323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c307a98-ffcd-428e-8ac6-ec968bba9b31 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.440436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.441832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.442322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.446336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] PATH_INFO: `/v3/projects/d45dddfdc67d465bb598fe5710515486/users/de7792f5df104265a1ba0a778b3339ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.490009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45dddfdc67d465bb598fe5710515486, user_id=de7792f5df104265a1ba0a778b3339ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.497343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.536783 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1372/2714] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:03 2022] PUT /identity/v3/projects/d45dddfdc67d465bb598fe5710515486/users/de7792f5df104265a1ba0a778b3339ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:03.537620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.552963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21bdd-4449-4494-83ba-8abca2cfffd6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.657779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.658474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.658759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.659035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.659771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.662443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781ced3-9128-46d4-abca-0043be3acb39 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.679143 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1343/2715] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:03.680507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:03.725033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9432-5dce-4e11-871a-c225f8db5330 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:03.731944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:03.734243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.734535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.735089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] PATH_INFO: `/v3/projects/d45dddfdc67d465bb598fe5710515486/users/de7792f5df104265a1ba0a778b3339ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.745738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45dddfdc67d465bb598fe5710515486, user_id=de7792f5df104265a1ba0a778b3339ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:03.748956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c55ce-8075-43a3-8712-c3729a601fe3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:03.780562 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1373/2716] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:03 2022] PUT /identity/v3/projects/d45dddfdc67d465bb598fe5710515486/users/de7792f5df104265a1ba0a778b3339ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:03.846319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.847165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.847477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:03.881994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] MFA Rules not processed for user `de7792f5df104265a1ba0a778b3339ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:03.884012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:03.981603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1344/2717] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:03.992447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f45d-4d48-4835-99a4-2fbf7deffb84 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:03.992962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f45d-4d48-4835-99a4-2fbf7deffb84 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:03.993176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f45d-4d48-4835-99a4-2fbf7deffb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:04.025582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b270f45d-4d48-4835-99a4-2fbf7deffb84 None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:04.027087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b270f45d-4d48-4835-99a4-2fbf7deffb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:04.112694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1374/2718] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:04.857967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:04.859439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:05.055390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88687-1ecc-4c47-99bb-080b8005319e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:05.072557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:05.073331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:05.073617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:05.073891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:05.092700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:05.096120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dcaf-defc-418e-8c2b-b58ca1f99392 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:05.142976 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1345/2719] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:05.692703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:05.693145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:05.693233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:05.764221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] MFA Rules not processed for user `a2e061bb9a054fb1945417baf444eaee`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:05.765523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:05.903871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1375/2720] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:06.217459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:06.217953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:06.218053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:06.248705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:06.252796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:06.399740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1346/2721] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:06.421208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:06.423114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:06.559173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf85b-b818-42ad-80ba-c248afe7e168 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:06.569966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:06.570858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:06.571241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:06.571642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:06.582376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:06.584469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4171-322e-4ab5-a0ef-1960412086d2 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:06.596378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1376/2722] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:54:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:08.540269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:08.543079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:08.562631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853f2a4-0fa7-496b-a844-69ad868edeae None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:08.569817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:08.570484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:08.570768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:08.571045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:08.573064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:08.657100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:08.660722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5bebf-9432-48eb-832f-835fa7de8752 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:08.685755 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1347/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:12.561004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:12.561504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:12.561602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:12.595469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] MFA Rules not processed for user `cf5e0bd625644d9eabf92db0624219e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:12.596928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:12.607254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1377/2724] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:15.300664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c675-6c64-406f-8995-cd3e61116b96 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:15.301134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c675-6c64-406f-8995-cd3e61116b96 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:15.301351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c675-6c64-406f-8995-cd3e61116b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:15.319865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-53c0c675-6c64-406f-8995-cd3e61116b96 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:15.321196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-53c0c675-6c64-406f-8995-cd3e61116b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:15.328936 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1348/2725] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:15.341728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:15.354610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9003d3a-bff1-47ec-9002-73692f50fc15 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:15.359739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:15.360439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:15.360953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:15.361629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:15.370717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:15.372368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:15.381893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1378/2726] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:20.185990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:20.186559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:20.186559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:20.224067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:20.225920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:20.247355 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1349/2727] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:20.292706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:20.304037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c5c3-efb2-4625-872b-7c12678c3f46 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:20.325766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:20.326665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:20.327115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:20.327561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:20.337447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:20.339456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:20.349216 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1379/2728] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:54:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:23.873144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:23.882202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:24.075083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a324f-b9da-4836-a9b5-4c7f7070caa5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:24.090940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:24.091840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:24.092127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:24.092408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] PATH_INFO: `/v3/users/82d0dd5279384016ba00c5688ce1d615` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:24.095557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d0dd5279384016ba00c5688ce1d615)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:24.097692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:24.224262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d0dd5279384016ba00c5688ce1d615'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.264724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d0dd5279384016ba00c5688ce1d615'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.266250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d0dd5279384016ba00c5688ce1d615'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.283183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d0dd5279384016ba00c5688ce1d615'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.292671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e2e5633-476a-4b13-80b8-f658a71396cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d0dd5279384016ba00c5688ce1d615'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.301793 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1350/2729] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:54:23 2022] DELETE /identity/v3/users/82d0dd5279384016ba00c5688ce1d615 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:24.694459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:24.715175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b7ee-4dbd-4244-8d9f-907dc0747bb1 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:24.855624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:24.857042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:24.857905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:24.858385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] PATH_INFO: `/v3/projects/89b61101b5644010bc714c2cdeba96eb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:24.859833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b61101b5644010bc714c2cdeba96eb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:24.863568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:24.960175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b61101b5644010bc714c2cdeba96eb', 'request_id': 'req-202420aa-fea5-4f69-b3c8-e52576f5fd38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.969666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b61101b5644010bc714c2cdeba96eb', 'request_id': 'req-202420aa-fea5-4f69-b3c8-e52576f5fd38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:24.985420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b61101b5644010bc714c2cdeba96eb', 'request_id': 'req-202420aa-fea5-4f69-b3c8-e52576f5fd38'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:25.005843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] The token cache is being invalidate because project 89b61101b5644010bc714c2cdeba96eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:25.006538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:25.007566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-202420aa-fea5-4f69-b3c8-e52576f5fd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:25.010276 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1380/2730] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:24 2022] DELETE /identity/v3/projects/89b61101b5644010bc714c2cdeba96eb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:54:25.017314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.018375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.018895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.052287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:25.055393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:25.307359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.307359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.307359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.312201 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1351/2731] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:25.354191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:25.356995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:25.385082 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1381/2732] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:25.387044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:25.422146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b661bf-32f6-4a05-b715-f9d25ad467fc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:25.455837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:25.459219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.460016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.460800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.462339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:25.464178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:25.485648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:25.524658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:25.531308 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1352/2733] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:54:25.541805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc1d49-dec4-4767-b3b6-f5bf854a4a9c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:25.558551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:25.560067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.560604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.561105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.562026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:25.564499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:25.640165 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1382/2734] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:25 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:25.644270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:25.660917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd85f-7d4f-4516-b920-e59fe927153e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:25.803148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:25.804385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.805080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.805735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.806872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:25.809270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:25.855715 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1353/2735] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:25 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:54:25.860647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:25.934659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d8b7-48a5-49c0-ac65-c7ebf85fbfc1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:25.960054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:25.961028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:25.961519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:25.962031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:25.963050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:25.967786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:25.994158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1383/2736] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:25.998184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:26.021438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144d2aa-afd2-4b0d-b552-358a055fac25 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:26.030202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:26.031270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:26.031800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:26.032287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:26.033295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:26.035731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6916cb-6ecd-4c6e-9106-e361bd759443 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:26.062083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1354/2737] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:26.066353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:26.084547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8649f6f-317b-41d7-b022-fe9f5c543794 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:26.091016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:26.092842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:26.093383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:26.093895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] PATH_INFO: `/v3/projects/3a625f99f9cd42e783fdc952f5995fc9/users/e61a673861c34644892513f98458bf5b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:26.128992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a625f99f9cd42e783fdc952f5995fc9, user_id=e61a673861c34644892513f98458bf5b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:26.132259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:26.161791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1384/2738] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:26 2022] PUT /identity/v3/projects/3a625f99f9cd42e783fdc952f5995fc9/users/e61a673861c34644892513f98458bf5b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:26.166767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:26.167208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:26.167597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:26.203351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:26.204799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:26.329451 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1355/2739] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:26.336612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:26.338548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:26.491649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96d6ab-9c53-4f97-b602-be1f65719cf4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:26.521835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:26.525327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:26.525846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:26.526549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:26.566809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:26.568592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:26.604846 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1385/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:27.134431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:27.135866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:27.344692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:27.346120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:27.356135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c57e9-7ea0-406a-9eea-366dc0133bc6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:27.369221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:27.370226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:27.370669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:27.371109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:27.381674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:27.395862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff116dc-b6c3-4637-8069-4d8768c3216c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:27.400673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:27.405185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:27.434471 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1356/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:27.436128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:27.436841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:27.447702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:27.448102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:27.474960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:27.557916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:27.562337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd6bb-c9ee-4224-85ce-945eb5d98cfe service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:27.632691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1386/2742] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:54:27.952011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:27.953578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:28.194579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a2002-40d0-461b-a63a-21eac14b4c93 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:28.226390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:28.227483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:28.227979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:28.228483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:28.230653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:28.379460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:28.381277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e279f35-a9e5-443d-b02f-06db6ac03dcf service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:28.401343 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1357/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:29.412637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:29.413562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:29.414093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:29.478566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] MFA Rules not processed for user `e61a673861c34644892513f98458bf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:29.482055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:29.574251 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1387/2744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:29.576845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9daba1-0628-4717-911f-10b764b17ad3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:29.577778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9daba1-0628-4717-911f-10b764b17ad3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:29.578221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9daba1-0628-4717-911f-10b764b17ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:29.682408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bd9daba1-0628-4717-911f-10b764b17ad3 None None] MFA Rules not processed for user `e61a673861c34644892513f98458bf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:29.685696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd9daba1-0628-4717-911f-10b764b17ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:29.717075 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1358/2745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:30.400827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:30.421332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6081e90-fe22-44a9-80c4-8e68c884e5e9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:30.428399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:30.429787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:30.430159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:30.430681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:30.433083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:30.534796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:30.536808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119db8d1-a92f-419a-ab18-108b2ab18493 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:30.547857 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1388/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:31.094028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.094915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.095728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.098630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1359/2747] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:54:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:54:31.104782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.105538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.105779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.128274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:31.129548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:31.146679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1389/2748] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:31.177860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:31.179839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:31.183728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:31.200643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b760aaf-2ada-4a3c-9c98-26b46ec52822 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:31.207637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:31.208315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.208703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.208986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.213428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130fd7-ed51-492f-9433-fef2b4e5d1c4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:31.220987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:31.222908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ba80a-ab82-48dd-b68c-be6372df7afd service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:31.226311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:31.227230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.228391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.228817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.234280 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1390/2749] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:54:31.243055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:31.244692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006e5eb-5494-4fe1-9654-ecd248ab345f service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:31.257028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1360/2750] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:31.532675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.533803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.533950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.537224 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1391/2751] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:54:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:54:31.544524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211316-f317-449d-834a-c5912e7c958c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.545062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211316-f317-449d-834a-c5912e7c958c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.545552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211316-f317-449d-834a-c5912e7c958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.599158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-47211316-f317-449d-834a-c5912e7c958c None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:31.606941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-47211316-f317-449d-834a-c5912e7c958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:31.619442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1361/2752] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:31.641510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:31.643668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:31.673043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab383-984f-4d5c-a9d5-0f21a7371e9b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.673700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab383-984f-4d5c-a9d5-0f21a7371e9b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.674140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eab383-984f-4d5c-a9d5-0f21a7371e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.683709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b98b7-d581-4061-a5b9-e26fded8efa4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:31.692125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:31.693094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.696189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:31.696673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:31.710078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:31.715984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664478-28ae-4f06-a057-34fbbcff86c9 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:31.720291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-94eab383-984f-4d5c-a9d5-0f21a7371e9b None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:31.725087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-94eab383-984f-4d5c-a9d5-0f21a7371e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:31.735959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1392/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:31.887699 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1362/2754] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:31.999145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d1c-0c31-44eb-b1c4-19c1e9f16f12 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:31.999720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d1c-0c31-44eb-b1c4-19c1e9f16f12 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.000162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e30d1c-0c31-44eb-b1c4-19c1e9f16f12 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.002147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1393/2755] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:54:32.009368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1059b-050b-4239-b4d0-7f1b71b116ce None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:32.009650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1059b-050b-4239-b4d0-7f1b71b116ce None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.011705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1059b-050b-4239-b4d0-7f1b71b116ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.066384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-80d1059b-050b-4239-b4d0-7f1b71b116ce None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:32.070422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80d1059b-050b-4239-b4d0-7f1b71b116ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:32.136232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1363/2756] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:32.153771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e30d1c-0c31-44eb-b1c4-19c1e9f16f12 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:32.178559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e30d1c-0c31-44eb-b1c4-19c1e9f16f12 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:32.235561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:32.251114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:32.251430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.251722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.293473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:32.295310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a2e7-f664-4b1b-8cb5-b0b399ff368c service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:32.329098 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1394/2757] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:32.738317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e313-94c3-4723-988c-ba8028fa94f9 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:32.738613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e313-94c3-4723-988c-ba8028fa94f9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.739070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2e313-94c3-4723-988c-ba8028fa94f9 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.741085 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1364/2758] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:54:32.752113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a79-2dd9-4ce8-ad90-dbcc740f3627 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:32.753250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a79-2dd9-4ce8-ad90-dbcc740f3627 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.753250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39a79-2dd9-4ce8-ad90-dbcc740f3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.796030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f5e39a79-2dd9-4ce8-ad90-dbcc740f3627 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:32.797312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f5e39a79-2dd9-4ce8-ad90-dbcc740f3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:32.818061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1395/2759] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:32.843643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2e313-94c3-4723-988c-ba8028fa94f9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:32.861221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2e313-94c3-4723-988c-ba8028fa94f9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:32.870225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:32.871799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:32.872268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:32.873045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:32.909118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:32.911650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:32.946240 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1365/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:37.212787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdd6e-9a10-4d6e-b1f9-10443f2c66eb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:37.213270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdd6e-9a10-4d6e-b1f9-10443f2c66eb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:37.216565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bdd6e-9a10-4d6e-b1f9-10443f2c66eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:37.259019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a30bdd6e-9a10-4d6e-b1f9-10443f2c66eb None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:37.260407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a30bdd6e-9a10-4d6e-b1f9-10443f2c66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:37.409444 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1396/2761] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:37.423483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:37.425431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:37.564293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509ec73-8a33-499b-a328-058687f06373 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:37.571173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:37.571902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:37.572191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:37.572490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:37.582388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:37.584307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390496e-c933-4e5e-9f72-df6b88d7b549 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:37.603103 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1366/2762] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 20:54:42.016809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be004f-44c7-4d92-b200-0bacfc2ade30 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:42.018555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be004f-44c7-4d92-b200-0bacfc2ade30 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:42.019031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be004f-44c7-4d92-b200-0bacfc2ade30 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:42.021696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1397/2763] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:54:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:54:42.027857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:42.028383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:42.028383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:42.061757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:42.063269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:42.087802 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1367/2764] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:42.113172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be004f-44c7-4d92-b200-0bacfc2ade30 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:42.131254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be004f-44c7-4d92-b200-0bacfc2ade30 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:42.144400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:42.145086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:42.145364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:42.145638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:42.161967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:42.166873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc89a0c-abe5-4ef5-b8ac-eda4d55a1b16 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:42.195141 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1398/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:42.695679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:42.697426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:42.719287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486b7a0-efc3-44c5-ac8a-0871158c2f70 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:42.724874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:42.726024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:42.726489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:42.726915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] PATH_INFO: `/v3/users/481d41af70a54782ad2d569d058d6fdc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:42.728190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=481d41af70a54782ad2d569d058d6fdc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:42.730402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:42.797377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481d41af70a54782ad2d569d058d6fdc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:42.822458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481d41af70a54782ad2d569d058d6fdc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:42.823643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481d41af70a54782ad2d569d058d6fdc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:42.834238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481d41af70a54782ad2d569d058d6fdc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:42.843867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481d41af70a54782ad2d569d058d6fdc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:42.852596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1368/2766] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:54:42 2022] DELETE /identity/v3/users/481d41af70a54782ad2d569d058d6fdc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:42.857374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577a04-e731-437c-b616-057c6a06c244 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:42.858303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577a04-e731-437c-b616-057c6a06c244 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:42.859458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577a04-e731-437c-b616-057c6a06c244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:42.880509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-95577a04-e731-437c-b616-057c6a06c244 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:42.882030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-95577a04-e731-437c-b616-057c6a06c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:42.965872 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1399/2767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:42.975129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:42.978870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:43.040698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ea5a3-e342-4c10-ac36-8a4ec83d95ce admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.044771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.045931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.046393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.046820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.063515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.066025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783ab93-17f6-459f-b3b4-b9db0ee62602 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.078081 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1369/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:43.325996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577a04-e731-437c-b616-057c6a06c244 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.329140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-95577a04-e731-437c-b616-057c6a06c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:43.352172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577a04-e731-437c-b616-057c6a06c244 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.363314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.364445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.364760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.365032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] PATH_INFO: `/v3/projects/ee534be172494c1b842d8749d1dfe969` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.366426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee534be172494c1b842d8749d1dfe969)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.369649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.443412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee534be172494c1b842d8749d1dfe969', 'request_id': 'req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:43.447614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee534be172494c1b842d8749d1dfe969', 'request_id': 'req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:43.461559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee534be172494c1b842d8749d1dfe969', 'request_id': 'req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:43.489114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] The token cache is being invalidate because project ee534be172494c1b842d8749d1dfe969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:43.489511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:43.490221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cc40ab5-630b-448c-93fe-eb4b6e0c7af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:43.492413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1400/2769] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:43 2022] DELETE /identity/v3/projects/ee534be172494c1b842d8749d1dfe969 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:43.497328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.497900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.498422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.516619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:43.518462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:43.599970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1370/2770] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:43.608588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.609233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.609730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.632668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:43.643762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:43.656307 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1401/2771] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:43.658704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.671477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7519-8039-4fb7-8002-01bf6733af67 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.677984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.678869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.679427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.679720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.680468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:43.680807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.682410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.695938 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1371/2772] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:54:43.700194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.711406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077ad26-0088-4ecf-8539-8e4ed93ee125 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.717196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.718242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.718535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.718815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.719517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.723224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.754151 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1402/2773] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:43 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:54:43.758180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.768759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed198-443d-405e-bc3b-521361492cb3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.824597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.825274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.825561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.825842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.826536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.828611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.849827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1372/2774] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:43 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:43.854179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.864691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ab0bd-a43e-4b3f-a192-59abd29d3831 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.869386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.870049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.870347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.870710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.871487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.873121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.884238 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1403/2775] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:43.888701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.898690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff20fda-d151-426a-b494-c77ab24f3eab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.903318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.904057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.904479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.904788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.905508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.907100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439d0d-281f-42e4-a7d2-62894cf1e0e6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.917592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1373/2776] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:43.922193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:43.933395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34224-8a43-4053-a3d3-441478665bfa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:43.938689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:43.939797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.940252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.940733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] PATH_INFO: `/v3/projects/6076a387b29d42a491d524e8e030f876/users/682b52dfd8a34a77bd9efe5ab9ce0536/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:43.956041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6076a387b29d42a491d524e8e030f876, user_id=682b52dfd8a34a77bd9efe5ab9ce0536, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:43.958852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:43.980903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1404/2777] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:43 2022] PUT /identity/v3/projects/6076a387b29d42a491d524e8e030f876/users/682b52dfd8a34a77bd9efe5ab9ce0536/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:54:43.983219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d636d2-feed-4de8-95fe-d1b94bbf19d6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:43.983975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d636d2-feed-4de8-95fe-d1b94bbf19d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:43.983975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d636d2-feed-4de8-95fe-d1b94bbf19d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:44.004346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-93d636d2-feed-4de8-95fe-d1b94bbf19d6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:44.006403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-93d636d2-feed-4de8-95fe-d1b94bbf19d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:44.080534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1374/2778] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:44.106252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:44.116106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:44.193603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d75c-12b8-4c49-962c-6a56ff0ac972 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:44.198025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:44.198865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:44.199284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:44.199579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:44.210270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:44.211754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:44.222480 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1405/2779] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:45.034581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:45.035243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:45.035761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:45.077687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] MFA Rules not processed for user `682b52dfd8a34a77bd9efe5ab9ce0536`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:45.079184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:45.175037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1375/2780] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:45.186224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:45.188077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:45.278907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962b65-5936-482c-8dd4-07d1c347c894 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:45.286457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:45.287531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:45.287703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:45.288198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:45.300387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:45.302583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:45.314828 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1406/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:50.670249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:50.683240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d557ff-fb76-4d58-8b85-9204a0f0c23c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:50.694179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:50.695322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:50.695602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:50.696217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] PATH_INFO: `/v3/users/682b52dfd8a34a77bd9efe5ab9ce0536` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:50.697536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] RBAC: Authorizing `identity:delete_user(user_id=682b52dfd8a34a77bd9efe5ab9ce0536)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:50.699694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:50.759875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682b52dfd8a34a77bd9efe5ab9ce0536'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:50.774534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682b52dfd8a34a77bd9efe5ab9ce0536'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:50.775671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682b52dfd8a34a77bd9efe5ab9ce0536'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:50.787227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682b52dfd8a34a77bd9efe5ab9ce0536'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:50.801205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a3f147e-5114-46c7-8713-393e44c1245b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682b52dfd8a34a77bd9efe5ab9ce0536'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:50.811017 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1376/2782] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:54:50 2022] DELETE /identity/v3/users/682b52dfd8a34a77bd9efe5ab9ce0536 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:51.054754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.072833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbab4d-c12a-4a52-a940-22b67225b843 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.197897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.199080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.199648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.200072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] PATH_INFO: `/v3/projects/6076a387b29d42a491d524e8e030f876` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.201713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6076a387b29d42a491d524e8e030f876)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.204697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.267146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6076a387b29d42a491d524e8e030f876', 'request_id': 'req-4a74251d-eb66-4a61-9c4d-55664f395761'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:51.274602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6076a387b29d42a491d524e8e030f876', 'request_id': 'req-4a74251d-eb66-4a61-9c4d-55664f395761'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:51.284761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6076a387b29d42a491d524e8e030f876', 'request_id': 'req-4a74251d-eb66-4a61-9c4d-55664f395761'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:51.299138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] The token cache is being invalidate because project 6076a387b29d42a491d524e8e030f876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:51.299463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:51.300099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a74251d-eb66-4a61-9c4d-55664f395761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:51.306638 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1407/2783] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:51 2022] DELETE /identity/v3/projects/6076a387b29d42a491d524e8e030f876 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:51.308692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.308979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.309257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.328417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:51.331555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:51.414057 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1377/2784] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:51.422445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.422901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.423259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.452518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:51.456937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:51.484804 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1408/2785] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:51.488107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.504217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62bb53-79df-4bba-bc80-fc49c7430ec7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.509894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.510875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.511209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.511496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.512218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:51.512556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.521421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.540974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1378/2786] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:54:51.548514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.558680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d07b9e-0527-47de-af73-1ecb9ba03751 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.567937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.568650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.569522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.569522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.570238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.572136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.635762 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1409/2787] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:51 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:51.639998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.653036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e2ba8-d599-4db7-891d-5b14fd0b3944 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.745805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.747272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.747717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.748153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.749792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.753372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.785372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.786227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1379/2788] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:51 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:54:51.802101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fc8ad-77a2-4c58-bad9-66ec5e14398d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.807363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.808133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.808505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.808863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.809727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.811531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.828710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1410/2789] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:51.832205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.847895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525898c-224f-4b61-b0a7-dccf3c44db2f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.853881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.854570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.855052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.855349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.856087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.857859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8d79-6a47-48ff-a35c-921cab3469e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.874760 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1380/2790] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:51.878292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:51.891164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f8d5d-25af-4cd2-b0ae-e676b4fe1c4b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:51.898906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:51.900244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.900633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.900921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] PATH_INFO: `/v3/projects/82dcdaf57e6a4fb5ae891203fec373e3/users/dcba26fd9dea4eb7ab48bbb952fbfbb6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.919154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82dcdaf57e6a4fb5ae891203fec373e3, user_id=dcba26fd9dea4eb7ab48bbb952fbfbb6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:51.922017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:51.940373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1411/2791] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:51 2022] PUT /identity/v3/projects/82dcdaf57e6a4fb5ae891203fec373e3/users/dcba26fd9dea4eb7ab48bbb952fbfbb6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:51.942271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce211-7a11-4ffe-8646-c67254bc714b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:51.942644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce211-7a11-4ffe-8646-c67254bc714b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:51.943018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce211-7a11-4ffe-8646-c67254bc714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:51.966339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a04ce211-7a11-4ffe-8646-c67254bc714b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:51.967562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a04ce211-7a11-4ffe-8646-c67254bc714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:52.034584 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1381/2792] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:52.044382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:52.046528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:52.107385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ebf45-c19e-40e8-b1af-aa67d968aa1a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:52.112479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:52.113170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:52.113461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:52.113741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:52.123861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:52.125411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab2f09-8c34-495e-857d-11a7df83f759 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:52.136430 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1412/2793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:52.356198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:52.356670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:52.356960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:52.390103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:52.391320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:52.496640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1382/2794] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:53.031641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:53.031939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:53.032227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:53.070898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] MFA Rules not processed for user `dcba26fd9dea4eb7ab48bbb952fbfbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:53.072794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:53.182496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1413/2795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:53.189754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:53.191333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:53.290290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cbe28-157b-420e-8916-bbf8431d1406 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:53.297186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:53.298106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:53.298952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:53.299666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:53.310607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:53.313118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:53.327986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1383/2796] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:54.648552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:54.650310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:54.675534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb735b-4f7c-4ab2-80b9-de8a6f6a0928 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:54.682573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:54.683459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:54.683912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:54.684341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] PATH_INFO: `/v3/users/e61a673861c34644892513f98458bf5b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:54.686693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61a673861c34644892513f98458bf5b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:54.689146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:54.746346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61a673861c34644892513f98458bf5b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:54.756305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61a673861c34644892513f98458bf5b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:54.763743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61a673861c34644892513f98458bf5b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:54.764436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61a673861c34644892513f98458bf5b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:54.775665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61a673861c34644892513f98458bf5b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:54.796301 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1414/2797] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:54:54 2022] DELETE /identity/v3/users/e61a673861c34644892513f98458bf5b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:55.181412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:55.196781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e137-0fa5-4452-a6a0-a5d4eefc3533 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:55.291654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:55.292671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.293212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.293723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] PATH_INFO: `/v3/users/dcba26fd9dea4eb7ab48bbb952fbfbb6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.295206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba26fd9dea4eb7ab48bbb952fbfbb6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:55.297653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:55.365525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba26fd9dea4eb7ab48bbb952fbfbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.382207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba26fd9dea4eb7ab48bbb952fbfbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.383709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba26fd9dea4eb7ab48bbb952fbfbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.394995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba26fd9dea4eb7ab48bbb952fbfbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.406274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba26fd9dea4eb7ab48bbb952fbfbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.414061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:55.415686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:55.433204 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1384/2798] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:54:55 2022] DELETE /identity/v3/users/dcba26fd9dea4eb7ab48bbb952fbfbb6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:55.440409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb8c-0f5e-4e99-9a66-364cbc7cd73e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:55.544138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:55.545053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.545340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.545623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] PATH_INFO: `/v3/projects/3a625f99f9cd42e783fdc952f5995fc9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.546824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a625f99f9cd42e783fdc952f5995fc9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:55.548926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:55.601315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a625f99f9cd42e783fdc952f5995fc9', 'request_id': 'req-7236c722-4647-4a06-9e9d-26581612d0ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.609125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a625f99f9cd42e783fdc952f5995fc9', 'request_id': 'req-7236c722-4647-4a06-9e9d-26581612d0ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.618077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a625f99f9cd42e783fdc952f5995fc9', 'request_id': 'req-7236c722-4647-4a06-9e9d-26581612d0ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.635205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:55.635608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] The token cache is being invalidate because project 3a625f99f9cd42e783fdc952f5995fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:55.635964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.636642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7236c722-4647-4a06-9e9d-26581612d0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.636774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:55.638555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1415/2799] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:55 2022] DELETE /identity/v3/projects/3a625f99f9cd42e783fdc952f5995fc9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:55.643569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc943-1d39-4c4f-9e3f-86cc8e36dc66 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.643855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc943-1d39-4c4f-9e3f-86cc8e36dc66 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.644132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc943-1d39-4c4f-9e3f-86cc8e36dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.652834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d94ec-22dd-41ef-b29c-34291cea4210 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:55.703587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2effc943-1d39-4c4f-9e3f-86cc8e36dc66 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:55.705416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2effc943-1d39-4c4f-9e3f-86cc8e36dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:55.746568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:55.747662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.749812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.750765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] PATH_INFO: `/v3/projects/82dcdaf57e6a4fb5ae891203fec373e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.752677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82dcdaf57e6a4fb5ae891203fec373e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:55.755533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:55.854279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1416/2800] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:55.855823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82dcdaf57e6a4fb5ae891203fec373e3', 'request_id': 'req-7d45b3be-8665-4185-89c2-a29911757d1a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.862500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.863005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.863923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.864713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82dcdaf57e6a4fb5ae891203fec373e3', 'request_id': 'req-7d45b3be-8665-4185-89c2-a29911757d1a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.882478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82dcdaf57e6a4fb5ae891203fec373e3', 'request_id': 'req-7d45b3be-8665-4185-89c2-a29911757d1a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.907009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:55.909197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:55.919063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] The token cache is being invalidate because project 82dcdaf57e6a4fb5ae891203fec373e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:54:55.919473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.921106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7d45b3be-8665-4185-89c2-a29911757d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:54:55.923273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1385/2801] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:55 2022] DELETE /identity/v3/projects/82dcdaf57e6a4fb5ae891203fec373e3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:55.929003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48bc6-d85f-4373-a30b-7f691e6d4b83 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:55.929342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48bc6-d85f-4373-a30b-7f691e6d4b83 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:55.929630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd48bc6-d85f-4373-a30b-7f691e6d4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:55.960194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ccd48bc6-d85f-4373-a30b-7f691e6d4b83 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:55.961713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ccd48bc6-d85f-4373-a30b-7f691e6d4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:56.029254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1417/2802] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:56.033723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.043152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979bc8e-f59d-4f2a-b674-ead2db395c9a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.049279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.050429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.050869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.051327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.052206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:56.052705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.054519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.074170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1418/2803] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:54:56.085528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.106159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57560-50f7-450c-9570-a802985cb00b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.110416 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1386/2804] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:56.118225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.119138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.119619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.120102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.121035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.123311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.123924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.124814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.126975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.174928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:56.176243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:56.181869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1419/2805] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:56.182878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.257313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e9d76-4e5f-49f3-8db5-d10705b5670e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.262576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.263381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.264560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.264939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.265841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.268411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.299517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1420/2806] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:56.304709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.306480 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1387/2807] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:56.310401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.322159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88fca-1a29-481b-9baa-37db73f6787e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.326436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc3c1-d9fa-4f33-ac49-c78bed6f42df None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.328230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.329046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.330486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.330770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.331902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.334262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.347566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1421/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:56.347710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.348111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.348223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.348509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.349410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:54:56.352302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.352917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.357359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.365691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9bf6d-bf12-4447-9300-c6b49e502fc7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.373548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.374635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.375009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.376162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.376162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.378409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.389514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1388/2809] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:54:56.393069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.411810 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1422/2810] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:56.412979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.418984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bada-79e7-4a00-9495-e2d6efbbb441 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.426179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221a35-3f87-4179-9620-0b4d4302a5e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.430774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.431768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.432309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.432588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.432721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.433468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.434429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.435635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.435755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.436027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] PATH_INFO: `/v3/projects/b683458310c945dd9acbecfb8661a9f5/users/38ba365bc3b9486eac23e3eeae7af79f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.458928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b683458310c945dd9acbecfb8661a9f5, user_id=38ba365bc3b9486eac23e3eeae7af79f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.464076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fa272-454a-4d49-a210-bb6574d5d4cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.493557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1389/2811] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:54:56.496974 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1423/2812] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:56 2022] PUT /identity/v3/projects/b683458310c945dd9acbecfb8661a9f5/users/38ba365bc3b9486eac23e3eeae7af79f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:56.499721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.518111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8a03-d93b-4cdf-9b4a-77e7be3dcd9d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.519739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8a03-d93b-4cdf-9b4a-77e7be3dcd9d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.521540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8a03-d93b-4cdf-9b4a-77e7be3dcd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.641893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3a0c8a03-d93b-4cdf-9b4a-77e7be3dcd9d None None] MFA Rules not processed for user `38ba365bc3b9486eac23e3eeae7af79f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:56.646009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3a0c8a03-d93b-4cdf-9b4a-77e7be3dcd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:56.655890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4cc04-2b0d-4ef1-850e-13a9b460deba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.668504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.669223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.669514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.669792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.670484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.674708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.713501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1390/2813] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:54:56.718286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.738728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb67005-d436-4e92-9afa-07581e8857c0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.755140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.757357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.757645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.757926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.758722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.763969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.768228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1424/2814] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:56.781508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.781849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.782073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.801113 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1391/2815] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:54:56.806490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.808210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] MFA Rules not processed for user `38ba365bc3b9486eac23e3eeae7af79f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:56.809653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:56.823596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1425/2816] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:54:56.829292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dfc8f-665c-47b7-badc-cebd47cf5791 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.835531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.836215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.836528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.836809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.837595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.839233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078046d-c4b5-4783-bed8-20607fa2ffb5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.852924 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1392/2817] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:54:56.856983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:56.869908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a9451-ab36-4151-a809-827c31a58a95 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:56.876317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:56.877803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.878087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.878361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] PATH_INFO: `/v3/projects/78889a02e6054dd49c29b72fc422e9c8/users/59d64769b0374642a462d10d4ff49f1b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.896525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78889a02e6054dd49c29b72fc422e9c8, user_id=59d64769b0374642a462d10d4ff49f1b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:56.899210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:56.916371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1426/2818] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:54:56 2022] PUT /identity/v3/projects/78889a02e6054dd49c29b72fc422e9c8/users/59d64769b0374642a462d10d4ff49f1b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:54:56.922221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:56.922914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:56.923193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:56.963632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:56.964993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:57.019151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:57.021166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:57.054299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1393/2819] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:57.081764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:57.083283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:57.135039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6475-5c7a-4003-a14e-3246ae564922 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:57.143063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:57.144170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:57.144569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:57.145111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:57.176430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c456-a4b7-42d0-8fd9-6f458c2dba04 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:57.185812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:57.186497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:57.188020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:57.189547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:57.222949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:57.225089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e549-4c24-4031-9786-e190f18c568a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:57.236727 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1394/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:54:57.254293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:57.256489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29fb4-4e69-44f6-91e5-a8d0d5c76593 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:57.269616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1427/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:54:59.323585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:59.324173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:59.324173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:59.377346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] MFA Rules not processed for user `59d64769b0374642a462d10d4ff49f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:59.378657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:59.473884 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1395/2822] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:59.484871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7af6-9134-474e-bafa-82295ba74413 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:59.485427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7af6-9134-474e-bafa-82295ba74413 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:59.485427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7af6-9134-474e-bafa-82295ba74413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:59.505588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8d4e7af6-9134-474e-bafa-82295ba74413 None None] MFA Rules not processed for user `59d64769b0374642a462d10d4ff49f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:54:59.506817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8d4e7af6-9134-474e-bafa-82295ba74413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:54:59.514108 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1428/2823] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:54:59.525468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:54:59.539745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcc5e4-668b-444d-a76a-83c60fe57a02 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:54:59.545611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:54:59.546077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:54:59.546367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:54:59.546652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:54:59.554936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:54:59.556633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c91c7-4c9a-4ed7-96d5-fd756ca9bc8c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:54:59.566635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1396/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:55:25.514217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da600-1890-4e10-ba1c-9bd80863d63e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:25.514731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da600-1890-4e10-ba1c-9bd80863d63e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:25.514842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615da600-1890-4e10-ba1c-9bd80863d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:25.534439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-615da600-1890-4e10-ba1c-9bd80863d63e None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:25.535596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-615da600-1890-4e10-ba1c-9bd80863d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:25.589094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1429/2825] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:27.236053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:27.236995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:27.237453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:27.263402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] MFA Rules not processed for user `a2e061bb9a054fb1945417baf444eaee`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:27.264937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:27.341941 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1397/2826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:29.606149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:29.606601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:29.606601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:29.646716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] MFA Rules not processed for user `c1d982c5db7e47a6ae521f2137af3204`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:29.648396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:29.798896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1430/2827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:40.051778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:40.066755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745df41-a5f4-4af5-bef6-6f15a3f287ec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:40.072981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:40.074420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:40.074765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:40.075009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] PATH_INFO: `/v3/users/59d64769b0374642a462d10d4ff49f1b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:40.076435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d64769b0374642a462d10d4ff49f1b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:40.079384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:40.143032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d64769b0374642a462d10d4ff49f1b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.162483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d64769b0374642a462d10d4ff49f1b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.163641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d64769b0374642a462d10d4ff49f1b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.178138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d64769b0374642a462d10d4ff49f1b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.200974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-770c29ac-99fb-4aa5-a327-593af925842a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d64769b0374642a462d10d4ff49f1b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.211594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1398/2828] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:55:40 2022] DELETE /identity/v3/users/59d64769b0374642a462d10d4ff49f1b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:55:40.671106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:40.694930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f101d-70f9-4889-b869-7a9dae662742 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:40.780296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:40.781487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:40.781922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:40.782348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] PATH_INFO: `/v3/projects/78889a02e6054dd49c29b72fc422e9c8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:40.783932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78889a02e6054dd49c29b72fc422e9c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:40.787360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:40.851995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78889a02e6054dd49c29b72fc422e9c8', 'request_id': 'req-733f1de7-a78d-4f07-97e6-95990d5d987b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.859568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78889a02e6054dd49c29b72fc422e9c8', 'request_id': 'req-733f1de7-a78d-4f07-97e6-95990d5d987b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.868898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78889a02e6054dd49c29b72fc422e9c8', 'request_id': 'req-733f1de7-a78d-4f07-97e6-95990d5d987b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.882727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] The token cache is being invalidate because project 78889a02e6054dd49c29b72fc422e9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:55:40.883304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.884383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-733f1de7-a78d-4f07-97e6-95990d5d987b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:55:40.887446 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1431/2829] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:55:40 2022] DELETE /identity/v3/projects/78889a02e6054dd49c29b72fc422e9c8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:55:40.895048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:40.895583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:40.896070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:40.934644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:40.936629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.017961 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1399/2830] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:41.026996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.027284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.027562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.046928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:41.048852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.060586 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1432/2831] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:55:41.065266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.076816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86791f46-82ec-4b5e-b245-6fc621349165 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.082590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.083411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.083691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.084136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.084899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:55:41.085225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.086822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.102417 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1400/2832] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:55:41.104349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.115731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b71f2-23a8-4516-b349-42b4aa3a5cc2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.126644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.127450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.127736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.128203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.130092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.132787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.170568 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1433/2833] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:55:41 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:55:41.174313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.185025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8af812-891e-4f61-a206-f45c776822fa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.251188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.252369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.252704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.253032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.254281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.256498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78cb87-adec-4c1b-8f1f-2377c5d0b1b5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.281445 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1401/2834] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:55:41 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:55:41.286035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.304644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015f619-adb4-4c08-830a-102402063671 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.312092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.313344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.313796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.314236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.316537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.319644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.323617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014199a-4863-4333-8603-18618e9fb4f7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.324069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014199a-4863-4333-8603-18618e9fb4f7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.324360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014199a-4863-4333-8603-18618e9fb4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.333688 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1434/2835] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:55:41.337689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.349659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07068-9b7b-4eae-86b5-e105e18d5457 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.351717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c014199a-4863-4333-8603-18618e9fb4f7 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:41.353308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c014199a-4863-4333-8603-18618e9fb4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.355508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.356179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.357075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.357629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.358611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.360431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.376797 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1435/2836] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:55:41.378137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.390735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadea13e-b42c-488a-b93c-a8f284c765fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.401159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.402470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.402761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.403184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] PATH_INFO: `/v3/projects/99e28f04f7dd4777891efe100377f141/users/ee8c4a666eb94960b71b0353d32b5f67/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.422767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e28f04f7dd4777891efe100377f141, user_id=ee8c4a666eb94960b71b0353d32b5f67, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.426521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.437081 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1402/2837] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:55:41.456289 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1436/2838] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:55:41 2022] PUT /identity/v3/projects/99e28f04f7dd4777891efe100377f141/users/ee8c4a666eb94960b71b0353d32b5f67/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:55:41.462046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.462396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.462973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.489183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:41.492172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.508359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.510513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.585486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1403/2839] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:41.611621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:41.614544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:41.626591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbbcc0-d8cf-4554-b6e1-45520ccf93f2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.632910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.633665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.634017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.634402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.702920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641677b-44bf-4939-a67d-72350e5a8208 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:41.708259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:41.709013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:41.709610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:41.709888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:41.719590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.721323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6fd5b-bec0-417b-90bf-efdaa028c84c service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.722914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:41.724593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c821bc9-b310-440d-b0fd-e8aa28040cc9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:41.736905 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1437/2840] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:41.738472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1404/2841] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:55:42.724220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a214-01d9-4ff6-9bcf-0683a0a7f24c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:42.726272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a214-01d9-4ff6-9bcf-0683a0a7f24c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:42.727028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a214-01d9-4ff6-9bcf-0683a0a7f24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:42.789146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bfb4a214-01d9-4ff6-9bcf-0683a0a7f24c None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:42.794242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bfb4a214-01d9-4ff6-9bcf-0683a0a7f24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:42.825346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a001-34dd-4c4f-a1e8-496989a0198d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:42.827278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a001-34dd-4c4f-a1e8-496989a0198d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:42.828204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a001-34dd-4c4f-a1e8-496989a0198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:42.918102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-21e6a001-34dd-4c4f-a1e8-496989a0198d None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:42.921493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-21e6a001-34dd-4c4f-a1e8-496989a0198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:42.927281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1438/2842] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:42.945891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:42.946256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:42.946588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:42.985057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:42.986489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:43.004099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1439/2843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:43.023280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:43.025260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:43.122385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1405/2844] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:43.169439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2109a4-655d-4fb5-9179-23b673b1f926 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:43.179233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:43.179976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:43.180300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:43.180689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:43.198427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:43.200656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5980d1-7910-43a2-a64e-27abaa4669d4 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:43.214548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1440/2845] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:55:45.847819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:45.849108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:45.849556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:45.853479 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1406/2846] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:55:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:55:45.868877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a818-2684-4852-8139-a1fda11c7ba5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:45.869452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a818-2684-4852-8139-a1fda11c7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:45.869663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a818-2684-4852-8139-a1fda11c7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:45.894879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-25d8a818-2684-4852-8139-a1fda11c7ba5 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:45.896416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25d8a818-2684-4852-8139-a1fda11c7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:45.982894 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1441/2847] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:46.000849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:46.003102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:46.042290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a560caa-ef59-4717-b762-c3fea9486abc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:46.055303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:46.056255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:46.056722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:46.057227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:46.073790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:46.075597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d441a2e-69d9-4628-aa9d-02baa7d2cfb5 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:46.098940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1407/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:55:46.349035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a7e1-8496-4483-ac69-ddff70b83188 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:46.349597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a7e1-8496-4483-ac69-ddff70b83188 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:46.349976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a7e1-8496-4483-ac69-ddff70b83188 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:46.352943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1442/2849] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:55:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:55:46.367697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1addf-1eba-4f9d-8e5e-fcff44b47055 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:46.367997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1addf-1eba-4f9d-8e5e-fcff44b47055 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:46.368287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1addf-1eba-4f9d-8e5e-fcff44b47055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:46.410966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c7e1addf-1eba-4f9d-8e5e-fcff44b47055 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:55:46.412373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7e1addf-1eba-4f9d-8e5e-fcff44b47055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:55:46.432864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1408/2850] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:55:46.463719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2a7e1-8496-4483-ac69-ddff70b83188 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:55:46.484606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2a7e1-8496-4483-ac69-ddff70b83188 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:55:46.489966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:55:46.490645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:55:46.491071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:55:46.491350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:55:46.518872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:55:46.520911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:55:46.540016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1443/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:00.325146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:00.326067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:00.328190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:00.385966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:00.388296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:00.420859 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1409/2852] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:00.424344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:00.430306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:00.473236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcb244-1cd0-4793-ae62-d79da34b5e31 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:00.479784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:00.481201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:00.483528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:00.483528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] PATH_INFO: `/v3/users/67d48665a950454aa634b35c21bbb279` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:00.483528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d48665a950454aa634b35c21bbb279)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:00.486023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:00.577223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d48665a950454aa634b35c21bbb279'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:00.600023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d48665a950454aa634b35c21bbb279'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:00.601819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d48665a950454aa634b35c21bbb279'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:00.604322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d48665a950454aa634b35c21bbb279'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:00.627327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dba8ce33-bf28-47a1-9123-6b68cfaba0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d48665a950454aa634b35c21bbb279'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:00.673890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1444/2853] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:00 2022] DELETE /identity/v3/users/67d48665a950454aa634b35c21bbb279 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:01.682836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:01.703631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def16601-11b4-4174-8f0a-1513a5e40a50 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:01.839587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:01.840782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:01.841376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:01.841975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] PATH_INFO: `/v3/projects/8d12a2c8ad9a43f2bded1c2804915030` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:01.843378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d12a2c8ad9a43f2bded1c2804915030)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:01.847346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:01.940549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d12a2c8ad9a43f2bded1c2804915030', 'request_id': 'req-90c802d3-b821-4113-9c60-598f74fa0458'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:01.949610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d12a2c8ad9a43f2bded1c2804915030', 'request_id': 'req-90c802d3-b821-4113-9c60-598f74fa0458'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:01.968833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d12a2c8ad9a43f2bded1c2804915030', 'request_id': 'req-90c802d3-b821-4113-9c60-598f74fa0458'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:01.989140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] The token cache is being invalidate because project 8d12a2c8ad9a43f2bded1c2804915030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:01.989690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:01.990960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90c802d3-b821-4113-9c60-598f74fa0458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:01.993337 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1410/2854] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:01 2022] DELETE /identity/v3/projects/8d12a2c8ad9a43f2bded1c2804915030 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:01.998741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:01.999719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.000174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.031613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:02.033327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:02.134003 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1445/2855] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:02.143152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.144828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.145201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.165218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:02.166693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:02.177670 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1411/2856] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:02.182490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.201660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a3058-6cef-4b40-9dd9-52c094a52be3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.229988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.231648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.232187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.232678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.234183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:02.235105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.238171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.261914 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1446/2857] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:02.266188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.278630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919d5f-ebf5-4580-8069-b4cb396cbf31 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.285228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.286063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.286348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.286627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.287386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.290341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.375229 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1412/2858] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:02 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:02.380262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.397049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9ced-3a16-4130-8c28-84774297676d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.551273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.551964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.552249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.552553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.553248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.555181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.589264 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1447/2859] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:02 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:02.593290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.610051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a63f-f855-42c2-9ca7-012f4a933577 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.623954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.627517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.629494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.630040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.636587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.642925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.662875 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1413/2860] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:56:02.664604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.677349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ae99f-9f53-4be9-8cb0-4d9bc0998747 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.685626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.686452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.686882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.687166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.688053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.690349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec96a9-f523-4de5-8d4e-16aa19750a20 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.707540 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1448/2861] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:02.708974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:02.725875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cbcf7-283a-4796-98d4-b2ef14ce8506 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:02.732653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:02.733798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.734588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.734918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] PATH_INFO: `/v3/projects/ca062168c5234ac98bdfe39669d817d7/users/b4e403362d974575bed8e6aca5fde653/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.785991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca062168c5234ac98bdfe39669d817d7, user_id=b4e403362d974575bed8e6aca5fde653, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:02.807913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:02.848513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1414/2862] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:02 2022] PUT /identity/v3/projects/ca062168c5234ac98bdfe39669d817d7/users/b4e403362d974575bed8e6aca5fde653/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:02.850364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfc5d-1dda-4ca7-9fcd-2785b0ea8af2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:02.850660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfc5d-1dda-4ca7-9fcd-2785b0ea8af2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:02.851675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfc5d-1dda-4ca7-9fcd-2785b0ea8af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:02.939881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-365cfc5d-1dda-4ca7-9fcd-2785b0ea8af2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:02.941786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-365cfc5d-1dda-4ca7-9fcd-2785b0ea8af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:03.113094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1449/2863] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:03.130007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:03.132148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:03.239067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6196247-21eb-4351-9c6d-ae86fce433ed admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:03.249429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:03.250189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:03.252700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:03.253044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:03.277800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:03.284076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9babc73-f411-4cf2-9762-82536f79f2f9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:03.309389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1415/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:05.248637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:05.249525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:05.249974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:05.282360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] MFA Rules not processed for user `b4e403362d974575bed8e6aca5fde653`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:05.283932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:05.385526 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1450/2865] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:05.390865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:05.391739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:05.392226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:05.413713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] MFA Rules not processed for user `b4e403362d974575bed8e6aca5fde653`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:05.415306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:05.425237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1416/2866] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:05.505875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:05.507474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:05.527810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794407-b992-401b-97fd-536af9a358b5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:05.538419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:05.539320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:05.539608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:05.539886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] PATH_INFO: `/v3/users/cf5e0bd625644d9eabf92db0624219e9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:05.541178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5e0bd625644d9eabf92db0624219e9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:05.543115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:05.608162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5e0bd625644d9eabf92db0624219e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:05.622024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5e0bd625644d9eabf92db0624219e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:05.622692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5e0bd625644d9eabf92db0624219e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:05.623346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5e0bd625644d9eabf92db0624219e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:05.631851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5e0bd625644d9eabf92db0624219e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:05.654277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1451/2867] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:05 2022] DELETE /identity/v3/users/cf5e0bd625644d9eabf92db0624219e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:05.729219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:05.731064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:05.865513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58905e-0047-4b8d-b0a1-add014e0c0b0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:06.012954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:06.013629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:06.013920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:06.014203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:06.016437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:06.121446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:06.123702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a62ac-39eb-4adc-acdd-6d6c9d437a9c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:06.147283 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1417/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:06.266482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:06.269594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:06.432029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad08ac5-b4ee-404c-abb5-db58d71708ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:06.436944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:06.438621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:06.438983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:06.439659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] PATH_INFO: `/v3/projects/6e2a80eb708d4a2b8aab54b268dc218d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:06.441567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2a80eb708d4a2b8aab54b268dc218d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:06.443632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:06.489831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:06.490371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:06.490617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:06.521311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] MFA Rules not processed for user `6bf48963161747228e3cafa0bc045729`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:06.522560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:06.525684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2a80eb708d4a2b8aab54b268dc218d', 'request_id': 'req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.537710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2a80eb708d4a2b8aab54b268dc218d', 'request_id': 'req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.555829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2a80eb708d4a2b8aab54b268dc218d', 'request_id': 'req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.588800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] The token cache is being invalidate because project 6e2a80eb708d4a2b8aab54b268dc218d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:06.589500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.590190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.592503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1452/2869] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:06 2022] DELETE /identity/v3/projects/6e2a80eb708d4a2b8aab54b268dc218d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:06.596113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:06.598238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:06.622954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1418/2870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:06.691824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca8d80-95f8-4bbd-adaf-49da0a2e2aa8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:06.700162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:06.701876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:06.702356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:06.702984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] PATH_INFO: `/v3/users/2f721650b0c6470eb76943460ae60b2b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:06.704919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f721650b0c6470eb76943460ae60b2b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:06.707165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:06.773391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f721650b0c6470eb76943460ae60b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.782313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f721650b0c6470eb76943460ae60b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.783724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f721650b0c6470eb76943460ae60b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.784710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f721650b0c6470eb76943460ae60b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.792571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0512bc1a-bb9b-4245-9376-79e30bdbd0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f721650b0c6470eb76943460ae60b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:06.812813 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1453/2871] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:06 2022] DELETE /identity/v3/users/2f721650b0c6470eb76943460ae60b2b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:07.525196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:07.541824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3fe18-6441-45e4-aa20-6c5ee4f4d7b4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:07.691399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:07.692423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:07.692739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:07.693038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] PATH_INFO: `/v3/projects/f13f1d267fc04ac989b506aaa7708ddc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:07.694533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13f1d267fc04ac989b506aaa7708ddc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:07.696660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:07.762412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13f1d267fc04ac989b506aaa7708ddc', 'request_id': 'req-95c5d38c-24c0-44bd-8492-39682579af8f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:07.781191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13f1d267fc04ac989b506aaa7708ddc', 'request_id': 'req-95c5d38c-24c0-44bd-8492-39682579af8f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:07.793031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13f1d267fc04ac989b506aaa7708ddc', 'request_id': 'req-95c5d38c-24c0-44bd-8492-39682579af8f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:07.822033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] The token cache is being invalidate because project f13f1d267fc04ac989b506aaa7708ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:07.822365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:07.823118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-95c5d38c-24c0-44bd-8492-39682579af8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:07.825860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1419/2872] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:07 2022] DELETE /identity/v3/projects/f13f1d267fc04ac989b506aaa7708ddc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:07.832426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:07.833384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:07.833873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:07.859550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:07.865632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:07.984638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:07.984927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:07.985425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:07.986239 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1454/2873] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:08.017605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:08.021518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:08.050831 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1420/2874] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:08.055968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.102893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e6a21-2aab-4b90-8b15-2cf09f037d87 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.118316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.122851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.123188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.123478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.124242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:08.124590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.133204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.168433 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1455/2875] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:08.168889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.185905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b600-cd2a-42d0-ba40-75a23007b9ec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.200559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.202550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.202854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.203134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.206304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.210666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.291788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.305567 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1421/2876] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:08 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:08.310239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f38fc-d839-43ad-83fe-4bcf68a8812d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.398129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.399595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.400127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.400413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.403111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.403111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.463752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.474975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1456/2877] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:08 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:08.483450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b947-2328-4bfa-9c77-030ae01daa04 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.510174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.511170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.513355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.517231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.520090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.522031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.575621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.603485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3ef7d-f0f9-4079-9e53-0f7649eb11a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.604893 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1422/2878] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:08.619088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.619996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.620360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.620797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.621558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.623306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba609-232c-4f96-b81c-e38763c5ec29 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.652394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.669436 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1457/2879] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:08.669882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18cb5-de22-4653-bef2-92c6b37395fe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:08.675090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:08.676293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.676713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.676713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] PATH_INFO: `/v3/projects/8431d621f8be4ba0b1a6faa94c77d545/users/ae2afa22826f4e999b65a9b0cfad1a59/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.696022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8431d621f8be4ba0b1a6faa94c77d545, user_id=ae2afa22826f4e999b65a9b0cfad1a59, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:08.699963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:08.723309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:08.723771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:08.724058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:08.725450 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1423/2880] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:08 2022] PUT /identity/v3/projects/8431d621f8be4ba0b1a6faa94c77d545/users/ae2afa22826f4e999b65a9b0cfad1a59/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:08.747371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:08.748925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:08.883679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1458/2881] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:08.896543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:08.899850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:09.080032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f7f5-ce56-4709-8dac-8a7ce63c8ff7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:09.129385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:09.133272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:09.133563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:09.133843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:09.171024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:09.185905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:09.266996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1424/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:17.286615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:17.288863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:17.310625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c2493-d40f-4523-a22a-2aab0fb201d7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:17.329334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:17.330884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:17.331360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:17.331644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] PATH_INFO: `/v3/users/c42119999e6f40b487a7174dc5a7d617` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:17.334932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42119999e6f40b487a7174dc5a7d617)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:17.338106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:17.447376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42119999e6f40b487a7174dc5a7d617'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:17.460620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42119999e6f40b487a7174dc5a7d617'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:17.462166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42119999e6f40b487a7174dc5a7d617'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:17.463241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42119999e6f40b487a7174dc5a7d617'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:17.475160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42119999e6f40b487a7174dc5a7d617'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:17.505257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1459/2883] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:17 2022] DELETE /identity/v3/users/c42119999e6f40b487a7174dc5a7d617 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:17.937873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:17.940137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:17.969565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d030721-4dff-4998-abc2-de458f37026d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:18.083262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:18.084006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:18.084380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:18.084990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] PATH_INFO: `/v3/users/38ba365bc3b9486eac23e3eeae7af79f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:18.088715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ba365bc3b9486eac23e3eeae7af79f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:18.091673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:18.161609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ba365bc3b9486eac23e3eeae7af79f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.209841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ba365bc3b9486eac23e3eeae7af79f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.212227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ba365bc3b9486eac23e3eeae7af79f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.229397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:18.235288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ba365bc3b9486eac23e3eeae7af79f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.237601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:18.259197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5d04217-13a6-4a4b-98d7-f53531912ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ba365bc3b9486eac23e3eeae7af79f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.262139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8064b-2ddf-4855-b07f-65a19200e3a0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:18.270321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:18.271225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:18.271510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:18.271791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] PATH_INFO: `/v3/projects/fde6bd005e3a4a25b63639832027ab85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:18.273655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde6bd005e3a4a25b63639832027ab85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:18.275680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:18.279138 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1425/2884] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:17 2022] DELETE /identity/v3/users/38ba365bc3b9486eac23e3eeae7af79f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:18.282046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:18.283620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:18.283821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:18.325871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:18.334373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:18.391297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde6bd005e3a4a25b63639832027ab85', 'request_id': 'req-3c46acd0-b88a-4b50-a0aa-83b38624dd24'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.400635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde6bd005e3a4a25b63639832027ab85', 'request_id': 'req-3c46acd0-b88a-4b50-a0aa-83b38624dd24'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.430782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde6bd005e3a4a25b63639832027ab85', 'request_id': 'req-3c46acd0-b88a-4b50-a0aa-83b38624dd24'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.455270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] The token cache is being invalidate because project fde6bd005e3a4a25b63639832027ab85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:18.470738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.474827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.482329 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1426/2885] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:18.482555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1460/2886] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:18 2022] DELETE /identity/v3/projects/fde6bd005e3a4a25b63639832027ab85 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:18.483441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:18.484491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:18.506184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2943b-b0f5-462e-8208-6dd830bd7d19 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:18.510454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:18.511927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:18.641935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46acd0-b88a-4b50-a0aa-83b38624dd24 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:18.642563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:18.643449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:18.643695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:18.644596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] PATH_INFO: `/v3/users/f60ddc5315644283a9f9f5b8dfa67a0f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:18.646203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60ddc5315644283a9f9f5b8dfa67a0f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:18.646759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:18.647431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:18.647721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:18.647829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:18.648004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:18.663667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:18.689990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:18.692253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19073b70-6f35-48f4-8974-5bd68fca91e4 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:18.707861 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1461/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:18.735850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60ddc5315644283a9f9f5b8dfa67a0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.763757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60ddc5315644283a9f9f5b8dfa67a0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.772319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60ddc5315644283a9f9f5b8dfa67a0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.786824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60ddc5315644283a9f9f5b8dfa67a0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.795114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60ddc5315644283a9f9f5b8dfa67a0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:18.813407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1427/2888] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:18 2022] DELETE /identity/v3/users/f60ddc5315644283a9f9f5b8dfa67a0f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:19.611231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:19.611661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:19.611661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:19.674846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] MFA Rules not processed for user `ae2afa22826f4e999b65a9b0cfad1a59`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:19.681729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:19.787670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:19.789515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:19.871034 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1462/2889] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:19.888037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:19.891338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:19.919978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf8c1d-02b9-4422-918e-a238f430b51f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:19.925443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:19.926501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:19.926888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:19.927267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] PATH_INFO: `/v3/projects/b683458310c945dd9acbecfb8661a9f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:19.928848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b683458310c945dd9acbecfb8661a9f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:19.930856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.032311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc76e-7392-47e5-a030-b9b68895a2db None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.038349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b683458310c945dd9acbecfb8661a9f5', 'request_id': 'req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.048056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b683458310c945dd9acbecfb8661a9f5', 'request_id': 'req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.056834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b683458310c945dd9acbecfb8661a9f5', 'request_id': 'req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.077464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] The token cache is being invalidate because project b683458310c945dd9acbecfb8661a9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:20.077938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.078774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3eb8ece6-ff5e-4eb7-ab81-828b3d1cdf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.080950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1428/2890] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:19 2022] DELETE /identity/v3/projects/b683458310c945dd9acbecfb8661a9f5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:20.088339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.088780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.089159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.115052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:20.116712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.126749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.127869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.128835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.129339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] PATH_INFO: `/v3/projects/14673cb7d0f940cabbca0f8510bf3545` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.130621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14673cb7d0f940cabbca0f8510bf3545)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.132684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.165946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1429/2891] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:20.167060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.169622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.215200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14673cb7d0f940cabbca0f8510bf3545', 'request_id': 'req-fbc1089e-8f5b-4c73-991d-633edeecd379'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.224872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14673cb7d0f940cabbca0f8510bf3545', 'request_id': 'req-fbc1089e-8f5b-4c73-991d-633edeecd379'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.239161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14673cb7d0f940cabbca0f8510bf3545', 'request_id': 'req-fbc1089e-8f5b-4c73-991d-633edeecd379'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.252421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] The token cache is being invalidate because project 14673cb7d0f940cabbca0f8510bf3545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:20.252822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.254192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fbc1089e-8f5b-4c73-991d-633edeecd379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:20.256609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1463/2892] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:19 2022] DELETE /identity/v3/projects/14673cb7d0f940cabbca0f8510bf3545 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:20.258068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848500-0e4c-46d7-9cf9-84439ae94e5d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.258447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848500-0e4c-46d7-9cf9-84439ae94e5d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.258838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848500-0e4c-46d7-9cf9-84439ae94e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.279294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-34848500-0e4c-46d7-9cf9-84439ae94e5d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:20.280773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-34848500-0e4c-46d7-9cf9-84439ae94e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.293455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea7c95-6a33-43a4-bd62-6e56ac66e677 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.377569 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1464/2893] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:20.379662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.380710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.380999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.400268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.401255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.402465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.402861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.405004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.410285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:20.412000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.440660 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1465/2894] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:20.440660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.474873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2504b-764f-46a6-958e-1c7ffa366811 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.486114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.488244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7f690-9dd7-4d8a-884c-bf97b639d1cb service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.499537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1430/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:20.500638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.501030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.501411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.506249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.509933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.510380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.510661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.512383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:20.512383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.513334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.532213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1466/2896] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:20.536240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.538680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:20.539898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:20.548025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f303-2916-47ac-8f9a-ff12de29d740 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.553864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.554666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.555191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.555575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.556078 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1431/2897] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:20.556610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.558625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.560213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.584129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a93b-d6c6-45ab-b875-b5efd54a7c91 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.600900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.601887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.602414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.603514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.604422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:20.604910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.605759 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1467/2898] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:20.608899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.610325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.637862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1432/2899] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:20.641519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.656097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc85d3-eb2c-4218-80ee-87c38494408b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.707522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb405283-abc6-4034-a715-581deb0555c5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.727704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.729090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.729659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.730398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.732377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.739651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.769492 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1468/2900] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:20.770788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.796059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f1c57-ece5-4adf-a478-214610cb95bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.808781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.809043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.809683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.810075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.811521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.812307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.812804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.813111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.813396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.814370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.817403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.820829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.848173 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1469/2901] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:20.849334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.860653 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1433/2902] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:20.865457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:20.875169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10dde9-0d7f-4d65-a91b-1e1a66f05d56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.944179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a064-de60-400e-ab3e-7b9441de0013 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:20.950058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:20.950859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:20.951021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:20.951302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:20.952064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:20.955208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:20.990788 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1434/2903] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:20 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:20.996444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.008931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.009789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.010181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.010579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.011655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.013424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.022913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02db5d-73f4-4b21-bb1b-628756d9387e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.028425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.029166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.029451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.029731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.030823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.032753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.041694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1470/2904] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:21.045813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.053125 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1435/2905] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:21.054051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.065861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1743b9-481a-478c-b917-4ceb58f9a008 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.068717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad3cc-f8c1-4b17-a6e6-99e2c4aaf1e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.072180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.072902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.073192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.073805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.074737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.076354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.082565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.083812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.084210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.084514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] PATH_INFO: `/v3/projects/3b4cf9b24e94432c9be83206789d34a0/users/88910d8c5d0840b6a7a77f487ec5526a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.108892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1436/2906] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:21.113648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.124118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4cf9b24e94432c9be83206789d34a0, user_id=88910d8c5d0840b6a7a77f487ec5526a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.126882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847a60-0d1d-43e6-a8cf-ae75da1b0a55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.137878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b273d-5580-41ee-a2f8-5b896e0e3c12 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.145751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.147033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.147261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.147586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] PATH_INFO: `/v3/projects/418a8df498a341c59e0257bf4c38f83f/users/6115d36990584f6c9dcef14970bcd64e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.166838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418a8df498a341c59e0257bf4c38f83f, user_id=6115d36990584f6c9dcef14970bcd64e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.167543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1471/2907] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:21 2022] PUT /identity/v3/projects/3b4cf9b24e94432c9be83206789d34a0/users/88910d8c5d0840b6a7a77f487ec5526a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:21.169131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.169406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.169609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d97f0-43ab-4c1e-a5ce-04bcbcbdbef3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.169724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.191392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1437/2908] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:21 2022] PUT /identity/v3/projects/418a8df498a341c59e0257bf4c38f83f/users/6115d36990584f6c9dcef14970bcd64e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:21.201217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.201653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.202020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.210433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] MFA Rules not processed for user `88910d8c5d0840b6a7a77f487ec5526a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:21.215534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:21.291555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] MFA Rules not processed for user `6115d36990584f6c9dcef14970bcd64e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:21.296865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:21.425987 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1472/2909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:21.430892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.458285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1438/2910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:21.459233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.579188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08edb8-704c-472b-a58f-186c8736fa16 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.596353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.596353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.596353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.597667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e71e39-2ad6-44b0-937e-48bbdb409594 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.598601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.599306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.603362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.609950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.610623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.610902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.611177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.611865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.615132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.662417 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1473/2911] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:21.666475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.667223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1439/2912] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:21.671264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.815135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feae11-724e-42ee-9ae3-63529dea2622 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.838117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031cd5a-8403-44c2-ba4e-6a95afde7b3e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.846857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.847953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.848396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.849409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.850630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.852913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.889474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.892238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.892554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.892841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.893658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.895107 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1440/2913] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:21.898288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.901282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.913025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675dc5a-2f88-4551-9a12-5bf88304ac12 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.917936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.918775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.919250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.919539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.920709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.923351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:21.939268 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1441/2914] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:21.944478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.947255 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1474/2915] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:21 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:21.950799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:21.957401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99d847-85d4-445f-b67f-bdfa00b25e12 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.964845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.966037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.966331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.966607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] PATH_INFO: `/v3/projects/6185437cc7674d57bf62549a9a318b41/users/e51cdf7123a242a5aaf4089c01d28787/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.976018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d9f7-519a-4222-94b8-169227f27dcc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:21.981405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:21.982351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:21.982789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:21.983442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:21.985116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:21.988109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.009682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6185437cc7674d57bf62549a9a318b41, user_id=e51cdf7123a242a5aaf4089c01d28787, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.013172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.015114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1475/2916] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:22.018835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:22.041304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba124-f2f3-450c-b8d7-9a195ed36be1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:22.042740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1442/2917] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:21 2022] PUT /identity/v3/projects/6185437cc7674d57bf62549a9a318b41/users/e51cdf7123a242a5aaf4089c01d28787/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:22.049065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:22.179742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29bd6-6825-4207-87c0-e4d01343cf0c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:22.189222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:22.190164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.190753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.191349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.192272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.194183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:22.194907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.195826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.196343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.196771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] PATH_INFO: `/v3/projects/4dd60dfb7a17482db59ee191f0da6323/users/821ce984e3e340f8a4fca21d765e579e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.217835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd60dfb7a17482db59ee191f0da6323, user_id=821ce984e3e340f8a4fca21d765e579e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.221637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.237198 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1443/2918] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:22.239371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:22.259182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9526234-d2c2-44bf-a64a-c1b3f6aeb421 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:22.267167 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1476/2919] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:22 2022] PUT /identity/v3/projects/4dd60dfb7a17482db59ee191f0da6323/users/821ce984e3e340f8a4fca21d765e579e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:22.269223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:22.388125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:22.389068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.389613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.389899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] PATH_INFO: `/v3/projects/6185437cc7674d57bf62549a9a318b41/users/e51cdf7123a242a5aaf4089c01d28787/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.397716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6185437cc7674d57bf62549a9a318b41, user_id=e51cdf7123a242a5aaf4089c01d28787, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.401026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b55a9a-2504-4d5e-aea0-fa1864109ea1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.406224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51a7b-2edb-4b6a-8807-ba3befa025ae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:22.414008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:22.415224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.415657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.416241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.418873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.420846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.422305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1444/2920] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:22 2022] PUT /identity/v3/projects/6185437cc7674d57bf62549a9a318b41/users/e51cdf7123a242a5aaf4089c01d28787/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:22.434526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.435215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.435703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.451399 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1477/2921] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:22.453490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:22.506182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bd078-10cf-44d7-a6f2-40c654d30aa7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:22.510481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] MFA Rules not processed for user `e51cdf7123a242a5aaf4089c01d28787`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:22.513770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:22.649750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:22.651395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.651893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.652375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] PATH_INFO: `/v3/projects/4dd60dfb7a17482db59ee191f0da6323/users/821ce984e3e340f8a4fca21d765e579e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.655827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd60dfb7a17482db59ee191f0da6323, user_id=821ce984e3e340f8a4fca21d765e579e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:22.659280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c0841-09fe-424a-97ff-c074ee858392 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:22.674045 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1478/2922] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:22 2022] PUT /identity/v3/projects/4dd60dfb7a17482db59ee191f0da6323/users/821ce984e3e340f8a4fca21d765e579e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:22.681058 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1445/2923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:22.686290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:22.686987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:22.688127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:22.755476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] MFA Rules not processed for user `821ce984e3e340f8a4fca21d765e579e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:22.758267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:22.920222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1479/2924] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:22.925688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.055561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf14d-928e-4351-9d06-ba89b3a7ca6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.060935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.061885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.062240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.062615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.063888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.064898 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:23.064898 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:23.064898 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:23.065939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.090847 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1446/2925] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 20:56:22 2022] POST /identity/v3/domains => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:23.094955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.111969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa235b4-8fea-43ea-a08b-e13b592a9d77 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.192386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.193349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.194225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.194811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.196034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.199519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.253850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1480/2926] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:23 2022] POST /identity/v3/users => generated 348 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:23.257726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.279368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1dac5-e001-48b5-9392-3e7d24cd5029 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.294098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.296361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.296775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.297840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.299556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.303216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.374857 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1447/2927] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:23 2022] POST /identity/v3/users => generated 323 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:23.379284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.392139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08522b4-0eb8-4c75-a618-b791342a9f54 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.405542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.406634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.407185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.408540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users/1f4b7771ff22412aa5a1da5095fd6bfd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.435776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:get_user(user_id=1f4b7771ff22412aa5a1da5095fd6bfd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.458032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.466304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1481/2928] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/users/1f4b7771ff22412aa5a1da5095fd6bfd => generated 348 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:23.467981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.481042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf490c-6e41-41c7-ada8-a4bb224876ef tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.492441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.493450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.493851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.494260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.495569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Adding query filter params (domain_id=1b78d46ae56f41ebbdc83d3c1ef0e209) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:23.496065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.497603 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:23.497603 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:23.497603 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:23.503175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.535060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1448/2929] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/users?domain_id=1b78d46ae56f41ebbdc83d3c1ef0e209 => generated 485 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:23.539994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.552757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd90dc-f7ac-487b-ad2a-0a5a14919f1d tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.558142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.559256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.559649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.560037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.560990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.562704 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:23.562704 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:23.562704 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:23.564792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.625706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1482/2930] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/users => generated 9436 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:23.631555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.644721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03549935-dfe1-40f2-989a-758f2c705765 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.658885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.663370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:23.671490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.676910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.678323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.679147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.682055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1317484918) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:23.685859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.701158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.760469 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1449/2931] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/users?name=tempest-test_user-1317484918 => generated 476 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:23.765989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.794660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a28340-a8f8-4a24-8915-59633cd3dd07 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.806645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.811713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.812011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.812300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.817740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:23.818069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.821121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:23.879446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1450/2932] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:23.881048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:23.887414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952c58b-0568-4de7-99c3-096b0f3e6e59 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.900087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658cf-8420-45eb-ab34-335c1f10ee7c tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:23.909035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.910349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.910632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.911496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.918677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:23.919580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:23.919864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:23.920145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users/5d7fd25e0162400a8c46b0c174cae5cc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:23.963845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d7fd25e0162400a8c46b0c174cae5cc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:23.968923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:24.038732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:24.041880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:24.061326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1483/2933] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:24.134534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7fd25e0162400a8c46b0c174cae5cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.156428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7fd25e0162400a8c46b0c174cae5cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.157362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7fd25e0162400a8c46b0c174cae5cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.169703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7fd25e0162400a8c46b0c174cae5cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.186574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7fd25e0162400a8c46b0c174cae5cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.227377 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1451/2934] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:23 2022] DELETE /identity/v3/users/5d7fd25e0162400a8c46b0c174cae5cc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:24.231860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:24.255050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edace6-a6fd-4c0f-8765-a8e55d663015 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:24.353338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:24.354403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:24.354756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:24.355116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/users/1f4b7771ff22412aa5a1da5095fd6bfd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:24.357314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1f4b7771ff22412aa5a1da5095fd6bfd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:24.365376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:24.484918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4b7771ff22412aa5a1da5095fd6bfd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.517787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4b7771ff22412aa5a1da5095fd6bfd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.518430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4b7771ff22412aa5a1da5095fd6bfd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.519129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4b7771ff22412aa5a1da5095fd6bfd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.535825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4b7771ff22412aa5a1da5095fd6bfd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.573066 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1484/2935] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:24 2022] DELETE /identity/v3/users/1f4b7771ff22412aa5a1da5095fd6bfd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:24.577246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:24.581079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:24.625742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0935-bd4e-448d-a147-b2f51975c632 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:24.833173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:24.836928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:24.837627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:24.837875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/domains/1b78d46ae56f41ebbdc83d3c1ef0e209` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:24.842782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1b78d46ae56f41ebbdc83d3c1ef0e209)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:24.843826 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:24.843826 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:24.843826 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:24.848650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:24.903448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.905293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.966287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.967841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed8dc8fb-0d82-4d5e-ac64-969a4644ee12 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:24.971122 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1452/2936] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 20:56:24 2022] PATCH /identity/v3/domains/1b78d46ae56f41ebbdc83d3c1ef0e209 => generated 276 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:24.975426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:24.977164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:24.994919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb3b0-da05-4f72-b49c-71d529b5789e tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:25.085320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821ce984e3e340f8a4fca21d765e579e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dd60dfb7a17482db59ee191f0da6323', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:25.090447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:25.090828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:25.091119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] PATH_INFO: `/v3/domains/1b78d46ae56f41ebbdc83d3c1ef0e209` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:25.122465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1b78d46ae56f41ebbdc83d3c1ef0e209)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:25.123923 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:25.123923 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:25.123923 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:25.125793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:25.179162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.185289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.368403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.381139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.397130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.430124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] The token cache is being invalidate because project 1b78d46ae56f41ebbdc83d3c1ef0e209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:25.430376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.433500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.439850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:25.441710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:25.442581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:25.447266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1453/2937] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:56:25 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:56:25.474559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:56:25.475204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.476346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:25.484194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.489447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1b78d46ae56f41ebbdc83d3c1ef0e209', 'request_id': 'req-bef0f50a-80be-4fee-80f1-16d276501883'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.498659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1485/2938] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:24 2022] DELETE /identity/v3/domains/1b78d46ae56f41ebbdc83d3c1ef0e209 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:25.505012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:25.509560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:25.667720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0f50a-80be-4fee-80f1-16d276501883 tempest-UsersV3TestJSON-1271214849 tempest-UsersV3TestJSON-1271214849-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:25.673023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:25.673992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:25.674276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:25.674601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] PATH_INFO: `/v3/users/88910d8c5d0840b6a7a77f487ec5526a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:25.676394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88910d8c5d0840b6a7a77f487ec5526a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:25.681860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:25.689002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:25.692913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:25.790490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88910d8c5d0840b6a7a77f487ec5526a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.805257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88910d8c5d0840b6a7a77f487ec5526a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.807575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88910d8c5d0840b6a7a77f487ec5526a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.809133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88910d8c5d0840b6a7a77f487ec5526a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.832411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262244-cbd0-4425-8692-df1cb8cbe602 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:25.836112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e08781d-fe81-4e42-af0f-616221e42140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88910d8c5d0840b6a7a77f487ec5526a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:25.852142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cdf7123a242a5aaf4089c01d28787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185437cc7674d57bf62549a9a318b41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:25.853152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:25.853508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:25.853854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] PATH_INFO: `/v3/projects/418a8df498a341c59e0257bf4c38f83f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:25.864414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1486/2939] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:25 2022] DELETE /identity/v3/users/88910d8c5d0840b6a7a77f487ec5526a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:25.864643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a8df498a341c59e0257bf4c38f83f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:25.865487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:25.866119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:25.866415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:25.866696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:25.867979 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1454/2940] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:56:25 2022] GET /identity/v3/projects/418a8df498a341c59e0257bf4c38f83f => generated 377 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:25.906204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:25.907886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.008152 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1487/2941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:26.025422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:26.031547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.104856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6320e7-5e1d-430a-b0eb-4f6ebdbf2869 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:26.164424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:26.165400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:26.165674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:26.165953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:26.177464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:26.178916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:26.190176 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1455/2942] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:26.431835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:26.433747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.604053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d37d28-231f-458d-8924-2bf9555e49b7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:26.610477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:26.611274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:26.611793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:26.611915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:26.614037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.629127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:26.630548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.650428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3c33f-7fee-49a3-b8cb-aeb5bee18adb service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:26.657532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:26.658440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:26.658721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:26.658994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] PATH_INFO: `/v3/projects/3b4cf9b24e94432c9be83206789d34a0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:26.663786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4cf9b24e94432c9be83206789d34a0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:26.663786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:26.715347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:26.718484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:26.731741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4cf9b24e94432c9be83206789d34a0', 'request_id': 'req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.734624 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1488/2943] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:26.744842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4cf9b24e94432c9be83206789d34a0', 'request_id': 'req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.759724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4cf9b24e94432c9be83206789d34a0', 'request_id': 'req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.783791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] The token cache is being invalidate because project 3b4cf9b24e94432c9be83206789d34a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:26.784222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.784995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-811d5114-ae93-4f20-b3bc-183a8fc8f4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.787211 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1456/2944] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:26 2022] DELETE /identity/v3/projects/3b4cf9b24e94432c9be83206789d34a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:26.791002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:26.807376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111521e7-659e-4b4b-8204-848bdf6a2b26 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:26.847339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6d36-6efc-4600-b0de-9a3c24db26ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:26.847625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6d36-6efc-4600-b0de-9a3c24db26ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:26.847910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6d36-6efc-4600-b0de-9a3c24db26ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:26.886513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-814c6d36-6efc-4600-b0de-9a3c24db26ec None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:26.887745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-814c6d36-6efc-4600-b0de-9a3c24db26ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:26.907397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:26.909147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:26.909461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:26.909906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] PATH_INFO: `/v3/users/821ce984e3e340f8a4fca21d765e579e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:26.911150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821ce984e3e340f8a4fca21d765e579e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:26.913418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:26.989570 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1457/2945] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:26.992352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821ce984e3e340f8a4fca21d765e579e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:26.999804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821ce984e3e340f8a4fca21d765e579e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.000468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821ce984e3e340f8a4fca21d765e579e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.001138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821ce984e3e340f8a4fca21d765e579e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.010769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821ce984e3e340f8a4fca21d765e579e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.030143 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1489/2946] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:26 2022] DELETE /identity/v3/users/821ce984e3e340f8a4fca21d765e579e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:27.282552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297bc-9433-4bdb-80db-809314882213 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.283073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297bc-9433-4bdb-80db-809314882213 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.283159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297bc-9433-4bdb-80db-809314882213 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.284992 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1458/2947] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:56:27.289912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:56:27.291847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:27.369913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:27.371199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:27.437401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cf04-e538-4bd0-9839-705ef9861ac3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:27.446725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e51cdf7123a242a5aaf4089c01d28787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6185437cc7674d57bf62549a9a318b41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:27.449368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.449637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.449991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] PATH_INFO: `/v3/projects/418a8df498a341c59e0257bf4c38f83f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.451632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a8df498a341c59e0257bf4c38f83f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:27.456147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ce1d1-8e17-4c27-b793-5e1aed226f9e tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:27.457808 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1490/2948] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:56:27 2022] GET /identity/v3/projects/418a8df498a341c59e0257bf4c38f83f => generated 377 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:27.492685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570297bc-9433-4bdb-80db-809314882213 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:27.494454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-570297bc-9433-4bdb-80db-809314882213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:27.626260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570297bc-9433-4bdb-80db-809314882213 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:27.633123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:27.634248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.634504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.634715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] PATH_INFO: `/v3/projects/4dd60dfb7a17482db59ee191f0da6323` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.636241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd60dfb7a17482db59ee191f0da6323)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:27.638233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:27.706078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd60dfb7a17482db59ee191f0da6323', 'request_id': 'req-6d24a51e-74c5-4706-ab5f-57315d21adf9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.713897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd60dfb7a17482db59ee191f0da6323', 'request_id': 'req-6d24a51e-74c5-4706-ab5f-57315d21adf9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.719681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd60dfb7a17482db59ee191f0da6323', 'request_id': 'req-6d24a51e-74c5-4706-ab5f-57315d21adf9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.734931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] The token cache is being invalidate because project 4dd60dfb7a17482db59ee191f0da6323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:27.735238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.735930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6d24a51e-74c5-4706-ab5f-57315d21adf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:27.738476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1459/2949] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:27 2022] DELETE /identity/v3/projects/4dd60dfb7a17482db59ee191f0da6323 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:27.743282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.743828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.744215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.764123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:27.765551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:27.838670 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1491/2950] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:27.846032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.846321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.846600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.865516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:27.866732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:27.875094 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1460/2951] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:27.879128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:27.890170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db0d9a-7e67-49a9-a0ed-7a73ec7f788f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:27.896779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:27.897534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.897882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.898224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.899015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:27.899387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:27.901111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:27.914959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1492/2952] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:27.919547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:27.929828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb7828-893b-46df-8ea0-0625c777df61 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:27.935329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:27.936077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:27.936425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:27.936793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:27.937623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:27.939834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:27.988218 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1461/2953] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:27 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:27.993432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.004676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02094c14-f2db-43dd-9927-a438ab2afcda admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.091715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.092545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.096753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.097084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.098455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.102806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.131819 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1493/2954] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:27 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:28.137728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.150959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822b7f-7eb2-4cb3-ae9d-9fd67e706ad3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.166503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.167450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.168223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.168357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.169187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.171172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.187530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1462/2955] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:28.191924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.204266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be037d6-5874-4a40-9826-4262010ab4f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.210785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.212705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.213172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.213621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.214554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.216348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f9222-f715-41c4-a2bc-488a6fa40328 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.228123 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1494/2956] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:28.232301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.243167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829f231-7c1f-47ae-892c-5f417544f466 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.251789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.256034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.256034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.256034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] PATH_INFO: `/v3/projects/e1b1683ebae94db889b969a8eb0d27e1/users/73288150b0984389b2830a9eec4bbb92/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.270935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b1683ebae94db889b969a8eb0d27e1, user_id=73288150b0984389b2830a9eec4bbb92, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.273683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.294213 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1463/2957] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:28 2022] PUT /identity/v3/projects/e1b1683ebae94db889b969a8eb0d27e1/users/73288150b0984389b2830a9eec4bbb92/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:28.308773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.308917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.309159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.352150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] MFA Rules not processed for user `73288150b0984389b2830a9eec4bbb92`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:28.353725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:28.463146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1495/2958] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:28.468199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.544843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92f2a-33d6-4e01-8fcc-b183ae8a966d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.550296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.550983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.551271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.551726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.552606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.554549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.598604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1464/2959] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:28 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:28.601755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.614189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf74fa-c5b0-420e-973a-e4499fba0b6d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.697749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.698547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.698831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.699102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.699788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.703385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.728398 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1496/2960] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:28 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:28.732290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.743626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7778f6-56a0-4d08-a570-65657c9617e6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.748591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.749267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.749555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.749835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.750561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.752177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.767563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1465/2961] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:28.772254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.788280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0b2c-30b2-4bdd-986f-47bf2bce2fab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.798730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.799934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.800354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.800813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] PATH_INFO: `/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce/users/bb3e4578d75f4daf9f28a3046a6f5afd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.823111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d40f9d56f64c10b8ec776de24aa5ce, user_id=bb3e4578d75f4daf9f28a3046a6f5afd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:28.826974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e19c29-05d5-4c1e-a6a4-ef0f33960908 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:28.844158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1497/2962] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:28 2022] PUT /identity/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce/users/bb3e4578d75f4daf9f28a3046a6f5afd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:28.848392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:28.864117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f50ed-9747-4aea-8835-f3327488a765 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:28.875132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.875427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.875711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:28.900402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] MFA Rules not processed for user `c1d982c5db7e47a6ae521f2137af3204`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:28.901811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:28.996042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:28.997899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:28.998808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:28.999242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.000984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.003792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55079f6-24e9-43a5-9387-6ce7a3a9c086 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.016188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1498/2963] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:29.019419 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1466/2964] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:29.023679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.037551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bebe6c-5889-400f-90ae-1894f98ea720 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.042775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.043671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.043954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.044285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] PATH_INFO: `/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce/users/bb3e4578d75f4daf9f28a3046a6f5afd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.046396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d40f9d56f64c10b8ec776de24aa5ce, user_id=bb3e4578d75f4daf9f28a3046a6f5afd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.049230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.064799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1499/2965] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:29 2022] PUT /identity/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce/users/bb3e4578d75f4daf9f28a3046a6f5afd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:29.071784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30046-233d-4dcf-bd8a-c17810796288 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.072091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30046-233d-4dcf-bd8a-c17810796288 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.072345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc30046-233d-4dcf-bd8a-c17810796288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.110331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ebc30046-233d-4dcf-bd8a-c17810796288 None None] MFA Rules not processed for user `bb3e4578d75f4daf9f28a3046a6f5afd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:29.111481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ebc30046-233d-4dcf-bd8a-c17810796288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:29.256659 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1467/2966] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:29.261892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.275148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c16e-32a8-4d86-a68e-2548f2ca73ad None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.275565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c16e-32a8-4d86-a68e-2548f2ca73ad None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.276071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809c16e-32a8-4d86-a68e-2548f2ca73ad None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.277349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92736bd-2546-4c35-8c62-9b2460642567 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.279466 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1468/2967] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:56:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:56:29.284335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.285715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.286074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.286428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.287206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.290042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.290220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.290949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.291310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.291953 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.common [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 02 20:56:29.317892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:29.319170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:29.338274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1500/2968] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:29 2022] POST /identity/v3/projects => generated 358 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:29.345397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.454726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8702b3c-dc3f-4bbb-8c4c-899ab8c1d8f0 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.464847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.466501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.466861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.467821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.468648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.471963 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1469/2969] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:29.478558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.498076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.499901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:29.515803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1501/2970] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:29 2022] POST /identity/v3/users => generated 416 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:29.516445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afd47-a306-48df-b0e9-e0662fa69ed0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.520715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.534019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4138d-2fec-4e93-9b73-02bc60cf9e80 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.544631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.546024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.546426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.546938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/users/3516a3e8017846eabd04a366ccdf15ac` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.572745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_user(user_id=3516a3e8017846eabd04a366ccdf15ac)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.575716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.577590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1502/2971] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:56:29 2022] GET /identity/v3/users/3516a3e8017846eabd04a366ccdf15ac => generated 416 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:29.581995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.593804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c99f-db71-422b-b846-60b0b3e8c941 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.596393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.598000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.598503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.599107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.599539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.600404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.600734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.601017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/users/3516a3e8017846eabd04a366ccdf15ac` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.602202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3516a3e8017846eabd04a366ccdf15ac)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.604345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.612046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.613773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.626177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1470/2972] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:29.655816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3516a3e8017846eabd04a366ccdf15ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.664790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3516a3e8017846eabd04a366ccdf15ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.666324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3516a3e8017846eabd04a366ccdf15ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.667153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3516a3e8017846eabd04a366ccdf15ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.676324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3516a3e8017846eabd04a366ccdf15ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.696892 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1503/2973] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:29 2022] DELETE /identity/v3/users/3516a3e8017846eabd04a366ccdf15ac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:29.700892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.712342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d492-a502-44f4-babc-8221ad51bdba service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.783481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.785012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.785277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.785556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/22975852e7d2403bb30de86ccf16cc13` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.786848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22975852e7d2403bb30de86ccf16cc13)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.788931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.851251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22975852e7d2403bb30de86ccf16cc13', 'request_id': 'req-c07ae5dd-6732-4b2a-818f-8496df8f4323'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.857711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22975852e7d2403bb30de86ccf16cc13', 'request_id': 'req-c07ae5dd-6732-4b2a-818f-8496df8f4323'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.863674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22975852e7d2403bb30de86ccf16cc13', 'request_id': 'req-c07ae5dd-6732-4b2a-818f-8496df8f4323'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.878236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 22975852e7d2403bb30de86ccf16cc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:29.878559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.879207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:29.881019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1471/2974] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:29 2022] DELETE /identity/v3/projects/22975852e7d2403bb30de86ccf16cc13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:29.885819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.887553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:29.903219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fac7-a7df-428e-8506-6dfcb3b30588 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:29.966478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:29.967271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:29.967646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:29.968345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:29.968781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:29.970685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:29.988078 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1504/2975] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:29 2022] POST /identity/v3/projects => generated 348 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:29.992132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:29.993766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.012874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae5dd-6732-4b2a-818f-8496df8f4323 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.096778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.098016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.098303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.098614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.099342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:30.099685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.100734 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:30.100734 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:30.100734 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:30.101871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.128894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.129314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1472/2976] 10.222.0.18 () {58 vars in 1159 bytes} [Sat Apr 2 20:56:29 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:30.139851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf54cf-4582-405b-974b-d78acbd9991c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.145282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.145816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.146106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.146381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.147107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.149275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.166996 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1505/2977] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:56:30 2022] GET /identity/v3/domains => generated 829 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:30.171221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.181546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772fc9-4962-4ba2-86b3-3858ac6b6ae5 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.186366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.187225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.187509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.187788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/5cd97380983344eb927ff4ae6188138e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.189479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_project(project_id=5cd97380983344eb927ff4ae6188138e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.190497 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:30.190497 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:30.190497 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:30.191518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.201759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.202468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.228357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.229001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6adcbf67-c1e4-4840-b12c-409b9fdd2957 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.231550 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1473/2978] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 20:56:30 2022] PATCH /identity/v3/projects/5cd97380983344eb927ff4ae6188138e => generated 362 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:30.235655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.237466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.252775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e305f-5eb2-48b9-87c9-91567f78a05a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.329922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.330808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.331091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.331965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/5cd97380983344eb927ff4ae6188138e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.344662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5cd97380983344eb927ff4ae6188138e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.346449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.371249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.375002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5cd97380983344eb927ff4ae6188138e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.402083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.402612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.402612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.425901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:30.427150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.430315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.437172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.448897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.477148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 5cd97380983344eb927ff4ae6188138e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:30.477741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.478520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.486426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.490429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.491435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5cd97380983344eb927ff4ae6188138e', 'request_id': 'req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.494131 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1474/2979] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:30.497626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1506/2980] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:30 2022] DELETE /identity/v3/projects/5cd97380983344eb927ff4ae6188138e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:30.504127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.505963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.573067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aec457-24c5-429e-ad6f-433802a59589 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.597087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.598177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.599418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.599418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.600404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.602697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.671779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1475/2981] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:30 2022] POST /identity/v3/projects => generated 357 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:30.674140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.677072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.703550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee585f7-a65d-4165-b4bf-0130fd9d7d4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.789390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.790409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.790699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.790976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/b6154f9a789a42d78223b8f663e442d4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.792854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=b6154f9a789a42d78223b8f663e442d4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.795024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.801991 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1507/2982] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:30 2022] GET /identity/v3/projects/b6154f9a789a42d78223b8f663e442d4 => generated 357 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:30.803288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.821044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5196d-6eea-4b85-80e4-c7322b9c5a2a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:30.827870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:30.829076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:30.829372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:30.829654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/b6154f9a789a42d78223b8f663e442d4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:30.831465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6154f9a789a42d78223b8f663e442d4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:30.834126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:30.906298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6154f9a789a42d78223b8f663e442d4', 'request_id': 'req-1ca12929-28b7-4463-9e7d-cacb1f90fe78'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.917092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6154f9a789a42d78223b8f663e442d4', 'request_id': 'req-1ca12929-28b7-4463-9e7d-cacb1f90fe78'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.922837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6154f9a789a42d78223b8f663e442d4', 'request_id': 'req-1ca12929-28b7-4463-9e7d-cacb1f90fe78'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.945064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project b6154f9a789a42d78223b8f663e442d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:30.945426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.946505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:30.953715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:30.955032 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1476/2983] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:30 2022] DELETE /identity/v3/projects/b6154f9a789a42d78223b8f663e442d4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:30.956483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:30.977713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070c46-9dbc-46fb-ae31-fdc8ef44829a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.056154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.057131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.057571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.058023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.058918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.061257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.111924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1508/2984] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:30 2022] POST /identity/v3/projects => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:31.116415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.129645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12929-28b7-4463-9e7d-cacb1f90fe78 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.195992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.199554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:31.250182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.251066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.251354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.251637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/e16cc33ec38048d5941a04c47497c8a8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.254840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=e16cc33ec38048d5941a04c47497c8a8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.256918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.259040 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1477/2985] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:31 2022] GET /identity/v3/projects/e16cc33ec38048d5941a04c47497c8a8 => generated 360 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:31.263014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.276836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91b675-7379-41f1-8fa9-bb79b9e17f4f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.287072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.288966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.289385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.291542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/e16cc33ec38048d5941a04c47497c8a8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.292077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e16cc33ec38048d5941a04c47497c8a8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.294781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.321118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3198199-f5e6-4549-bab0-24a7ed1d02ef tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.328579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.329756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.330205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.330599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] PATH_INFO: `/v3/users/6115d36990584f6c9dcef14970bcd64e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.333552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6115d36990584f6c9dcef14970bcd64e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.335805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.375205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16cc33ec38048d5941a04c47497c8a8', 'request_id': 'req-baafbed1-e269-4103-9529-7ae109c1919a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.382986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16cc33ec38048d5941a04c47497c8a8', 'request_id': 'req-baafbed1-e269-4103-9529-7ae109c1919a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.389212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16cc33ec38048d5941a04c47497c8a8', 'request_id': 'req-baafbed1-e269-4103-9529-7ae109c1919a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.408513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project e16cc33ec38048d5941a04c47497c8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:31.409265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.409599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.410624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6115d36990584f6c9dcef14970bcd64e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.415910 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1478/2986] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:31 2022] DELETE /identity/v3/projects/e16cc33ec38048d5941a04c47497c8a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:31.418189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.420220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:31.424271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6115d36990584f6c9dcef14970bcd64e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.426459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6115d36990584f6c9dcef14970bcd64e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.427518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6115d36990584f6c9dcef14970bcd64e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.449633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee98dc47-a3fd-40bb-8d4b-763992a95d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6115d36990584f6c9dcef14970bcd64e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.494204 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1509/2987] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:31 2022] DELETE /identity/v3/users/6115d36990584f6c9dcef14970bcd64e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:31.498876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.500392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.500933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.524615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafbed1-e269-4103-9529-7ae109c1919a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.536362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:31.537936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:31.598273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.599280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.599804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.600779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.601525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.604368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.631264 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1510/2988] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:31.645386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.647314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:31.649760 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1479/2989] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:31 2022] POST /identity/v3/projects => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:31.655867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.661151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:31.719362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a96a6-6673-44b0-95f0-359535d0e9fd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.743936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e90ba-d423-48a1-9a7b-d05a0063fb8d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.749494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.750331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.750630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.750913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/428aece9a0b344958fea08ae4823252e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.752201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=428aece9a0b344958fea08ae4823252e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.754485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.756574 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1480/2990] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:31 2022] GET /identity/v3/projects/428aece9a0b344958fea08ae4823252e => generated 346 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:31.760749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.776500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf3ad2-fbe6-4c16-b004-24c0d7b46bf1 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:31.789895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.790653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.791016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.791367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.798535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:31.799636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:31.800901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:31.801340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/428aece9a0b344958fea08ae4823252e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:31.802931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=428aece9a0b344958fea08ae4823252e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.805305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.869282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428aece9a0b344958fea08ae4823252e', 'request_id': 'req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.876960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:31.877318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428aece9a0b344958fea08ae4823252e', 'request_id': 'req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.879684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:31.884423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428aece9a0b344958fea08ae4823252e', 'request_id': 'req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.896675 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1511/2991] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:31.905820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 428aece9a0b344958fea08ae4823252e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:31.906432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.907227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:31.909895 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1481/2992] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:31 2022] DELETE /identity/v3/projects/428aece9a0b344958fea08ae4823252e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:31.915222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:31.927960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167f3c3-8492-4a43-afc8-906f935ea7e1 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.021828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:32.022639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:32.023006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:32.023483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:32.024722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:32.026286 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:32.026286 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:32.026286 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:32.027690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:32.057832 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1512/2993] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 20:56:31 2022] POST /identity/v3/domains => generated 276 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:32.061078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.064420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:32.099605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddca4ad-6a66-4d46-a4ff-00149f1d9b5d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.213969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:32.214659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:32.214952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:32.215238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:32.216002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:32.218203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:32.278838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1482/2994] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:32 2022] POST /identity/v3/projects => generated 404 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:32.282962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.295096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7a922-ff73-4005-b5d5-8e0eb790e98d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.390282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:32.392308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:32.392776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:32.393185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/c005ec482f2e4d629acef150928435a0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:32.396909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=c005ec482f2e4d629acef150928435a0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:32.402757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:32.406093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1513/2995] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:32 2022] GET /identity/v3/projects/c005ec482f2e4d629acef150928435a0 => generated 404 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:32.409359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.424166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cea61-b2fc-448d-aa06-0c11e9b13530 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.430624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:32.431661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:32.431955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:32.432237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/c005ec482f2e4d629acef150928435a0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:32.436337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c005ec482f2e4d629acef150928435a0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:32.438532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:32.537071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c005ec482f2e4d629acef150928435a0', 'request_id': 'req-834c20b0-dc8a-4ebb-a249-db08d947b357'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.551631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c005ec482f2e4d629acef150928435a0', 'request_id': 'req-834c20b0-dc8a-4ebb-a249-db08d947b357'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.569107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c005ec482f2e4d629acef150928435a0', 'request_id': 'req-834c20b0-dc8a-4ebb-a249-db08d947b357'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.594666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project c005ec482f2e4d629acef150928435a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:32.596117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.597975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.609558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1483/2996] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:32 2022] DELETE /identity/v3/projects/c005ec482f2e4d629acef150928435a0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:32.613084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.615341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:32.629092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc729-3f4f-4191-bdbf-cdba106c1bcb tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.719397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:32.721110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:32.721774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:32.722356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/29fd142a94204ada8cadfe09c68f520b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:32.723949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=29fd142a94204ada8cadfe09c68f520b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:32.725294 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:32.725294 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:32.725294 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:32.726646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:32.771914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.773013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.847919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.849142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:32.852654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1514/2997] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 20:56:32 2022] PATCH /identity/v3/domains/29fd142a94204ada8cadfe09c68f520b => generated 277 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:32.856581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.902771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c20b0-dc8a-4ebb-a249-db08d947b357 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:32.911244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:32.912744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:33.039124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.040276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.040837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.041526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/29fd142a94204ada8cadfe09c68f520b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.052060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99412db4-8b2b-4d26-b9fe-f2748bd974bc tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:33.062622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.064492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.064788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.065067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] PATH_INFO: `/v3/projects/418a8df498a341c59e0257bf4c38f83f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.067338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29fd142a94204ada8cadfe09c68f520b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.069200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418a8df498a341c59e0257bf4c38f83f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.070550 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:33.070550 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:33.070550 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:33.071742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:33.072620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:33.129769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.148725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '29fd142a94204ada8cadfe09c68f520b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.185351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418a8df498a341c59e0257bf4c38f83f', 'request_id': 'req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.202228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418a8df498a341c59e0257bf4c38f83f', 'request_id': 'req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.214036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418a8df498a341c59e0257bf4c38f83f', 'request_id': 'req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.239436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] The token cache is being invalidate because project 418a8df498a341c59e0257bf4c38f83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:33.239723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.240417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.245478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1515/2998] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:32 2022] DELETE /identity/v3/projects/418a8df498a341c59e0257bf4c38f83f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:33.246632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:33.247376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.247880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:33.258904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.271059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.293080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 29fd142a94204ada8cadfe09c68f520b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:33.293285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.294617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.315571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.322841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.326077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '29fd142a94204ada8cadfe09c68f520b', 'request_id': 'req-2f0b9a60-d866-46bd-a552-f02745da6c90'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.336385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1484/2999] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:32 2022] DELETE /identity/v3/domains/29fd142a94204ada8cadfe09c68f520b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:33.345508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:33.349654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:33.420880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a96f2-29ed-448d-a97c-7cb3ed39d0d1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:33.509907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b9a60-d866-46bd-a552-f02745da6c90 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:33.522164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.523000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.523401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.523735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.524951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.527434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:33.553217 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1485/3000] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 20:56:33 2022] POST /identity/v3/domains => generated 276 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:33.557758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:33.564948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.566381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.566663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.566996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] PATH_INFO: `/v3/users/e51cdf7123a242a5aaf4089c01d28787` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.569321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51cdf7123a242a5aaf4089c01d28787)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.571110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:33.674825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51cdf7123a242a5aaf4089c01d28787'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.692359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51cdf7123a242a5aaf4089c01d28787'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.693960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51cdf7123a242a5aaf4089c01d28787'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.693960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51cdf7123a242a5aaf4089c01d28787'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.704443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51cdf7123a242a5aaf4089c01d28787'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:33.710449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51709cf9-976a-44e0-bb54-bb63621c6d84 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:33.718308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.719266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.719799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.720290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.723113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.725931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:33.752669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1516/3001] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:33 2022] DELETE /identity/v3/users/e51cdf7123a242a5aaf4089c01d28787 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:33.777955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1486/3002] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:33 2022] POST /identity/v3/projects => generated 409 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:33.782129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:33.784739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:33.873682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432f8ba-06eb-4bc5-bcfd-c07e39e28e22 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:33.960711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:33.963464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:33.964029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:33.964292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:33.967029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:33.973525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:34.061350 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1517/3003] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:33 2022] POST /identity/v3/projects => generated 404 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:34.062879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:34.076781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbf8a2-2d0a-4843-ba95-5153cb57a6f9 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:34.182474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:34.187215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.187453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.187789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/607da5e4a1d549f2bc553d327224e1be` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.190745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=607da5e4a1d549f2bc553d327224e1be)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:34.193806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:34.254251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607da5e4a1d549f2bc553d327224e1be', 'request_id': 'req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.270523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607da5e4a1d549f2bc553d327224e1be', 'request_id': 'req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.279834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607da5e4a1d549f2bc553d327224e1be', 'request_id': 'req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.304746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 607da5e4a1d549f2bc553d327224e1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:34.305023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.305728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.312705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1487/3004] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:34 2022] DELETE /identity/v3/projects/607da5e4a1d549f2bc553d327224e1be => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:34.315372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:34.318161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:34.339441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8a191-8865-4340-b345-d3e9f862e59a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:34.422829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:34.424409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:34.485942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:34.486902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.487082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.487395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/3358d3acbd7e4e208343086885261a2c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.493641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3358d3acbd7e4e208343086885261a2c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:34.498815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:34.570063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec71bc-9f8d-4d5c-a2d4-1f05c5d06861 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:34.582732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3358d3acbd7e4e208343086885261a2c', 'request_id': 'req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.589866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3358d3acbd7e4e208343086885261a2c', 'request_id': 'req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.602716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3358d3acbd7e4e208343086885261a2c', 'request_id': 'req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.626790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 3358d3acbd7e4e208343086885261a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:34.627060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.628968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3da3df9-f6e9-4a1e-ba38-e89fad8dc3a4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.631077 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1518/3005] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:34 2022] DELETE /identity/v3/projects/3358d3acbd7e4e208343086885261a2c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:34.632876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.633334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.633800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.663253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:34.663849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:34.664303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.664627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.664905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] PATH_INFO: `/v3/projects/6185437cc7674d57bf62549a9a318b41` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.665314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:34.666161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6185437cc7674d57bf62549a9a318b41)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:34.668393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:34.737080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1519/3006] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:34.742141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:34.743547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:34.747673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6185437cc7674d57bf62549a9a318b41', 'request_id': 'req-007f901d-4733-477b-ba9e-608eedd63c3a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.764950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6185437cc7674d57bf62549a9a318b41', 'request_id': 'req-007f901d-4733-477b-ba9e-608eedd63c3a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.777685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6185437cc7674d57bf62549a9a318b41', 'request_id': 'req-007f901d-4733-477b-ba9e-608eedd63c3a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.797485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] The token cache is being invalidate because project 6185437cc7674d57bf62549a9a318b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:34.798088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.799171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-007f901d-4733-477b-ba9e-608eedd63c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.801075 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1488/3007] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:34 2022] DELETE /identity/v3/projects/6185437cc7674d57bf62549a9a318b41 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:34.807558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31e9c-a8c5-4a36-85c6-2b3cdcfd63f2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.808555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31e9c-a8c5-4a36-85c6-2b3cdcfd63f2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.808853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d31e9c-a8c5-4a36-85c6-2b3cdcfd63f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.843152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-48d31e9c-a8c5-4a36-85c6-2b3cdcfd63f2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:34.844699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48d31e9c-a8c5-4a36-85c6-2b3cdcfd63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:34.859111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02cf9d-73e1-4763-9ecb-e68bf773a4c5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:34.933113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:34.933999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.934282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.934554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/925e6b1431c84891bc806b88563a9e19` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.938330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=925e6b1431c84891bc806b88563a9e19)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:34.939487 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1489/3008] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:34.941765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:34.949254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:34.949703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:34.950085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:34.969694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.970909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:34.981298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:34.983853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:35.010795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.011986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.017346 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1520/3009] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 20:56:34 2022] PATCH /identity/v3/domains/925e6b1431c84891bc806b88563a9e19 => generated 277 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:35.025290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.027374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:35.068813 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1490/3010] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:35.073437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.087313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47497bd-d561-4429-bb60-5b8b56f225ea None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.095859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.096946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.097232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.097506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.098241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:35.098552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.100163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.119320 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1491/3011] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:35.120211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.129103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f9b75-22c6-430f-8bd7-c0f390e12f6a tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.131933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabeaaa-9e0e-46d9-a59c-60b1bb6b92eb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.135838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.136894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.137028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.137206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.137484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/925e6b1431c84891bc806b88563a9e19` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.137614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.137846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.138083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.138759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.141678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.151354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=925e6b1431c84891bc806b88563a9e19)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.153285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.184873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1492/3012] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:35.188505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.194949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.199243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '925e6b1431c84891bc806b88563a9e19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.281115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e9fd-4256-453d-9584-f7a7a39c8c41 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.283010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.292810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.314155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.334807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 925e6b1431c84891bc806b88563a9e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:35.335337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.336318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.351574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.356596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.357610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '925e6b1431c84891bc806b88563a9e19', 'request_id': 'req-869160b9-05b2-40c5-aa7f-3aaedf073413'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:35.370040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.370040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.370040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.370040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.370533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.371042 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1521/3013] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:35 2022] DELETE /identity/v3/domains/925e6b1431c84891bc806b88563a9e19 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:35.372099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.372232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.373858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:35.405483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1493/3014] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:35.420305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.423235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:35.439510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36760a49-0ef5-4c79-a3b2-e32a7c185800 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.453187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.454309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.454597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.454872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.455600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.457333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.477193 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1494/3015] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:35.479068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.499929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd513ba4-25ef-46d4-9309-d89eb89d297c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.509860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.510119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869160b9-05b2-40c5-aa7f-3aaedf073413 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.511185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.511652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.511944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.512936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.516197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.516350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.516917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.517486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.517767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.518456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.522491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.529441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1495/3016] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:35.534380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.572350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979521-34ca-43ce-9aba-c6e7c377adc1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.580092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1522/3017] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:35.584179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.584355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.585202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.585485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.585790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] PATH_INFO: `/v3/projects/4da0e8e619e0431fb29b64983f33da56/users/298356dcff5a405493da095dacfc7aa5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.607941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da0e8e619e0431fb29b64983f33da56, user_id=298356dcff5a405493da095dacfc7aa5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.611043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb74f-d038-4314-9e72-7635d49ebfae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.643213 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1496/3018] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:35 2022] PUT /identity/v3/projects/4da0e8e619e0431fb29b64983f33da56/users/298356dcff5a405493da095dacfc7aa5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:35.645342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.645635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.645913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.696572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] MFA Rules not processed for user `298356dcff5a405493da095dacfc7aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:35.697790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:35.731486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5a424-be3f-4cf7-ae0d-a711608e67a8 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.819738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.822433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.822722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.822998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/28650ffeca01431e869dff00a25d3cd2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.826906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=28650ffeca01431e869dff00a25d3cd2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.829428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.832269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1523/3019] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:35 2022] GET /identity/v3/projects/28650ffeca01431e869dff00a25d3cd2 => generated 377 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:35.836413 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1497/3020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:35.838624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.840648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:35.863954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e380f-d903-4c98-8a69-a9bd566cf267 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.875705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.876388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.876724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.877002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.877758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.882305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b23db-ba30-46d7-8510-654b3d38431e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.943314 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1524/3021] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 20:56:35 2022] GET /identity/v3/projects => generated 7306 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:35.953007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.953384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.953607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.958443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6352-e24f-4b05-8144-be1060263e4c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:35.965183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:35.970299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:35.970812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:35.971564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:35.973203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:35.976043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:35.982790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:35.984483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:36.031911 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1498/3022] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:36.033067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.068063 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1525/3023] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:36.068063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.085047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5f6a9-31ea-4c8e-acfe-730e587b797d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.137762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1bbb7-c766-4c7a-96c3-38fd17d783a6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.146445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.147383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.147737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.148081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/28650ffeca01431e869dff00a25d3cd2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.149560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=28650ffeca01431e869dff00a25d3cd2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.151546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.182524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.195232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.195602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.195891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.196654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.198624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.236831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28650ffeca01431e869dff00a25d3cd2', 'request_id': 'req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.237635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1526/3024] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:36 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:36.241895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.246911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28650ffeca01431e869dff00a25d3cd2', 'request_id': 'req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.253976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28650ffeca01431e869dff00a25d3cd2', 'request_id': 'req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.273229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baf71a-9391-45d7-8691-41364e2067d2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.276380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 28650ffeca01431e869dff00a25d3cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:36.276680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.277473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.283095 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1499/3025] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:36 2022] DELETE /identity/v3/projects/28650ffeca01431e869dff00a25d3cd2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:36.288771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.290754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:36.385871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.387100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.387717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.388143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.389077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.397016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.410559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb11fb7-c0e8-4fef-8093-e3181bdb2403 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.422906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.423776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.424063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.424733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.425918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.428700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1527/3026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:36.433127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.433330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.438539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:36.482133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4f09-67f0-4a47-b337-e2f5f3906b00 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.493481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.494473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.494764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.495046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] PATH_INFO: `/v3/projects/832c3ededc024ad785dd0ff868fdb944/users/caeb954f43ec4a169b17d2e17f8dc06b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.499783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1500/3027] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:36 2022] POST /identity/v3/projects => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:36.501097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.520694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832c3ededc024ad785dd0ff868fdb944, user_id=caeb954f43ec4a169b17d2e17f8dc06b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.523847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.543828 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1528/3028] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:36 2022] PUT /identity/v3/projects/832c3ededc024ad785dd0ff868fdb944/users/caeb954f43ec4a169b17d2e17f8dc06b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:36.548114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.595175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445cd57-175f-4c78-aaa4-bfbec26dcfc6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.636238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda2b7f-a23a-4326-8e11-680a88e1c6d7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.642325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.643506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.644402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.644783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.645683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.647177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.658234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1529/3029] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:36.662301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.675969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16235107-8b45-41a9-ae67-717f896874ae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.679890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.680915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.681356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.681897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/063ebae58fd4404487359b934786baff` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.683936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_project(project_id=063ebae58fd4404487359b934786baff)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.684376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.686107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.686572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.686860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.687166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] PATH_INFO: `/v3/projects/832c3ededc024ad785dd0ff868fdb944/users/caeb954f43ec4a169b17d2e17f8dc06b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.690401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832c3ededc024ad785dd0ff868fdb944, user_id=caeb954f43ec4a169b17d2e17f8dc06b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.694341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4710a1-1a19-4ff1-a18a-c226d34f0b01 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.707415 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1530/3030] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:36 2022] PUT /identity/v3/projects/832c3ededc024ad785dd0ff868fdb944/users/caeb954f43ec4a169b17d2e17f8dc06b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:36.719100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65906f2-0615-4024-838e-14567475b135 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.719428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65906f2-0615-4024-838e-14567475b135 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.719985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65906f2-0615-4024-838e-14567475b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.732477 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1501/3031] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 20:56:36 2022] PATCH /identity/v3/projects/063ebae58fd4404487359b934786baff => generated 361 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:36.734592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.748962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c751f-660d-4c1b-bb76-ca816a5d2517 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.755108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d65906f2-0615-4024-838e-14567475b135 None None] MFA Rules not processed for user `caeb954f43ec4a169b17d2e17f8dc06b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:36.756928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d65906f2-0615-4024-838e-14567475b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:36.834271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.835307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.844144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.844144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/063ebae58fd4404487359b934786baff` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.848504 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1531/3032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:36.853969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=063ebae58fd4404487359b934786baff)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.856076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.859576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1502/3033] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:36 2022] GET /identity/v3/projects/063ebae58fd4404487359b934786baff => generated 348 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:36.862244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65906f2-0615-4024-838e-14567475b135 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.874739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65906f2-0615-4024-838e-14567475b135 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:36.880533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:36.881512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:36.882328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:36.882328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/063ebae58fd4404487359b934786baff` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:36.884280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=063ebae58fd4404487359b934786baff)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:36.885982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:36.948072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063ebae58fd4404487359b934786baff', 'request_id': 'req-3183d1f7-d75a-4c00-89c5-7f34b21f495e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.955901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063ebae58fd4404487359b934786baff', 'request_id': 'req-3183d1f7-d75a-4c00-89c5-7f34b21f495e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.967048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063ebae58fd4404487359b934786baff', 'request_id': 'req-3183d1f7-d75a-4c00-89c5-7f34b21f495e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.985061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 063ebae58fd4404487359b934786baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:36.985657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.986794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:36.988681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1532/3034] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:36 2022] DELETE /identity/v3/projects/063ebae58fd4404487359b934786baff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:36.993826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:36.995867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.011687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb160f-fcb5-4335-9f23-3c4f8745479c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.053156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.055592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.111617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.112681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.112969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.113248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.114046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.116682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.153943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1503/3035] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:36 2022] POST /identity/v3/projects => generated 360 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:37.158083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d1f7-d75a-4c00-89c5-7f34b21f495e tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.162777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.241767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109aa4-9386-4b65-9070-9b56b5e21db6 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.248158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.250493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.250493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.250962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/73b967e02ccb495e9da9ce280d0a638d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.252989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.253955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_project(project_id=73b967e02ccb495e9da9ce280d0a638d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.255528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.255822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.256111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.256879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.259060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.320886 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1504/3036] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 20:56:37 2022] PATCH /identity/v3/projects/73b967e02ccb495e9da9ce280d0a638d => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:37.324798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.330667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.333186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.336593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48348a5-2a2d-44f6-8c35-6e6c075d1875 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.342448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.343446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.343743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.343974 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1533/3037] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:37.344097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/73b967e02ccb495e9da9ce280d0a638d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.357982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=73b967e02ccb495e9da9ce280d0a638d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.361482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.363795 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1505/3038] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:37 2022] GET /identity/v3/projects/73b967e02ccb495e9da9ce280d0a638d => generated 359 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:37.367933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.385096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea34d0-6d19-417c-8d79-35b98232d816 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.389996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.390871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.391159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.391435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/73b967e02ccb495e9da9ce280d0a638d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.398647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73b967e02ccb495e9da9ce280d0a638d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.400627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.458793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b967e02ccb495e9da9ce280d0a638d', 'request_id': 'req-cdd9d4fe-4982-44c7-821e-9a941e584d7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:37.464645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b967e02ccb495e9da9ce280d0a638d', 'request_id': 'req-cdd9d4fe-4982-44c7-821e-9a941e584d7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:37.475767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b967e02ccb495e9da9ce280d0a638d', 'request_id': 'req-cdd9d4fe-4982-44c7-821e-9a941e584d7c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:37.493832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 73b967e02ccb495e9da9ce280d0a638d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:37.494052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:37.494887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdd9d4fe-4982-44c7-821e-9a941e584d7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:37.497651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1534/3039] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:37 2022] DELETE /identity/v3/projects/73b967e02ccb495e9da9ce280d0a638d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:37.502328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.504972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.525838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634cc30-741d-4835-9045-0dd8f8fd4a6d tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.617890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.618100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.618385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.642624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.644113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.645190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.645603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.646417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.648567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.692515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:37.695747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.711021 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1506/3040] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:37 2022] POST /identity/v3/projects => generated 354 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:37.713396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.797747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1535/3041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:37.848082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.849930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.853393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b250-8190-4f93-9a45-b689e0f1185f tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.858569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.859746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.860039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.860320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/7323096cc89b4e418a96d7492e1ddf99` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.861697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:update_project(project_id=7323096cc89b4e418a96d7492e1ddf99)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.864538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.902946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1507/3042] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 20:56:37 2022] PATCH /identity/v3/projects/7323096cc89b4e418a96d7492e1ddf99 => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:37.906977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.920150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d676-2148-4324-8ce8-1bf27a59ce8c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.926331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.927699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.928093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.928513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/7323096cc89b4e418a96d7492e1ddf99` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.932827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b2bb1-c63e-4046-923e-d9907c20364e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.939012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.939668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.939952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.940312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.942307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:37.945404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:get_project(project_id=7323096cc89b4e418a96d7492e1ddf99)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.947766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:37.952944 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1508/3043] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:56:37 2022] GET /identity/v3/projects/7323096cc89b4e418a96d7492e1ddf99 => generated 355 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:37.954358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:37.966169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd21c-dfd1-4afb-a21c-a13dab291ca4 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:37.971019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:37.972432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:37.972764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:37.973042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/projects/7323096cc89b4e418a96d7492e1ddf99` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:37.974252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7323096cc89b4e418a96d7492e1ddf99)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:37.976162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:38.012070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:38.013938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:38.026993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1536/3044] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:38.029064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7323096cc89b4e418a96d7492e1ddf99', 'request_id': 'req-f636bc3d-4f18-4368-8f40-150c4fd87e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.036825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7323096cc89b4e418a96d7492e1ddf99', 'request_id': 'req-f636bc3d-4f18-4368-8f40-150c4fd87e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.045141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7323096cc89b4e418a96d7492e1ddf99', 'request_id': 'req-f636bc3d-4f18-4368-8f40-150c4fd87e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.062712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] The token cache is being invalidate because project 7323096cc89b4e418a96d7492e1ddf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:38.063026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.064237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.067814 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1509/3045] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:37 2022] DELETE /identity/v3/projects/7323096cc89b4e418a96d7492e1ddf99 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:38.071398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:38.083854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19af4-4a1a-4f71-b81b-2ef6cc368c3a service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:38.166496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:38.167558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.167942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.168489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/925e6b1431c84891bc806b88563a9e19` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:38.178204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:56:38.188533 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Could not find domain: 925e6b1431c84891bc806b88563a9e19.: keystone.exception.DomainNotFound: Could not find domain: 925e6b1431c84891bc806b88563a9e19. Apr 02 20:56:38.193298 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1537/3046] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 20:56:38 2022] PATCH /identity/v3/domains/925e6b1431c84891bc806b88563a9e19 => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:38.194518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:38.196940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.212683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636bc3d-4f18-4368-8f40-150c4fd87e7c tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:38.220029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3e4578d75f4daf9f28a3046a6f5afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d40f9d56f64c10b8ec776de24aa5ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:38.220488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.220868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.221224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] PATH_INFO: `/v3/domains/29fd142a94204ada8cadfe09c68f520b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:38.233976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 20:56:38.244637 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Could not find domain: 29fd142a94204ada8cadfe09c68f520b.: keystone.exception.DomainNotFound: Could not find domain: 29fd142a94204ada8cadfe09c68f520b. Apr 02 20:56:38.248823 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1510/3047] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 20:56:38 2022] PATCH /identity/v3/domains/29fd142a94204ada8cadfe09c68f520b => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:38.250054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:38.251883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.281474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:38.283941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.365835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919619-3ab5-4221-87e0-529e0f28d852 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:38.373259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:38.375800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.376063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.376346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] PATH_INFO: `/v3/users/73288150b0984389b2830a9eec4bbb92` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:38.377643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73288150b0984389b2830a9eec4bbb92)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:38.379833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:38.484639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73288150b0984389b2830a9eec4bbb92'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.490538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d372e6-c14b-4b81-91ad-5964046d6ef3 tempest-ProjectsTestJSON-704861090 tempest-ProjectsTestJSON-704861090-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:38.497492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:38.497769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.497949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.498876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:38.506960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.524370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73288150b0984389b2830a9eec4bbb92'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.525312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73288150b0984389b2830a9eec4bbb92'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.528138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73288150b0984389b2830a9eec4bbb92'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.559320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af2d56e-ba92-4134-93c8-f1372b130d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73288150b0984389b2830a9eec4bbb92'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:38.592711 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1538/3048] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:38 2022] DELETE /identity/v3/users/73288150b0984389b2830a9eec4bbb92 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:38.598628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.599100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.599667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:38.621116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:38.622507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.731171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:38.735169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:38.748974 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1539/3049] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:38.777323 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1511/3050] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:38.801351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:38.803286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:38.949453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b3786-9e5e-47dd-97ec-95487eca88ba None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:38.959267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:38.960870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:38.961813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:38.962682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:39.019162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:39.035209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:39.083630 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1540/3051] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:39.918161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:39.931184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b39bf-3e42-4179-b7cf-83af90be613c service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:39.937133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:39.938357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:39.939523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:39.939994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] PATH_INFO: `/v3/projects/e1b1683ebae94db889b969a8eb0d27e1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:39.941749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b1683ebae94db889b969a8eb0d27e1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:39.944237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:40.012059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b1683ebae94db889b969a8eb0d27e1', 'request_id': 'req-563b0196-74e0-41b3-80dc-7f85ea869f61'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.020246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b1683ebae94db889b969a8eb0d27e1', 'request_id': 'req-563b0196-74e0-41b3-80dc-7f85ea869f61'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.038075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b1683ebae94db889b969a8eb0d27e1', 'request_id': 'req-563b0196-74e0-41b3-80dc-7f85ea869f61'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.060149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] The token cache is being invalidate because project e1b1683ebae94db889b969a8eb0d27e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:40.060446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.062254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.063047 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1512/3052] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:39 2022] DELETE /identity/v3/projects/e1b1683ebae94db889b969a8eb0d27e1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:40.068238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:40.070370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:40.089985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fbca4-c636-4961-8c3e-179c60940411 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:40.160966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:40.164526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:40.165163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:40.165456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] PATH_INFO: `/v3/users/bb3e4578d75f4daf9f28a3046a6f5afd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:40.167063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3e4578d75f4daf9f28a3046a6f5afd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:40.169640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:40.174810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:40.177959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:40.240331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3e4578d75f4daf9f28a3046a6f5afd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.248493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3e4578d75f4daf9f28a3046a6f5afd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.249108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3e4578d75f4daf9f28a3046a6f5afd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.249789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3e4578d75f4daf9f28a3046a6f5afd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.255749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b0196-74e0-41b3-80dc-7f85ea869f61 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:40.258035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2d1db5ac-4cb3-4e6c-a498-698b7e54cd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3e4578d75f4daf9f28a3046a6f5afd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.259951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:40.260708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:40.261560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:40.261560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:40.263319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:40.289402 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1541/3053] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:40 2022] DELETE /identity/v3/users/bb3e4578d75f4daf9f28a3046a6f5afd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:40.290907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0ebc-4c7e-4292-9ec6-82e5dea34d16 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:40.291254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0ebc-4c7e-4292-9ec6-82e5dea34d16 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:40.291704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0ebc-4c7e-4292-9ec6-82e5dea34d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:40.316287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8cac0ebc-4c7e-4292-9ec6-82e5dea34d16 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:40.317924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8cac0ebc-4c7e-4292-9ec6-82e5dea34d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:40.369850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:40.372254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:40.390744 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1513/3054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:40.407827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1542/3055] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:40.693813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:40.695321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:40.713785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd08b1-f1b1-4e2c-8edf-e0221f5cdb60 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:40.808324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:40.809278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:40.809562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:40.809844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] PATH_INFO: `/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:40.811306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d40f9d56f64c10b8ec776de24aa5ce)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:40.813327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:40.877298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d40f9d56f64c10b8ec776de24aa5ce', 'request_id': 'req-a629823f-731b-4aea-9f25-a08ce34fe942'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.884845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d40f9d56f64c10b8ec776de24aa5ce', 'request_id': 'req-a629823f-731b-4aea-9f25-a08ce34fe942'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.890773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d40f9d56f64c10b8ec776de24aa5ce', 'request_id': 'req-a629823f-731b-4aea-9f25-a08ce34fe942'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.907688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] The token cache is being invalidate because project 24d40f9d56f64c10b8ec776de24aa5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:40.908494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.909826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a629823f-731b-4aea-9f25-a08ce34fe942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:40.911596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1514/3056] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:40 2022] DELETE /identity/v3/projects/24d40f9d56f64c10b8ec776de24aa5ce => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:40.916616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:40.916982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:40.917261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:40.949601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:40.950930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.062677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.063231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.063331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.066344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1543/3057] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:41.085197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:41.086643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.098060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1515/3058] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:41.102156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.113718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0f9d7-1d6d-481b-b412-3d9cdb6b2833 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.119284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.119970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.120261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.120648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.121597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:41.121920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.123605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.141186 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1544/3059] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:41.142469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.153062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009ea06-6795-48b0-95fc-342723ae4c91 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.160756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.161443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.161730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.162014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.162933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.165034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.195975 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1516/3060] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:41.199964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.210807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82882a0-c9dc-4bac-bb7e-d24bef064b16 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.292234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.293029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.294266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.294529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.295248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.298495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.340210 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1545/3061] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:41.344135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.357751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9f1a-c520-4774-974c-c032307f6a8e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.365691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.366599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.366991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.367171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.367928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.369605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.401617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1517/3062] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:41.402828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.416029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff1ab-152d-4274-91ce-cf1064778b3c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.422917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.423726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.424062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.424407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.428949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.428949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.443967 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1546/3063] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:41.447968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.465321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.467100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.474308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2ccf9-ab7d-407d-aeaf-8280a30378ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.483174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635f69-2999-43d7-a3df-cda28be9ef4e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.483332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.484237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.484655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.485037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] PATH_INFO: `/v3/projects/df525d29a1954e9c98ebad547e311d27/users/ceafe7a92def430eaae6030fc33ad797/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.489578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.490467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.490755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.491038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] PATH_INFO: `/v3/users/298356dcff5a405493da095dacfc7aa5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.492401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] RBAC: Authorizing `identity:delete_user(user_id=298356dcff5a405493da095dacfc7aa5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.494680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.502683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=df525d29a1954e9c98ebad547e311d27, user_id=ceafe7a92def430eaae6030fc33ad797, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.505636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce48f-5487-48af-a328-4671a7ee1eea admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.526574 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1518/3064] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:41 2022] PUT /identity/v3/projects/df525d29a1954e9c98ebad547e311d27/users/ceafe7a92def430eaae6030fc33ad797/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:41.539085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffa5b-dbbc-42c4-9e02-b75f59f71dbc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.539584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffa5b-dbbc-42c4-9e02-b75f59f71dbc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.539893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fffa5b-dbbc-42c4-9e02-b75f59f71dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.555886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298356dcff5a405493da095dacfc7aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:41.565290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298356dcff5a405493da095dacfc7aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:41.566336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298356dcff5a405493da095dacfc7aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:41.567146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298356dcff5a405493da095dacfc7aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:41.573188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1fffa5b-dbbc-42c4-9e02-b75f59f71dbc None None] MFA Rules not processed for user `ceafe7a92def430eaae6030fc33ad797`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:41.574968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1fffa5b-dbbc-42c4-9e02-b75f59f71dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.578279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1d80ebff-c298-4aac-9796-1ef71336396e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298356dcff5a405493da095dacfc7aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:41.598897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1547/3065] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:41 2022] DELETE /identity/v3/users/298356dcff5a405493da095dacfc7aa5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:41.600627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.601087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.601370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.619491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:41.620748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.662382 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1519/3066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:41.667108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.668242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.668543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.692611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1548/3067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:41.693493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.696819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.704205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:41.705450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.790300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1520/3068] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:41.799886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0391-d1a0-4053-b604-f66ef654435a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.800216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.801997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:41.804782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.805421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.806554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.806844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.807788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.809683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.844620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1549/3069] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:41.845971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.896776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d31ec-2676-4bf6-8ea7-5ff03b58cf5b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.921553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9156-d75f-462f-b96f-42ce75c94631 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.926453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.927135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.928619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.928922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.929995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.932241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.959849 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1550/3070] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:41 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:41.963043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:41.963889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:41.964124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:41.964624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:41.965055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:41.976416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:41.978233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:41.997111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee277a0-60d0-447c-b1ad-0c84a2029df1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:41.998648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1521/3071] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:42.005228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.005963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.006303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.006658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.007293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.009045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.024367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1551/3072] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:42.028034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.044610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b54b0-0184-4b19-ab5d-a9570d9fc7af service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.051211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.052408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.052719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.053132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] PATH_INFO: `/v3/projects/e386dec76b2741698ac7fd422b1c95e6/users/76ef484c9e674cfb96e71af121f3af54/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.069868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e386dec76b2741698ac7fd422b1c95e6, user_id=76ef484c9e674cfb96e71af121f3af54, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.072670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.102216 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1522/3073] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:42 2022] PUT /identity/v3/projects/e386dec76b2741698ac7fd422b1c95e6/users/76ef484c9e674cfb96e71af121f3af54/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:42.106202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.120644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7615-15d9-45b2-84fa-9d2ae8c0d251 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.200355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.207796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.208282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.208868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.210163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.212961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4747df-ed50-43c6-90e6-8f57e38140a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.228678 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1552/3074] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:56:42.230146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.265443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1241-9622-4937-b9cf-d2bc3038ab38 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.275265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.276543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.277037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.277561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] PATH_INFO: `/v3/projects/e386dec76b2741698ac7fd422b1c95e6/users/76ef484c9e674cfb96e71af121f3af54/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.281234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e386dec76b2741698ac7fd422b1c95e6, user_id=76ef484c9e674cfb96e71af121f3af54, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.286561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.302302 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1523/3075] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:42 2022] PUT /identity/v3/projects/e386dec76b2741698ac7fd422b1c95e6/users/76ef484c9e674cfb96e71af121f3af54/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:42.314280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.314600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.314853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.344492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] MFA Rules not processed for user `76ef484c9e674cfb96e71af121f3af54`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:42.345758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.436975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.439040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.484067 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1553/3076] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:42.488917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.501920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699524a-0016-4d85-ac8c-a137f00538dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.511597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.513995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.514291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.515515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.518262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.525794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.541481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7380-7bdb-4883-b11f-615790677723 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.556413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.557810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.558305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.558808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] PATH_INFO: `/v3/projects/4da0e8e619e0431fb29b64983f33da56` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.562027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da0e8e619e0431fb29b64983f33da56)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.566403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.580998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1554/3077] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/projects => generated 329 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:42.587295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.651382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da0e8e619e0431fb29b64983f33da56', 'request_id': 'req-a55cfe4a-4681-4742-85f1-957ff7d9472c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.657802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da0e8e619e0431fb29b64983f33da56', 'request_id': 'req-a55cfe4a-4681-4742-85f1-957ff7d9472c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.663287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da0e8e619e0431fb29b64983f33da56', 'request_id': 'req-a55cfe4a-4681-4742-85f1-957ff7d9472c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.667870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe42ee-734d-47ed-a72d-66ebd37ba4c9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.680196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] The token cache is being invalidate because project 4da0e8e619e0431fb29b64983f33da56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:42.680421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.681318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a55cfe4a-4681-4742-85f1-957ff7d9472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.686506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1524/3078] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:42 2022] DELETE /identity/v3/projects/4da0e8e619e0431fb29b64983f33da56 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:42.687895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.688256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.688640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.708806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:42.710103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.728807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.729551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.729842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.730125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.731450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.732879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.762409 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1555/3079] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/users => generated 416 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:42.764020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.766348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.780766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1525/3080] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:42.781876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.783140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.798944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479dead-f43d-499c-82fa-bc8896398c7c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.806359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.807696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.807989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.808278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.809053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.810212 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:42.810212 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:42.810212 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:42.811104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.837889 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1526/3081] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/roles => generated 242 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:42.839196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.850904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16a789-1898-4a20-8e0c-44b9c017bcc2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.857481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.859288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.860055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.860304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.861442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.866026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.869034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f0816-a6c1-4d75-9cf1-3f248e6593ff tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.879954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.881329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.881759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.882183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] PATH_INFO: `/v3/users/caeb954f43ec4a169b17d2e17f8dc06b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.883597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caeb954f43ec4a169b17d2e17f8dc06b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.885888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.893520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1527/3082] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:42 2022] POST /identity/v3/roles => generated 247 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:42.894907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.910412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a5361-0630-4069-b9e7-efd3717af70f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:42.916959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:42.919200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:42.920268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:42.920956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e/users/1fabff5ea1fc414d8e86bc0fb86946fc/roles/e62722fa95704c8ab1fd6632a46cba45` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:42.944667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a891fd5e1c5c4de8840ed6c3a750df4e, user_id=1fabff5ea1fc414d8e86bc0fb86946fc, role_id=e62722fa95704c8ab1fd6632a46cba45)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:42.947634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:42.957701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caeb954f43ec4a169b17d2e17f8dc06b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.967214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caeb954f43ec4a169b17d2e17f8dc06b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.968223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caeb954f43ec4a169b17d2e17f8dc06b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.969250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caeb954f43ec4a169b17d2e17f8dc06b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:42.969465 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1528/3083] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:42 2022] PUT /identity/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e/users/1fabff5ea1fc414d8e86bc0fb86946fc/roles/e62722fa95704c8ab1fd6632a46cba45 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:42.970720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:42.972536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:42.979454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caeb954f43ec4a169b17d2e17f8dc06b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:43.029315 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1556/3084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:42 2022] DELETE /identity/v3/users/caeb954f43ec4a169b17d2e17f8dc06b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:43.055140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2ab7-698a-407e-bfff-836791009f91 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.145660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.147331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.148071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.148365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e/users/1fabff5ea1fc414d8e86bc0fb86946fc/roles/4822ac34160442c0bc9ef5cd03167b09` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.151585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a891fd5e1c5c4de8840ed6c3a750df4e, user_id=1fabff5ea1fc414d8e86bc0fb86946fc, role_id=4822ac34160442c0bc9ef5cd03167b09)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.154734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a1421-fc80-4ba8-9c3f-30e0124dcce5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.182282 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1529/3085] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:42 2022] PUT /identity/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e/users/1fabff5ea1fc414d8e86bc0fb86946fc/roles/4822ac34160442c0bc9ef5cd03167b09 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:43.183297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.197369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1954fc-7aa9-4728-96d6-1b2cf36d0408 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.272249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.272993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.273413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.273700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.274477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.276354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db25627-2496-412b-af3c-3b41ae019ea0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.327060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1557/3086] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:43 2022] GET /identity/v3/users => generated 8625 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:56:43.329451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cdad7-e19b-46e3-9270-17943f26a359 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.329752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cdad7-e19b-46e3-9270-17943f26a359 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.330136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cdad7-e19b-46e3-9270-17943f26a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.394803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-943cdad7-e19b-46e3-9270-17943f26a359 None None] MFA Rules not processed for user `1fabff5ea1fc414d8e86bc0fb86946fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:43.396338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-943cdad7-e19b-46e3-9270-17943f26a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:43.511443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1530/3087] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:43.511616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.511975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.512263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.540594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] MFA Rules not processed for user `1fabff5ea1fc414d8e86bc0fb86946fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:43.541608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:43.572143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.572567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.572718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.576411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1558/3088] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:43.577475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.591235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d3e18-d4c1-437e-893f-e508779362ad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.604386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fabff5ea1fc414d8e86bc0fb86946fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-50991723', 'tempest-NotDelegatedRole-2001737769'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.605185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.605538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.605883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.606800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: Authorizing `identity:create_trust()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.608214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.609078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:43.610318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:43.749780 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1559/3089] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:43 2022] POST /identity/v3/OS-TRUST/trusts => generated 832 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:43.749780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.755286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:43.791987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1531/3090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:43.793005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.806227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752e61-f4cb-4069-9194-ac2e6601e91e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.811508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.812487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.812800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.813087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.814743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.815355 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:43.815355 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:43.815355 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:43.816850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.825160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1532/3091] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:56:43 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:43.830186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.842131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebb76c-5ed5-41ff-96b2-4f94561f1ab5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.856097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fabff5ea1fc414d8e86bc0fb86946fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-50991723', 'tempest-NotDelegatedRole-2001737769'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.857259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.857259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.858964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] PATH_INFO: `/v3/OS-TRUST/trusts/f62e6d41ef164aa3a0c3b1142109d31c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.880360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: Authorizing `identity:delete_trust(trust_id=f62e6d41ef164aa3a0c3b1142109d31c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.881870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.915397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5796c-6af7-4b82-bb47-ef8b46f9773f tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.920427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.921467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.921881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.922269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] PATH_INFO: `/v3/projects/832c3ededc024ad785dd0ff868fdb944` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:43.924161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f62e6d41ef164aa3a0c3b1142109d31c', 'request_id': 'req-e101af75-1770-4235-9cdf-aa6c9953be34'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:43.925601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f62e6d41ef164aa3a0c3b1142109d31c', 'request_id': 'req-e101af75-1770-4235-9cdf-aa6c9953be34'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:43.926365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f62e6d41ef164aa3a0c3b1142109d31c', 'request_id': 'req-e101af75-1770-4235-9cdf-aa6c9953be34'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:43.929703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832c3ededc024ad785dd0ff868fdb944)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:43.932936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:43.943873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1533/3092] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 20:56:43 2022] DELETE /identity/v3/OS-TRUST/trusts/f62e6d41ef164aa3a0c3b1142109d31c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:43.948437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:43.950304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:43.969647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101af75-1770-4235-9cdf-aa6c9953be34 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:43.977720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fabff5ea1fc414d8e86bc0fb86946fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-50991723', 'tempest-NotDelegatedRole-2001737769'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:43.979315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:43.979707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:43.980093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] PATH_INFO: `/v3/OS-TRUST/trusts/f62e6d41ef164aa3a0c3b1142109d31c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.000325 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Could not find trust: f62e6d41ef164aa3a0c3b1142109d31c.: keystone.exception.TrustNotFound: Could not find trust: f62e6d41ef164aa3a0c3b1142109d31c. Apr 02 20:56:44.005453 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1534/3093] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:43 2022] GET /identity/v3/OS-TRUST/trusts/f62e6d41ef164aa3a0c3b1142109d31c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:44.010432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.012120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832c3ededc024ad785dd0ff868fdb944', 'request_id': 'req-a611dbce-ae01-40af-8ab1-4975a62bc326'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.013439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.018549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832c3ededc024ad785dd0ff868fdb944', 'request_id': 'req-a611dbce-ae01-40af-8ab1-4975a62bc326'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.031194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832c3ededc024ad785dd0ff868fdb944', 'request_id': 'req-a611dbce-ae01-40af-8ab1-4975a62bc326'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.040069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e891ac-1246-4733-8100-e6c4ab15e120 tempest-TrustsV3TestJSON-1445085567 tempest-user-1006909238] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.053257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] The token cache is being invalidate because project 832c3ededc024ad785dd0ff868fdb944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:44.053548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.055100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a611dbce-ae01-40af-8ab1-4975a62bc326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.056825 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1560/3094] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:43 2022] DELETE /identity/v3/projects/832c3ededc024ad785dd0ff868fdb944 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:44.064058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd120-4c8b-4821-bbd5-0b6868eaffc8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.064354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd120-4c8b-4821-bbd5-0b6868eaffc8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.064643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd120-4c8b-4821-bbd5-0b6868eaffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.103969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1d8dd120-4c8b-4821-bbd5-0b6868eaffc8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:44.105223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d8dd120-4c8b-4821-bbd5-0b6868eaffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.161650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.162213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.162384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.162603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/4822ac34160442c0bc9ef5cd03167b09` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.173525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4822ac34160442c0bc9ef5cd03167b09)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.174811 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:44.174811 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 20:56:44.174811 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 20:56:44.176591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.204292 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1561/3095] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:44.205877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.206203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.206478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.226274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:44.227681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.236202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1562/3096] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:44.241894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.256514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 4822ac34160442c0bc9ef5cd03167b09 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:44.256514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.256514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.260404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1535/3097] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:44 2022] DELETE /identity/v3/roles/4822ac34160442c0bc9ef5cd03167b09 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:44.261437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.264173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11387b-70ce-45bd-b0a2-cbe79457b213 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.265253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.353768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.354446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.354729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.355574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.357329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:44.357797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.359417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.360829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e237-719d-42ae-98bd-6ef8821f9fd6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.366841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.368144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.368656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.369122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/e62722fa95704c8ab1fd6632a46cba45` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.371317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e62722fa95704c8ab1fd6632a46cba45)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.373351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.376997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1563/3098] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:44.378516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.380428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.415335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0fee7-c0ba-4d04-9161-1fca9af7f1d3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.422122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.422756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.423042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.423321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.424041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.426682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.436304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role e62722fa95704c8ab1fd6632a46cba45 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:44.436964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.437823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.440558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1536/3099] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:44 2022] DELETE /identity/v3/roles/e62722fa95704c8ab1fd6632a46cba45 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:44.444792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.447091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.469689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1564/3100] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:44.475090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.478630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.546542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd9abe-4e71-4721-af5b-1845db79146f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.558487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81683443-4704-4510-8200-a73f406258f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.565382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.566272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.566563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.566825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.567504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.569453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.596119 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1565/3101] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:44.601417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.617996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fdf15-30d3-4d5b-8e6f-a179f4d72fe5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.630562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.632044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.633235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.633811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.634808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.636816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.654463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1566/3102] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:56:44.659634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.672310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.673038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.673321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.674095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/1fabff5ea1fc414d8e86bc0fb86946fc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.675709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1fabff5ea1fc414d8e86bc0fb86946fc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.678158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.692415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709efa3-a7ec-4a88-9fee-715aafe18319 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.707645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.710670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.711042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.711467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.713634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.717522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.741920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fabff5ea1fc414d8e86bc0fb86946fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.746403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1567/3103] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:44.750009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.763523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fabff5ea1fc414d8e86bc0fb86946fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.765272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fabff5ea1fc414d8e86bc0fb86946fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.778730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba88c-7ac9-4c52-8c62-9b203f9c6f8d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.778902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fabff5ea1fc414d8e86bc0fb86946fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.783769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.784956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.785394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.785516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fabff5ea1fc414d8e86bc0fb86946fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:44.785952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] PATH_INFO: `/v3/projects/2f86306375a140b18339f5f2a962fa88/users/e827faea27374297be8b6cd2d2af3ffc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.796186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1537/3104] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:44 2022] DELETE /identity/v3/users/1fabff5ea1fc414d8e86bc0fb86946fc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:44.798871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.802796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.816001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f86306375a140b18339f5f2a962fa88, user_id=e827faea27374297be8b6cd2d2af3ffc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.820137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6ac63-530e-4d19-aed5-1394e22ed4ef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:44.840841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1568/3105] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:44 2022] PUT /identity/v3/projects/2f86306375a140b18339f5f2a962fa88/users/e827faea27374297be8b6cd2d2af3ffc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:44.852898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.853189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.853468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.886540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] MFA Rules not processed for user `e827faea27374297be8b6cd2d2af3ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:44.887951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:44.902693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f38fa-cf50-4042-b853-bf0d79e1f1e0 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:44.984446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:44.986299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:44.986682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:44.986959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:44.989013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a891fd5e1c5c4de8840ed6c3a750df4e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:44.992119 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1569/3106] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:44.993055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:44.994421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:45.004237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.093878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dea45-1ac9-46fb-8530-82a567b87205 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.106039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'request_id': 'req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:45.116123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'request_id': 'req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:45.124680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a891fd5e1c5c4de8840ed6c3a750df4e', 'request_id': 'req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:45.148297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project a891fd5e1c5c4de8840ed6c3a750df4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:45.148679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:45.150378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:45.156706 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1538/3107] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:44 2022] DELETE /identity/v3/projects/a891fd5e1c5c4de8840ed6c3a750df4e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:45.159427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.165504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:45.194751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.195980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.195980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.196187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.196871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.199230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.233423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1570/3108] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:44 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:45.238897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.240937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:45.293198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3afa-85bf-487e-9a7e-ce86c1eecaf2 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.358529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16850e-d998-4cba-b22c-b010b05238db admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.385824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.386872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.387493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.387836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.388563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.390499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.391506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.393950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.394430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.394857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.395950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.398857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.432008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1539/3109] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/projects => generated 329 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:45.437153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.449740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1571/3110] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:45.455043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.476915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f7443-386f-4e95-9f60-bbf92c660373 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.588753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.589695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.590340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.590459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.591688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.593612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.618973 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1572/3111] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:45.620950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781603eb-65d7-4bd3-8d5b-1d1d5f36364a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.625288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.630174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.631881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.634806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.635104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.636045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.638809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689341-f9ee-4378-8c1f-c2ece65054de admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.641875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.650610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.651873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.652365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.653230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] PATH_INFO: `/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1/users/e3fa237350d64cccb6f93686db844ee1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.675918 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1540/3112] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/users => generated 416 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:45.679946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2622121ede4659a4ff9b1424f8c9c1, user_id=e3fa237350d64cccb6f93686db844ee1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.683527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.685569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.704588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34875c84-2df1-4d2a-a89c-46ecd0ae7203 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.712702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1573/3113] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:45 2022] PUT /identity/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1/users/e3fa237350d64cccb6f93686db844ee1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:45.716955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.835138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.835764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.836651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.836956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.849736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:45.853919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040abac9-03f6-476a-952a-99ca521c96b7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:45.880108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1541/3114] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/roles => generated 243 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:45.881989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.882290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.882573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.910891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:45.913161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:45.978289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd2710-f5dc-4f5f-9d53-4ca2b946d316 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:45.987084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1542/3115] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:45.992773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:45.992971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:45.994265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:45.994895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:45.995431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:45.996753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.009280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc2ea-87d7-42dc-a06f-b0b950280fa2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.015329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.016018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.016308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.016745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.021227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.023334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.024579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.046728 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1543/3116] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:45 2022] POST /identity/v3/roles => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:46.048163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.083849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ed226-5171-44df-a2d6-7ada98251f8a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.084106 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1574/3117] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:45 2022] GET /identity/v3/roles => generated 1891 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:46.084877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.092248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.093528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.094743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.095343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/da237c6e444445019ebca5e36fe8d84f/users/38128d0204a541a997590cdb34f0790f/roles/0fcb79b6ad394ee6b967f1d250d9b70b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.116796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f96547-5ea3-48b9-aea4-2698578acdd1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.123038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.124422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.125020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.125806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] PATH_INFO: `/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1/users/e3fa237350d64cccb6f93686db844ee1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.130870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2622121ede4659a4ff9b1424f8c9c1, user_id=e3fa237350d64cccb6f93686db844ee1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.135856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad9c4d-c22a-448a-bbc5-fd7da164c362 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.155796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=da237c6e444445019ebca5e36fe8d84f, user_id=38128d0204a541a997590cdb34f0790f, role_id=0fcb79b6ad394ee6b967f1d250d9b70b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.158522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.170119 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1575/3118] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:46 2022] PUT /identity/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1/users/e3fa237350d64cccb6f93686db844ee1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:46.178090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b868-7f31-4f8c-be20-92fd01f5a2b8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.179464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b868-7f31-4f8c-be20-92fd01f5a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.180281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b868-7f31-4f8c-be20-92fd01f5a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.197539 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1544/3119] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:46 2022] PUT /identity/v3/projects/da237c6e444445019ebca5e36fe8d84f/users/38128d0204a541a997590cdb34f0790f/roles/0fcb79b6ad394ee6b967f1d250d9b70b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:46.198679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.278623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7535b868-7f31-4f8c-be20-92fd01f5a2b8 None None] MFA Rules not processed for user `e3fa237350d64cccb6f93686db844ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:46.279951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7535b868-7f31-4f8c-be20-92fd01f5a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:46.379983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ac8e2-ce32-4972-bd24-cca6b7a40186 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.411826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.412779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.413069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.413349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/da237c6e444445019ebca5e36fe8d84f/users/38128d0204a541a997590cdb34f0790f/roles/c91bd58cf78948d68a1b0ed7e605f82a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.417945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=da237c6e444445019ebca5e36fe8d84f, user_id=38128d0204a541a997590cdb34f0790f, role_id=c91bd58cf78948d68a1b0ed7e605f82a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.420697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.469108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1545/3120] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:46 2022] PUT /identity/v3/projects/da237c6e444445019ebca5e36fe8d84f/users/38128d0204a541a997590cdb34f0790f/roles/c91bd58cf78948d68a1b0ed7e605f82a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:46.473683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.502701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1576/3121] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:46.643021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4110-4901-4da2-9b12-4bad9c9ec621 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.661797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.663005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.663554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.663957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.667544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.673451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:46.728515 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1546/3122] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:46 2022] GET /identity/v3/users => generated 9195 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:46.733523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20c53-24cc-493f-9cc2-3f93ab4d9444 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.733830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20c53-24cc-493f-9cc2-3f93ab4d9444 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.734085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e20c53-24cc-493f-9cc2-3f93ab4d9444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.796402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-85e20c53-24cc-493f-9cc2-3f93ab4d9444 None None] MFA Rules not processed for user `38128d0204a541a997590cdb34f0790f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:46.797924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-85e20c53-24cc-493f-9cc2-3f93ab4d9444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:46.835069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.837484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:46.902798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1577/3123] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:46.914411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.915267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.915783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.948065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] MFA Rules not processed for user `38128d0204a541a997590cdb34f0790f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:46.950337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:46.964717 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1578/3124] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:46.971897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:46.974327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb84fe0-6b60-4e2c-81e6-3efe0c30ca45 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.985271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09af58-bb21-4e7d-85fb-69446b40e236 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:46.987782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.988406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.988737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.988976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.991587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38128d0204a541a997590cdb34f0790f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da237c6e444445019ebca5e36fe8d84f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-254948182', 'tempest-DelegatedRole-956429807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:46.993206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:46.993497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:46.994132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:46.994955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorizing `identity:create_trust()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:46.996318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.091551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.093311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.104761 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1547/3125] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:47.145201 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1579/3126] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:47.145912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.163566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c80690-3d46-4c34-bdb3-3d00c96c9f2e service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.169799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38128d0204a541a997590cdb34f0790f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da237c6e444445019ebca5e36fe8d84f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-254948182', 'tempest-DelegatedRole-956429807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.170981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.171480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.172335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.174067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.176595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.189217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.195721 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1548/3127] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Apr 2 20:56:47 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=38128d0204a541a997590cdb34f0790f => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:47.199575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187a60-f5e6-4ddc-924f-b95eca7134a9 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.203858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38128d0204a541a997590cdb34f0790f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da237c6e444445019ebca5e36fe8d84f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-254948182', 'tempest-DelegatedRole-956429807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.204876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.205161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.205441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] PATH_INFO: `/v3/OS-TRUST/trusts/5e276b35fc404406b90d6ff5000d8f60` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.215914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorizing `identity:delete_trust(trust_id=5e276b35fc404406b90d6ff5000d8f60)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.217879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.243853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5e276b35fc404406b90d6ff5000d8f60', 'request_id': 'req-371371e9-5bec-425b-8585-7571c7ad3b18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.244785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5e276b35fc404406b90d6ff5000d8f60', 'request_id': 'req-371371e9-5bec-425b-8585-7571c7ad3b18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.254038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5e276b35fc404406b90d6ff5000d8f60', 'request_id': 'req-371371e9-5bec-425b-8585-7571c7ad3b18'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.266358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.267977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1580/3128] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/OS-TRUST/trusts/5e276b35fc404406b90d6ff5000d8f60 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:47.269023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.283198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29db4-1a6f-4a2a-8805-1ec7c58f5f21 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.296265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38128d0204a541a997590cdb34f0790f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da237c6e444445019ebca5e36fe8d84f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-254948182', 'tempest-DelegatedRole-956429807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.298991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.298991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.299257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] PATH_INFO: `/v3/OS-TRUST/trusts/5e276b35fc404406b90d6ff5000d8f60` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.317995 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Could not find trust: 5e276b35fc404406b90d6ff5000d8f60.: keystone.exception.TrustNotFound: Could not find trust: 5e276b35fc404406b90d6ff5000d8f60. Apr 02 20:56:47.319427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1549/3129] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:47 2022] GET /identity/v3/OS-TRUST/trusts/5e276b35fc404406b90d6ff5000d8f60 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:47.324035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.325944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.345959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371371e9-5bec-425b-8585-7571c7ad3b18 tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.352152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.353525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.353818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.354209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/c91bd58cf78948d68a1b0ed7e605f82a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.356870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c91bd58cf78948d68a1b0ed7e605f82a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.358513 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:47.358513 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:47.358513 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:47.359553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.382356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.384539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.431131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role c91bd58cf78948d68a1b0ed7e605f82a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:47.431131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.433436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.440279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1581/3130] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/roles/c91bd58cf78948d68a1b0ed7e605f82a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:47.445073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.448019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.555990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f915-0a1b-4c78-a067-cc4fad95987e tempest-TrustsV3TestJSON-1029837693 tempest-user-1573713453] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.591792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c789e7-5579-45bc-8dac-bdbc73f0486a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.608017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.608949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.611691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.611994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/0fcb79b6ad394ee6b967f1d250d9b70b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.615346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0fcb79b6ad394ee6b967f1d250d9b70b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.617089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.654168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.655108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.655340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.655600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] PATH_INFO: `/v3/users/e827faea27374297be8b6cd2d2af3ffc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.659742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e827faea27374297be8b6cd2d2af3ffc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.665540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.686440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 0fcb79b6ad394ee6b967f1d250d9b70b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:47.686722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.688416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.691662 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1582/3131] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/roles/0fcb79b6ad394ee6b967f1d250d9b70b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:47.695993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.699580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.763233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e827faea27374297be8b6cd2d2af3ffc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.783040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03df49-f237-464a-93ee-7a3e90e8ff2b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:47.788753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:47.789515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e827faea27374297be8b6cd2d2af3ffc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.790015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.790309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.790585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/38128d0204a541a997590cdb34f0790f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.791386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e827faea27374297be8b6cd2d2af3ffc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.791842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=38128d0204a541a997590cdb34f0790f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:47.793805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:47.809069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e827faea27374297be8b6cd2d2af3ffc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.823363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ac98021-7320-483e-8cbb-88aad60c019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e827faea27374297be8b6cd2d2af3ffc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.842904 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1550/3132] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/users/e827faea27374297be8b6cd2d2af3ffc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:47.844430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:47.844670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:47.844946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:47.856251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38128d0204a541a997590cdb34f0790f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.868408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38128d0204a541a997590cdb34f0790f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.870206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38128d0204a541a997590cdb34f0790f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.870883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38128d0204a541a997590cdb34f0790f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.878869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:47.880122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:47.887840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38128d0204a541a997590cdb34f0790f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:47.924179 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1583/3133] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/users/38128d0204a541a997590cdb34f0790f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:47.927972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:47.929653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:48.086637 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1551/3134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:48.105687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.109108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:48.124939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c5b7-10a4-4f12-aa6e-ffde57b98a60 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.151958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.153326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.156347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.157885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/da237c6e444445019ebca5e36fe8d84f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.162983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da237c6e444445019ebca5e36fe8d84f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.169890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.282263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da237c6e444445019ebca5e36fe8d84f', 'request_id': 'req-bba70a92-a378-4c28-9f0b-1e0318471d82'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:48.303005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da237c6e444445019ebca5e36fe8d84f', 'request_id': 'req-bba70a92-a378-4c28-9f0b-1e0318471d82'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:48.312376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d992277-a74d-4496-ba56-d9ba1bb598b1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.327995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da237c6e444445019ebca5e36fe8d84f', 'request_id': 'req-bba70a92-a378-4c28-9f0b-1e0318471d82'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:48.366703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project da237c6e444445019ebca5e36fe8d84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:48.367046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:48.369080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:48.385921 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1584/3135] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:47 2022] DELETE /identity/v3/projects/da237c6e444445019ebca5e36fe8d84f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:48.391181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.392922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:48.462103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.462770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.463300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.463591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.470887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:48.534119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70a92-a378-4c28-9f0b-1e0318471d82 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.560743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.561432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.561715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.561994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.562687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.565957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.620318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.627110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1585/3136] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:48 2022] POST /identity/v3/projects => generated 329 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:48.627458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.628223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.647872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1552/3137] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:48.752637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba24ac-51ea-47dc-a094-1c710a72a418 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.757844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.758865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.758999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.759212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.759932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.761935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.788406 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1586/3138] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:48 2022] POST /identity/v3/users => generated 416 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:48.791961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.804587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae451c-ce73-4f8e-b6e9-57e3b6d56fa8 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.809663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.810337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.810620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.811049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.811679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.813305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.837359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1553/3139] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:48 2022] POST /identity/v3/roles => generated 244 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:48.841088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.853524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e960b87-abf7-4d5e-b535-3d17779f8a4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.860527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.861212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.861500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.862272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:48.863051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:48.864076 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:48.864076 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 20:56:48.864076 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 20:56:48.865064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:48.897381 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1587/3140] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:48 2022] POST /identity/v3/roles => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:48.900221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.929176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42ea2-ff2e-4c53-8568-9bd15fc8023f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:48.940245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:48.942513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:48.947144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:48.948070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:48.948331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:48.948636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1/users/3272c978f29d425599144142f0a6bc67/roles/b86e17d6ca3241d7ab0f30d84b8ec40d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.014551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ed370887bfe42c7bff9c2292b07f9b1, user_id=3272c978f29d425599144142f0a6bc67, role_id=b86e17d6ca3241d7ab0f30d84b8ec40d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.017613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.056319 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1554/3141] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:48 2022] PUT /identity/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1/users/3272c978f29d425599144142f0a6bc67/roles/b86e17d6ca3241d7ab0f30d84b8ec40d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:49.059304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:49.098777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb7f6-42ac-4a5d-9495-d2f7422a70bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:49.190336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:49.193964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.194701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.195169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] PATH_INFO: `/v3/users/b4e403362d974575bed8e6aca5fde653` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.197304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e403362d974575bed8e6aca5fde653)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.200693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.266731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede4d1c-f77d-44cd-8ddc-5ddde5199be4 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:49.280002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:49.281330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.281815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.281942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e403362d974575bed8e6aca5fde653'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.282369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1/users/3272c978f29d425599144142f0a6bc67/roles/016076a883b648c795eb1f34f0fa89e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.285600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ed370887bfe42c7bff9c2292b07f9b1, user_id=3272c978f29d425599144142f0a6bc67, role_id=016076a883b648c795eb1f34f0fa89e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.288588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.303947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e403362d974575bed8e6aca5fde653'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.305660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e403362d974575bed8e6aca5fde653'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.306438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e403362d974575bed8e6aca5fde653'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.322010 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1555/3142] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:49 2022] PUT /identity/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1/users/3272c978f29d425599144142f0a6bc67/roles/016076a883b648c795eb1f34f0fa89e4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:49.328741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:49.333737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e403362d974575bed8e6aca5fde653'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.334197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:49.399274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1588/3143] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:48 2022] DELETE /identity/v3/users/b4e403362d974575bed8e6aca5fde653 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:49.475115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3ece-9e75-461e-9d45-61c2bd96212c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:49.583794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:49.584858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.585218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.585699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.586401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.589347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154e07-3d50-402e-8322-78e9bf2e7a44 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.644181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:49.647831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:49.693085 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1556/3144] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:49 2022] GET /identity/v3/users => generated 8630 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:49.698426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.698796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.699398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.757620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] MFA Rules not processed for user `3272c978f29d425599144142f0a6bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:49.759676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:49.796884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3205-ebb4-4bfa-8893-3132a02ea4ab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:49.809373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:49.810840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.811334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.811798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] PATH_INFO: `/v3/users/ae2afa22826f4e999b65a9b0cfad1a59` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.814667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2afa22826f4e999b65a9b0cfad1a59)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.818883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.888889 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1557/3145] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:49.896513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:49.900752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:49.915888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2afa22826f4e999b65a9b0cfad1a59'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.929089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2afa22826f4e999b65a9b0cfad1a59'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.930551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2afa22826f4e999b65a9b0cfad1a59'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.931661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2afa22826f4e999b65a9b0cfad1a59'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.940740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2afa22826f4e999b65a9b0cfad1a59'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:49.941273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935b6a-5f82-468e-9961-c5ffe67500a3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:49.958213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:49.959465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:49.959914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:49.960189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] PATH_INFO: `/v3/projects/2f86306375a140b18339f5f2a962fa88` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:49.962737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f86306375a140b18339f5f2a962fa88)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:49.965915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:49.974760 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1589/3146] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:49 2022] DELETE /identity/v3/users/ae2afa22826f4e999b65a9b0cfad1a59 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:49.976346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:49.979361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.094403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f86306375a140b18339f5f2a962fa88', 'request_id': 'req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.102498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f86306375a140b18339f5f2a962fa88', 'request_id': 'req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.110904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f86306375a140b18339f5f2a962fa88', 'request_id': 'req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.121418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d08952-d181-4032-a7ee-5fb8666a713a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:50.134401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] The token cache is being invalidate because project 2f86306375a140b18339f5f2a962fa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:50.135783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.137207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0fa9958f-5a72-47a5-af7f-7ac7acf1cb8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.141439 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1558/3147] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:49 2022] DELETE /identity/v3/projects/2f86306375a140b18339f5f2a962fa88 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:50.145877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.147095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.147521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.168635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] MFA Rules not processed for user `3272c978f29d425599144142f0a6bc67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:50.169959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.248549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1559/3148] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:50.249966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:50.252842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.337671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:50.340005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.340357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.343290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] PATH_INFO: `/v3/projects/ca062168c5234ac98bdfe39669d817d7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.345335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca062168c5234ac98bdfe39669d817d7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:50.349559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:50.372944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebefee-42b5-4931-87fb-d7bf6bf10936 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:50.380547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:50.381602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.382173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.382290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] PATH_INFO: `/v3/users/e3fa237350d64cccb6f93686db844ee1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.383453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fa237350d64cccb6f93686db844ee1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:50.388104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:50.431757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca062168c5234ac98bdfe39669d817d7', 'request_id': 'req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.442046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca062168c5234ac98bdfe39669d817d7', 'request_id': 'req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.458893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca062168c5234ac98bdfe39669d817d7', 'request_id': 'req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.462139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fa237350d64cccb6f93686db844ee1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.476246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fa237350d64cccb6f93686db844ee1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.476951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] The token cache is being invalidate because project ca062168c5234ac98bdfe39669d817d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:50.477203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.477698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fa237350d64cccb6f93686db844ee1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.477841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.479895 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1590/3149] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:49 2022] DELETE /identity/v3/projects/ca062168c5234ac98bdfe39669d817d7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:50.486422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:50.487877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.494365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fa237350d64cccb6f93686db844ee1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.506975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fa237350d64cccb6f93686db844ee1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.513345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1560/3150] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:50 2022] DELETE /identity/v3/users/e3fa237350d64cccb6f93686db844ee1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:50.514237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:50.515624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.599148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638b73e-13f3-4fc2-ad72-bcc8344ee92f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:50.641242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7752-4b90-4d32-acdd-505e18159d54 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:50.647332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:50.648204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.648514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.648806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] PATH_INFO: `/v3/projects/8431d621f8be4ba0b1a6faa94c77d545` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.650271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8431d621f8be4ba0b1a6faa94c77d545)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:50.652548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:50.679070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:50.680097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.680563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.680851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.681727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:create_trust()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:50.683391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa7946-220d-49cf-b973-a70f5b3fa219 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:50.734483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8431d621f8be4ba0b1a6faa94c77d545', 'request_id': 'req-673b705c-dc5e-4b47-8674-2e750bac44da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.741101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8431d621f8be4ba0b1a6faa94c77d545', 'request_id': 'req-673b705c-dc5e-4b47-8674-2e750bac44da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.747415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8431d621f8be4ba0b1a6faa94c77d545', 'request_id': 'req-673b705c-dc5e-4b47-8674-2e750bac44da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.768079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] The token cache is being invalidate because project 8431d621f8be4ba0b1a6faa94c77d545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:50.768296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.769549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-673b705c-dc5e-4b47-8674-2e750bac44da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:50.773643 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1561/3151] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:50 2022] DELETE /identity/v3/projects/8431d621f8be4ba0b1a6faa94c77d545 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:50.776302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.776621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.776905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.807286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:50.809023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.852640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1591/3152] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:50.858241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca954a-4a9c-42b8-af15-65df13f23616 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.858536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca954a-4a9c-42b8-af15-65df13f23616 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.858814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca954a-4a9c-42b8-af15-65df13f23616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.887473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-39ca954a-4a9c-42b8-af15-65df13f23616 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:50.888706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39ca954a-4a9c-42b8-af15-65df13f23616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.896929 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1562/3153] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:50.899144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:50.900699 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1592/3154] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:50.900911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.904218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b4bb-36b4-44e4-930f-78045f094a16 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.904968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b4bb-36b4-44e4-930f-78045f094a16 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.905531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b4bb-36b4-44e4-930f-78045f094a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.932580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0b77b4bb-36b4-44e4-930f-78045f094a16 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:50.933836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b77b4bb-36b4-44e4-930f-78045f094a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.946200 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1593/3155] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:50.947577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:50.947884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:50.948170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:50.986480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:50.988353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:50.998098 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1594/3156] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:50.999037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.001591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d6330-ccd7-46d4-8066-f5ae483c3d58 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.007616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.008558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.008928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.009270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.012212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4578b6-b247-4088-ae55-0d8d13bb79bb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.016406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:get_trust(trust_id=163956426cc0406c93f6fd0dda55a354)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.017091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.017753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.018035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.018189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.019271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.020034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:51.020347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.021966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.027878 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1563/3157] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:50 2022] GET /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354 => generated 859 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.028602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.030491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.046500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1595/3158] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.048180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d32997-5e42-4084-9fa8-5ed00bf49183 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.049322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.060943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.064193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec591-faaa-4968-8a25-5399853424a5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.065177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.065563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.066376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] PATH_INFO: `/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.069279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2622121ede4659a4ff9b1424f8c9c1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.070130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.070802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.071088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.071370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.072094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:51.072211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.072411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.074374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.092010 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1596/3159] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.093468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.107145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e3df5-121b-4d62-9f6b-1d2d61fa7a28 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.111737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.113743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.114036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.114729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.133779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=163956426cc0406c93f6fd0dda55a354)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.135794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.146428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2622121ede4659a4ff9b1424f8c9c1', 'request_id': 'req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:51.152239 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1597/3160] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles => generated 371 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.154089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2622121ede4659a4ff9b1424f8c9c1', 'request_id': 'req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:51.156000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.160364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2622121ede4659a4ff9b1424f8c9c1', 'request_id': 'req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:51.177277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ac7b-a532-4ea3-a5e2-35fe28ecec78 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.179536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] The token cache is being invalidate because project 4e2622121ede4659a4ff9b1424f8c9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:51.179994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:51.180879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:51.185790 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1564/3161] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:51 2022] DELETE /identity/v3/projects/4e2622121ede4659a4ff9b1424f8c9c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:51.185790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.185790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.247713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.248394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.248718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.249001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.249689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.251765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.259372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fe4d-533c-4cf5-9d76-b7d577d65202 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.264716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.265432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.265765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.266045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.266727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.268742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d8a66-cd5d-4063-a2a3-d0b239735a8b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.280611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1598/3162] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:51.280611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.283145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.298831 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1565/3163] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:51.298831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.298831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.298831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.325864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:51.327266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.360864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be3ea1-d7fa-40fb-835d-fa0b1768b866 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.407285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1566/3164] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:51.408780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.410766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.417727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.418570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.418858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.419133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/b86e17d6ca3241d7ab0f30d84b8ec40d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.425702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:get_role_for_trust(trust_id=163956426cc0406c93f6fd0dda55a354, role_id=b86e17d6ca3241d7ab0f30d84b8ec40d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.426860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d26f-9b84-4806-9b3d-aa55dbf3902c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.427153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.432340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.433058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.433344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.433621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.434303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.438016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1599/3165] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/b86e17d6ca3241d7ab0f30d84b8ec40d => generated 244 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.438016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.441212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4aa288-4fdd-4d7d-9529-c4b0a0367939 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.449318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baeae1-ab75-4eab-b2cc-db9ebcd9451b tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.459111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.460678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.460983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.461527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.462459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.465105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.476632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1567/3166] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:51.478146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645aca-0b46-473d-a072-2875602fa365 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.478517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645aca-0b46-473d-a072-2875602fa365 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.478807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645aca-0b46-473d-a072-2875602fa365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.492302 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1600/3167] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/users => generated 282 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:51.493368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.503462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58645aca-0b46-473d-a072-2875602fa365 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:51.504897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58645aca-0b46-473d-a072-2875602fa365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:51.514686 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1568/3168] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:51.515475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645aca-0b46-473d-a072-2875602fa365 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.521826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb6b4-b5c5-4a92-8566-7ded5c82297e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.527173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.527923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645aca-0b46-473d-a072-2875602fa365 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.528485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.529054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.529524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/b86e17d6ca3241d7ab0f30d84b8ec40d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.536175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.537401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.537847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.538517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.539721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.540767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:get_role_for_trust(trust_id=163956426cc0406c93f6fd0dda55a354, role_id=b86e17d6ca3241d7ab0f30d84b8ec40d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.541836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.542736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.555372 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1569/3170] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/roles => generated 1892 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:51.555793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1601/3170] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:56:51 2022] HEAD /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/b86e17d6ca3241d7ab0f30d84b8ec40d => generated 0 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 02 20:56:51.557161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.559314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.570911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357cf1-66fd-4c91-a7b7-1013430693fb tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.571115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c267-9bfd-4d91-b911-01885e5f36cc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.576101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.576274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.576802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.576921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.577086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.577208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.577363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.578077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:51.578387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.579973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.580550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.581457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.588529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.593988 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1570/3171] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:51.594963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.610207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181199f-e0d7-4368-a33e-d35b593d38cd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.614211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.614977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.615268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.615839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1602/3172] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/roles => generated 1892 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:51.616172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/016076a883b648c795eb1f34f0fa89e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.616934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.627731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:get_role_for_trust(trust_id=163956426cc0406c93f6fd0dda55a354, role_id=016076a883b648c795eb1f34f0fa89e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.629294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.629930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654774b-e681-406d-8425-2ff1adf9076b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.634979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.636396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.636721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.636999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.637719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.639310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.649784 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Could not find role: 016076a883b648c795eb1f34f0fa89e4.: keystone.exception.RoleNotFound: Could not find role: 016076a883b648c795eb1f34f0fa89e4. Apr 02 20:56:51.652711 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1571/3173] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/016076a883b648c795eb1f34f0fa89e4 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:51.654181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.664115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1603/3174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/roles => generated 1892 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:51.665759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.676109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a64d-f287-4c14-ad13-b777ced7aa7d tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.681740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.682408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.682742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.682981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.683640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.685355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0e93-9183-4c5d-92bf-b11f08a33d6c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.685729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.691573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.693243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.693529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.693807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.695487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.697610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.714666 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1604/3175] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:51 2022] GET /identity/v3/roles => generated 1892 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:51.714666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.725040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75e109-7f63-4486-8883-61046e0e4a16 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.731281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1572/3176] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/projects => generated 409 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:51.732287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.736605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.738811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.739179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.739516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/016076a883b648c795eb1f34f0fa89e4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.745826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:get_role_for_trust(trust_id=163956426cc0406c93f6fd0dda55a354, role_id=016076a883b648c795eb1f34f0fa89e4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.747412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.762835 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Could not find role: 016076a883b648c795eb1f34f0fa89e4.: keystone.exception.RoleNotFound: Could not find role: 016076a883b648c795eb1f34f0fa89e4. Apr 02 20:56:51.764210 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1605/3177] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:56:51 2022] HEAD /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354/roles/016076a883b648c795eb1f34f0fa89e4 => generated 0 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Apr 02 20:56:51.767354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.777313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070330-5cb5-4d80-b2ca-b94a5fdb46ff tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.804272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70b7b-cc7b-4619-9c78-9ba03000727a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.808989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.809876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.810161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.810443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] PATH_INFO: `/v3/projects/39ae799bc6f1400186ad8199388612a1/users/369aaa621e1a4e8788a3e18afeea57a8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.825708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ae799bc6f1400186ad8199388612a1, user_id=369aaa621e1a4e8788a3e18afeea57a8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.828485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.842253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.851946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1573/3178] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:51 2022] PUT /identity/v3/projects/39ae799bc6f1400186ad8199388612a1/users/369aaa621e1a4e8788a3e18afeea57a8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:51.851946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.852139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.852139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.852139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] PATH_INFO: `/v3/projects/784e9ed7207a4d9e970e3d496574e6d1/users/2e7bca7cae174c2c9b83217ea73a973e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.868318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784e9ed7207a4d9e970e3d496574e6d1, user_id=2e7bca7cae174c2c9b83217ea73a973e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.871142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.885695 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1606/3179] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:51 2022] PUT /identity/v3/projects/784e9ed7207a4d9e970e3d496574e6d1/users/2e7bca7cae174c2c9b83217ea73a973e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:51.886543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:51.918855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff29dc5-5d6b-4b5f-89fb-8020af0a8a7a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.947567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895846a-808b-4f97-915e-ea21fb5650a5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:51.952622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.953762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.954103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.954516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.961074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorizing `identity:delete_trust(trust_id=163956426cc0406c93f6fd0dda55a354)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.962514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:51.992274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:51.993026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:51.993651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:51.994103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:51.994967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:51.997415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeacfab-abcb-47e4-ba27-a38e6a4b32a7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.019406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '163956426cc0406c93f6fd0dda55a354', 'request_id': 'req-e7ed521a-b10c-4048-a0dc-30656322f919'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.023965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '163956426cc0406c93f6fd0dda55a354', 'request_id': 'req-e7ed521a-b10c-4048-a0dc-30656322f919'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.029562 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1574/3180] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:51 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:52.031144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.031510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.031872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.041678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e7ed521a-b10c-4048-a0dc-30656322f919 tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '163956426cc0406c93f6fd0dda55a354', 'request_id': 'req-e7ed521a-b10c-4048-a0dc-30656322f919'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.049182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1607/3181] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 20:56:51 2022] DELETE /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:52.051139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.051602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.051972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.068855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] MFA Rules not processed for user `369aaa621e1a4e8788a3e18afeea57a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:52.070180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.074502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:52.076243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.087802 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1608/3182] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:52.088868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.090316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.104143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35abdb0-8c41-450e-8cbd-6961dee778cd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.109972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.110737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.111306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.111675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.113283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.114974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.130396 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1609/3183] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:52 2022] GET /identity/v3/roles => generated 1892 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:52.131308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.135062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.151938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586f5d6-93da-4838-978f-366a21e35f6b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.156753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3272c978f29d425599144142f0a6bc67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed370887bfe42c7bff9c2292b07f9b1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-704562799', 'tempest-DelegatedRole-1694314150'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.157600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.157883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.158162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] PATH_INFO: `/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.178902 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1575/3184] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:52.179137 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Could not find trust: 163956426cc0406c93f6fd0dda55a354.: keystone.exception.TrustNotFound: Could not find trust: 163956426cc0406c93f6fd0dda55a354. Apr 02 20:56:52.179255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.179352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1610/3185] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:52 2022] GET /identity/v3/OS-TRUST/trusts/163956426cc0406c93f6fd0dda55a354 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:52.179352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.184892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.191917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f605c23-91a6-42fd-a445-9bf0550e2ded tempest-TrustsV3TestJSON-2083783148 tempest-user-1309233957] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.196666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.197620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.197958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.198241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.198962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.200579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.213622 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1611/3186] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:52 2022] GET /identity/v3/roles => generated 1892 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:52.219348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.221236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.278041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bace9b7-0219-49c4-a951-458f55513b39 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.283815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.286190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.287246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.288039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.303556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.305724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c1ad0-7f4c-435d-8053-e37ed879b8be service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.316149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4249d9-e449-46b9-9ba9-081b88595310 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.319971 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1576/3187] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:52.321468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.322568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.322897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.323246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/016076a883b648c795eb1f34f0fa89e4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.324905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=016076a883b648c795eb1f34f0fa89e4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.327415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.330435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040342-e127-4056-9411-0c0746179130 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.330654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040342-e127-4056-9411-0c0746179130 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.330944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3040342-e127-4056-9411-0c0746179130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.374104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a3040342-e127-4056-9411-0c0746179130 None None] MFA Rules not processed for user `369aaa621e1a4e8788a3e18afeea57a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:52.375597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a3040342-e127-4056-9411-0c0746179130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.375787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 016076a883b648c795eb1f34f0fa89e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:52.376224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.376914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.381965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1612/3188] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:52 2022] DELETE /identity/v3/roles/016076a883b648c795eb1f34f0fa89e4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:52.383025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.385111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.398623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1577/3189] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:52.399924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3040342-e127-4056-9411-0c0746179130 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.401532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a3040342-e127-4056-9411-0c0746179130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.418805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3040342-e127-4056-9411-0c0746179130 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.503390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.504677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.506479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.507373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/b86e17d6ca3241d7ab0f30d84b8ec40d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.509543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b86e17d6ca3241d7ab0f30d84b8ec40d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.511884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.537196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4a78c-5cc4-46ad-83e2-466f8dab97ef tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.549296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.551531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.552789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.553562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] PATH_INFO: `/v3/projects/c43205117bd845bf8d26d0afc9df8da5/users/a33b5411bfa543aeaf36575cd7589e4c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.579859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role b86e17d6ca3241d7ab0f30d84b8ec40d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:52.582036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.583239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.587064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1578/3190] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:52 2022] DELETE /identity/v3/roles/b86e17d6ca3241d7ab0f30d84b8ec40d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:52.591330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.593610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.599626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43205117bd845bf8d26d0afc9df8da5, user_id=a33b5411bfa543aeaf36575cd7589e4c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.603956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.639042 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1613/3191] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:52 2022] PUT /identity/v3/projects/c43205117bd845bf8d26d0afc9df8da5/users/a33b5411bfa543aeaf36575cd7589e4c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:52.640080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:52.645510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.756835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12584e7f-10f8-4087-bfcd-2785dfc200bd tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.820109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bfe5d-bd9a-4faa-9099-00bc43381aab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:52.835122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.835882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.836186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.836610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.841661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:52.852733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:52.854884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.856441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.857066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/3272c978f29d425599144142f0a6bc67` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.858833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3272c978f29d425599144142f0a6bc67)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.861376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.953887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:52.958078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3272c978f29d425599144142f0a6bc67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.959565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7f52-12a2-47e8-85b6-3327ce056691 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:52.976010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3272c978f29d425599144142f0a6bc67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.976899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3272c978f29d425599144142f0a6bc67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:52.981989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1614/3192] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:52.983495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:52.983812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:52.984078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:52.992084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3272c978f29d425599144142f0a6bc67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.009008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3272c978f29d425599144142f0a6bc67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.023102 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1579/3193] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:52 2022] DELETE /identity/v3/users/3272c978f29d425599144142f0a6bc67 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:53.027039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.029748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.033884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] MFA Rules not processed for user `a33b5411bfa543aeaf36575cd7589e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:53.035184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.159301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ea97f-2d96-4f06-bd4e-fa174ab405a7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.164979 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1615/3194] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:53.169186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.171222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.172225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:53.175560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.176383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.177218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.180750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ed370887bfe42c7bff9c2292b07f9b1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:53.183830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:53.282150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed370887bfe42c7bff9c2292b07f9b1', 'request_id': 'req-65ae68c6-ce50-4144-a99a-c2f259271992'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.299396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed370887bfe42c7bff9c2292b07f9b1', 'request_id': 'req-65ae68c6-ce50-4144-a99a-c2f259271992'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.330825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0de62a-9320-43ae-953e-0793da4f4453 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.334789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed370887bfe42c7bff9c2292b07f9b1', 'request_id': 'req-65ae68c6-ce50-4144-a99a-c2f259271992'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.367126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project 0ed370887bfe42c7bff9c2292b07f9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:53.367425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.368953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:53.379818 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1580/3195] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:53 2022] DELETE /identity/v3/projects/0ed370887bfe42c7bff9c2292b07f9b1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:53.379818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.382812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.473427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:53.474239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.474629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.475012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.475810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:53.478703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:53.526464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae68c6-ce50-4144-a99a-c2f259271992 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.536732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:53.537708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.537970 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1616/3196] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:53 2022] POST /identity/v3/projects => generated 411 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:53.538455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.538930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.539149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.541627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.544390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.598463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:53.603693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:53.653979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf7b15-ec7c-4604-b86a-7565e7d19123 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.661662 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1581/3197] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:53.662057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:53.662793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.662921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.663083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.663402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.664501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:53.666296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.668426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897bc12-ac36-4ba6-82d7-0f1de6f32199 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:53.708718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f7a59-df65-4408-8696-aa760bae13ba service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.765696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1617/3198] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:53 2022] POST /identity/v3/projects => generated 329 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:53.765696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7125e-67a2-4df5-82b3-a16e3e02db61 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.765696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7125e-67a2-4df5-82b3-a16e3e02db61 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.765696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7125e-67a2-4df5-82b3-a16e3e02db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.804802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-faf7125e-67a2-4df5-82b3-a16e3e02db61 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:53.806320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-faf7125e-67a2-4df5-82b3-a16e3e02db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.809663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:53.810635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.811096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.811475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.812272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:53.814688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:53.843267 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1582/3199] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:53 2022] POST /identity/v3/users => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:53.844721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:53.848886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:53.942412 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1618/3200] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:53.943925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ca74e-c43c-4ced-a18f-928a35c44022 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:53.946034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ca74e-c43c-4ced-a18f-928a35c44022 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:53.947068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ca74e-c43c-4ced-a18f-928a35c44022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:53.955461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227a3c9-c0c4-4761-af94-8f9bb2b2e56e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:53.975738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-297ca74e-c43c-4ced-a18f-928a35c44022 None None] MFA Rules not processed for user `369aaa621e1a4e8788a3e18afeea57a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:53.977983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-297ca74e-c43c-4ced-a18f-928a35c44022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.090310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.090757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.091104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.091381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.106160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.107101 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1619/3201] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:54.115054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.115431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.115860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.136171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.138570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.153048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1583/3202] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:54.154270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.174752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] MFA Rules not processed for user `2e7bca7cae174c2c9b83217ea73a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:54.176029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.237177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db08971-fcb2-4b6d-bbe5-2849303168a4 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.244541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.245249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.246003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.246395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.247245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.254717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b72d4-7219-43c1-945b-225249c7aabf tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.283883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1620/3203] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:54.287967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.302507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1584/3204] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/users => generated 416 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:54.304881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.305305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.305714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.327205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] MFA Rules not processed for user `2e7bca7cae174c2c9b83217ea73a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:54.328592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.337741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1585/3205] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:54.338526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.351365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b801-6bcb-435f-b66e-294ba15b6f31 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.360928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.362051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.362440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.369584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.370437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.372100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.395383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1586/3206] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/roles => generated 244 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:54.396364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.407854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5253fc-33c7-430f-940e-8e6fe0999002 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.411338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b184e54-e12e-4c96-933c-51b056233141 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.412636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.413309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.413595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.413873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.414722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.416393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.419651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.421285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.421774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.422202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.422998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.425309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.439048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1587/3207] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/roles => generated 246 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:54.441243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.453860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58209212-e15f-4c3c-9d54-ce429cb6ec30 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.460636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.461677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.462191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.462572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5/users/32122eea609a4a7d9581b9962126c39c/roles/99fdf2387e6e417db2c912139942dead` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.478371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1621/3208] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:54 2022] GET /identity/v3/roles => generated 1892 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:54.478371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.486525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bed9bbfdabe54a61b376e9561ebf2fa5, user_id=32122eea609a4a7d9581b9962126c39c, role_id=99fdf2387e6e417db2c912139942dead)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.488905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.492139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01a677-3204-48f8-98f8-adbc1cfaa0dc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.499349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.500833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.500956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.501274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.514572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.516317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.519601 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1588/3209] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:54 2022] PUT /identity/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5/users/32122eea609a4a7d9581b9962126c39c/roles/99fdf2387e6e417db2c912139942dead => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:54.521898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.535626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1622/3210] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:54.538332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.557785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab8f39-1ae4-460f-904a-d4a24f3f640f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.638180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdd9da-30fd-4b73-b962-77ca29902df9 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.650683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.653412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.653702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.654071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] PATH_INFO: `/v3/projects/6b4754de00b04cb7aafe685170e5ded2/users/52eb088466384e2ebad85934eafabec0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.689291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4754de00b04cb7aafe685170e5ded2, user_id=52eb088466384e2ebad85934eafabec0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.689693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.691247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.691510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.691789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5/users/32122eea609a4a7d9581b9962126c39c/roles/78db1cbec8aa4d4f8e9262a82f4ec11a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.694336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bed9bbfdabe54a61b376e9561ebf2fa5, user_id=32122eea609a4a7d9581b9962126c39c, role_id=78db1cbec8aa4d4f8e9262a82f4ec11a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.697023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084b8c-93b6-4612-92d5-dfb90f171823 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.698528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.721340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1623/3211] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:54 2022] PUT /identity/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5/users/32122eea609a4a7d9581b9962126c39c/roles/78db1cbec8aa4d4f8e9262a82f4ec11a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:54.722778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.723114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.723399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.727009 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1589/3212] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:54 2022] PUT /identity/v3/projects/6b4754de00b04cb7aafe685170e5ded2/users/52eb088466384e2ebad85934eafabec0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:54.727943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.749207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:54.750514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.852771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1624/3213] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:54.853722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:54.862797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bc4e3-63e9-413e-af5a-dba5d784468d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.874781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:54.875692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.875692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.875926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.876784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:54.879645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99d762-8fd7-41fa-b865-61a05902688c tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:54.934936 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1590/3214] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:54 2022] GET /identity/v3/users => generated 9205 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:54.940090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978171-8db3-493f-81d5-bf6fc58e4bd9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:54.941188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978171-8db3-493f-81d5-bf6fc58e4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:54.941557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978171-8db3-493f-81d5-bf6fc58e4bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:54.986739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c9978171-8db3-493f-81d5-bf6fc58e4bd9 None None] MFA Rules not processed for user `32122eea609a4a7d9581b9962126c39c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:54.988568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9978171-8db3-493f-81d5-bf6fc58e4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:54.994273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde570a-331f-4e3e-80aa-b529ad9feded None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:54.999864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.001114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.001476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.001819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.002618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.005037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.016764 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1625/3215] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:54 2022] GET /identity/v3/roles => generated 1892 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:55.020917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.033042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3c52f-5b31-4946-8d5d-9c5860efb3e2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.040788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.041722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.042087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.042554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] PATH_INFO: `/v3/projects/6b4754de00b04cb7aafe685170e5ded2/users/52eb088466384e2ebad85934eafabec0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.045060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4754de00b04cb7aafe685170e5ded2, user_id=52eb088466384e2ebad85934eafabec0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.049395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9e7c1-6c28-4288-82ee-436d312249f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.069818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1626/3216] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:55 2022] PUT /identity/v3/projects/6b4754de00b04cb7aafe685170e5ded2/users/52eb088466384e2ebad85934eafabec0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:55.085001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.085439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.085802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.118731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1591/3217] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:55.120301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.120616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.123599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.141454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] MFA Rules not processed for user `52eb088466384e2ebad85934eafabec0`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:55.142980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.159059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] MFA Rules not processed for user `32122eea609a4a7d9581b9962126c39c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:55.174241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.295422 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1592/3218] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:55.301391 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1627/3219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:55.301579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.312479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b467-f761-4b41-b768-2843f3eb9cc4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.317534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32122eea609a4a7d9581b9962126c39c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bed9bbfdabe54a61b376e9561ebf2fa5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1389239632', 'tempest-NotDelegatedRole-588511145'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.318511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.318862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.319593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.319982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] RBAC: Authorizing `identity:create_trust()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.321261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.413423 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Apr 02 20:56:55.415093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1593/3220] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:55 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 116 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 20:56:55.419172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.518212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbf66-c21c-447c-86fe-7352cda01700 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.525097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.526099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.526387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.526677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/78db1cbec8aa4d4f8e9262a82f4ec11a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.528826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78db1cbec8aa4d4f8e9262a82f4ec11a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.530548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.537462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.539379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.582959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 78db1cbec8aa4d4f8e9262a82f4ec11a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:55.582959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.583637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.585996 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1628/3221] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:55 2022] DELETE /identity/v3/roles/78db1cbec8aa4d4f8e9262a82f4ec11a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:55.589840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.592685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.655372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4b4d-53c4-4ece-b2e5-0fe1de28db21 tempest-TrustsV3TestJSON-1237792973 tempest-user-1686627254] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.677303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d1eb-febc-4acc-a257-b9354f015a0b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.683535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.684659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.685455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.686049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/99fdf2387e6e417db2c912139942dead` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.688198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=99fdf2387e6e417db2c912139942dead)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.690122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.738708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 99fdf2387e6e417db2c912139942dead has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:55.739408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.740293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.742935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1629/3222] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:55 2022] DELETE /identity/v3/roles/99fdf2387e6e417db2c912139942dead => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:55.747099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.749855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.757255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.758016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.758314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.758595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.760792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.861986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.862787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649895d5-59b8-4e2d-914a-720673beac39 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.868004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.878832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:55.879845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:55.880160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:55.880684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/32122eea609a4a7d9581b9962126c39c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:55.883028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=32122eea609a4a7d9581b9962126c39c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:55.886791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:55.894525 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1594/3223] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:55.907597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:55.909095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:55.927385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a48243-6cdc-48f7-b50f-40e53cd63ec9 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:55.979392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32122eea609a4a7d9581b9962126c39c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.993426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32122eea609a4a7d9581b9962126c39c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.994682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32122eea609a4a7d9581b9962126c39c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:55.996801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32122eea609a4a7d9581b9962126c39c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.013411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32122eea609a4a7d9581b9962126c39c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.021394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.022121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.022451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.022859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.024922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.054934 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1630/3224] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:55 2022] DELETE /identity/v3/users/32122eea609a4a7d9581b9962126c39c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:56.057860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.059772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.109866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.121574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.132398 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1595/3225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:56.147617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad482a7-fd94-440a-ad81-a325c7b34559 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.152866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.153775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.154090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.154566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.155989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bed9bbfdabe54a61b376e9561ebf2fa5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.158235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.253927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed9bbfdabe54a61b376e9561ebf2fa5', 'request_id': 'req-bfbd5afa-148f-4176-8dee-e246557562aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.268412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.273392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed9bbfdabe54a61b376e9561ebf2fa5', 'request_id': 'req-bfbd5afa-148f-4176-8dee-e246557562aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.274512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.296204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed9bbfdabe54a61b376e9561ebf2fa5', 'request_id': 'req-bfbd5afa-148f-4176-8dee-e246557562aa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.313718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project bed9bbfdabe54a61b376e9561ebf2fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:56.314031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.314713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.328448 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1631/3226] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:56 2022] DELETE /identity/v3/projects/bed9bbfdabe54a61b376e9561ebf2fa5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:56.328448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.328448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.354587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62f7c1-db51-4865-b7d6-252af3e3fdaf service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.403751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5afa-148f-4176-8dee-e246557562aa tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.418376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.419209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.419541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.419826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.420795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.420985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.422060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.422339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.422625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] PATH_INFO: `/v3/users/a33b5411bfa543aeaf36575cd7589e4c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.424070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33b5411bfa543aeaf36575cd7589e4c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.424653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.426498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.462022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1632/3227] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:56 2022] POST /identity/v3/projects => generated 329 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:56.466540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.484790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33b5411bfa543aeaf36575cd7589e4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.499771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33b5411bfa543aeaf36575cd7589e4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.500517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33b5411bfa543aeaf36575cd7589e4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.508916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33b5411bfa543aeaf36575cd7589e4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.518022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94ef8-108d-43f4-8e8c-f6d88bc94768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33b5411bfa543aeaf36575cd7589e4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:56.526069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1596/3228] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:56 2022] DELETE /identity/v3/users/a33b5411bfa543aeaf36575cd7589e4c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:56.530288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.531683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.531683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.552298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:56.553824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.588424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d2d0-7dcf-4037-b996-452ee3777e2e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.630016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1597/3229] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:56.646398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.648050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.657292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.658396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.658780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.659207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.660016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.663586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.693900 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1633/3230] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:56 2022] POST /identity/v3/users => generated 413 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:56.695162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.697019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.730773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26009bc-4566-4038-b7b1-b5f52204d955 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.735812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.736548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.736838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.737272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.748076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.749806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.761467 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1598/3231] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:56:56.762374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.763910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.782180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefe794-c9cc-4fb5-bfd3-9fad2bb94704 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.786897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.787697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.788237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.788655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1dcc3-203f-40bf-a67a-ef71a2faed2f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.788882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.791148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:56.796527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.797850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.798154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.798445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.799199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.801621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.821892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1599/3232] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:56 2022] POST /identity/v3/roles => generated 243 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:56.828033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.828257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.829784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.844339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451832-c52a-4d25-b5d4-037a8b5478c6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.851589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.851990 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1634/3233] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:56.852526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.852889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.853286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.854641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.856835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.874801 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1600/3234] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:56 2022] POST /identity/v3/roles => generated 247 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:56.879326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.895890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01500b2e-6d60-4528-afd1-d48d05407a6c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:56.902054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:56.903121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:56.903429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:56.903712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7/users/993684f494ba45c5843a2add7c207415/roles/0119d397b2ec43fea98a4665c52014dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:56.937974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f5b5e270fc7c4640b51cb3b4fc2704a7, user_id=993684f494ba45c5843a2add7c207415, role_id=0119d397b2ec43fea98a4665c52014dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:56.941359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:56.961812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1635/3235] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:56 2022] PUT /identity/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7/users/993684f494ba45c5843a2add7c207415/roles/0119d397b2ec43fea98a4665c52014dc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:56.965700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:56.976172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364ce88-3eda-4d17-8a70-090316241664 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.047961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.049032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.049508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.050405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7/users/993684f494ba45c5843a2add7c207415/roles/78ea2fac77364dfc820464a8823ac1ad` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.052815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f5b5e270fc7c4640b51cb3b4fc2704a7, user_id=993684f494ba45c5843a2add7c207415, role_id=78ea2fac77364dfc820464a8823ac1ad)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.055477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.072561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1601/3236] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:56 2022] PUT /identity/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7/users/993684f494ba45c5843a2add7c207415/roles/78ea2fac77364dfc820464a8823ac1ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:57.076659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.089919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb7086-ffd7-484f-b2bb-1b077eb2b081 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.142550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.144336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.148741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.149673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.149967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.150583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.151417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.153265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c2673-44e4-4c5d-bfd7-f00b6b8b541a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.187690 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1636/3237] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/users => generated 8906 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:57.193490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e6a3-92e1-4c9d-b8ca-c2562c103bac None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.193858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e6a3-92e1-4c9d-b8ca-c2562c103bac None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.194212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e6a3-92e1-4c9d-b8ca-c2562c103bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.220073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39e7c3-faae-423c-9025-13609aa58a77 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.226420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.227436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.227732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.228029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] PATH_INFO: `/v3/projects/c43205117bd845bf8d26d0afc9df8da5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.229251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43205117bd845bf8d26d0afc9df8da5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.231284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.232682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0f99e6a3-92e1-4c9d-b8ca-c2562c103bac None None] MFA Rules not processed for user `993684f494ba45c5843a2add7c207415`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:57.233908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f99e6a3-92e1-4c9d-b8ca-c2562c103bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.297715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43205117bd845bf8d26d0afc9df8da5', 'request_id': 'req-0d39520d-0544-4768-b308-68afd7ef62db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.305513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43205117bd845bf8d26d0afc9df8da5', 'request_id': 'req-0d39520d-0544-4768-b308-68afd7ef62db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.311321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43205117bd845bf8d26d0afc9df8da5', 'request_id': 'req-0d39520d-0544-4768-b308-68afd7ef62db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.313108 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1637/3238] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:57.325819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.326094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.326458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.333876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] The token cache is being invalidate because project c43205117bd845bf8d26d0afc9df8da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:57.334174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.334936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.336954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1602/3239] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:57 2022] DELETE /identity/v3/projects/c43205117bd845bf8d26d0afc9df8da5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:57.340431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.342441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.356961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] MFA Rules not processed for user `993684f494ba45c5843a2add7c207415`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:57.358276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.454556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39520d-0544-4768-b308-68afd7ef62db admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.459186 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1638/3240] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:57.465383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.465901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.466693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.467158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.467596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] PATH_INFO: `/v3/users/52eb088466384e2ebad85934eafabec0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.469343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52eb088466384e2ebad85934eafabec0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.471545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.476864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ada5d1-66b9-4c6d-ae5f-819806e7370d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.481441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.482082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.482365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.482637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.483357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:create_trust()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.484527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.522899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52eb088466384e2ebad85934eafabec0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.536228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52eb088466384e2ebad85934eafabec0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.537077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52eb088466384e2ebad85934eafabec0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.545203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52eb088466384e2ebad85934eafabec0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.554150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52eb088466384e2ebad85934eafabec0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.561168 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1603/3241] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:57 2022] DELETE /identity/v3/users/52eb088466384e2ebad85934eafabec0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:57.561375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1639/3242] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:57.567871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.569356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.654962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68527cb-6702-4280-8911-fd32ae6930d7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.661167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.662014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.662452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.662724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.669943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:get_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.671431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.680551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1604/3243] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce => generated 833 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:57.684720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.693987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267058-f324-484f-ac8c-0713bcd9ece5 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.698378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.699151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.699434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.699711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.705565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.707237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.716871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1640/3244] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles => generated 370 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:56:57.719693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.729776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0b69-c37a-4a5d-a535-83a1634212a0 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.734050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.734901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.735604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.735604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/0119d397b2ec43fea98a4665c52014dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.741858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce, role_id=0119d397b2ec43fea98a4665c52014dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.743668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.750143 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1605/3245] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/0119d397b2ec43fea98a4665c52014dc => generated 243 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:57.754250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.764638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27b378-5052-4437-a230-7901d526aff1 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.769884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.770763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.771052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.771331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/0119d397b2ec43fea98a4665c52014dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.777734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce, role_id=0119d397b2ec43fea98a4665c52014dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.779228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.787651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1641/3246] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:56:57 2022] HEAD /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/0119d397b2ec43fea98a4665c52014dc => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 02 20:56:57.791886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.801844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f360-2235-4bfa-9182-4f701f7b3b72 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.807395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.808433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.808915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.809263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/78ea2fac77364dfc820464a8823ac1ad` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.815518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce, role_id=78ea2fac77364dfc820464a8823ac1ad)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.817801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.836051 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Could not find role: 78ea2fac77364dfc820464a8823ac1ad.: keystone.exception.RoleNotFound: Could not find role: 78ea2fac77364dfc820464a8823ac1ad. Apr 02 20:56:57.837652 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1606/3247] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/78ea2fac77364dfc820464a8823ac1ad => generated 110 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:57.841739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.849536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.851605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.855849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480cae-1b1c-48d1-a766-3772e01f5e1f tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.861906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.864314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.864952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.865351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/78ea2fac77364dfc820464a8823ac1ad` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.872123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce, role_id=78ea2fac77364dfc820464a8823ac1ad)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.873811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.890249 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Could not find role: 78ea2fac77364dfc820464a8823ac1ad.: keystone.exception.RoleNotFound: Could not find role: 78ea2fac77364dfc820464a8823ac1ad. Apr 02 20:56:57.891788 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1642/3248] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:56:57 2022] HEAD /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce/roles/78ea2fac77364dfc820464a8823ac1ad => generated 0 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:57.896070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.906289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbcbf7-6b48-4122-a5e0-5271d194aee6 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.912404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.913345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.913830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.914186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.921210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorizing `identity:delete_trust(trust_id=4739e3c3c4064adf9441fb30fc9449ce)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.922796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.942540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bab07-03dd-4b6f-acb2-454131e15c0e tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.947666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.948586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.949019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.949142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] PATH_INFO: `/v3/projects/6b4754de00b04cb7aafe685170e5ded2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:57.949364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4739e3c3c4064adf9441fb30fc9449ce', 'request_id': 'req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.950357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4754de00b04cb7aafe685170e5ded2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:57.952700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4739e3c3c4064adf9441fb30fc9449ce', 'request_id': 'req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.955689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:57.963735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4739e3c3c4064adf9441fb30fc9449ce', 'request_id': 'req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:57.971232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1643/3249] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 20:56:57 2022] DELETE /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:57.976562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:57.977975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:57.990291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f4910-77df-453c-a0b3-6e2c9668ca5d tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:57.994917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993684f494ba45c5843a2add7c207415', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2003463025', 'tempest-DelegatedRole-920924227'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:57.995985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:57.996275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:57.996600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] PATH_INFO: `/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.009293 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Could not find trust: 4739e3c3c4064adf9441fb30fc9449ce.: keystone.exception.TrustNotFound: Could not find trust: 4739e3c3c4064adf9441fb30fc9449ce. Apr 02 20:56:58.013473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1644/3250] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:57 2022] GET /identity/v3/OS-TRUST/trusts/4739e3c3c4064adf9441fb30fc9449ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:56:58.013623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4754de00b04cb7aafe685170e5ded2', 'request_id': 'req-c7797b90-ef11-42ef-8272-e83138950db4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.015438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.017173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.019262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4754de00b04cb7aafe685170e5ded2', 'request_id': 'req-c7797b90-ef11-42ef-8272-e83138950db4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.026258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4754de00b04cb7aafe685170e5ded2', 'request_id': 'req-c7797b90-ef11-42ef-8272-e83138950db4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.050911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] The token cache is being invalidate because project 6b4754de00b04cb7aafe685170e5ded2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:58.051290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.052159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7797b90-ef11-42ef-8272-e83138950db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.054123 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1607/3251] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:57 2022] DELETE /identity/v3/projects/6b4754de00b04cb7aafe685170e5ded2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:58.058914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a4b9-a8d5-4a00-9ffa-609fc8a38b72 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.059180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a4b9-a8d5-4a00-9ffa-609fc8a38b72 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.059476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a4b9-a8d5-4a00-9ffa-609fc8a38b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.078399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-62b0a4b9-a8d5-4a00-9ffa-609fc8a38b72 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:58.079918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-62b0a4b9-a8d5-4a00-9ffa-609fc8a38b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.092299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dae0b7-bc45-4dcf-bf39-0dc5041b9196 tempest-TrustsV3TestJSON-1104469336 tempest-user-513530255] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.148160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1608/3252] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:58.156059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.157220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.157621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.159686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.160590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.160877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.161146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/78ea2fac77364dfc820464a8823ac1ad` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.162655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=78ea2fac77364dfc820464a8823ac1ad)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.164254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.181504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:58.183052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.193041 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1609/3253] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:58.197477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.208367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ad75-b515-4ba8-86c3-e64055eeebc4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.212439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 78ea2fac77364dfc820464a8823ac1ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:58.212841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.213632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.215964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.216118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1645/3254] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:58 2022] DELETE /identity/v3/roles/78ea2fac77364dfc820464a8823ac1ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:58.219074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.219074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.219074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.219074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:56:58.219074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.220513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.220736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.222150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.237687 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1610/3255] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:56:58.238799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.240829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.266581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5ac8-d1e4-48ee-9327-9d70e1d63705 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.305790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce31b4-5848-41dd-8921-cc0edc4a2b7b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.321349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.323410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.324415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.326897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/0119d397b2ec43fea98a4665c52014dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.329825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0119d397b2ec43fea98a4665c52014dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.334441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.353206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.353960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.354251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.354635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.355358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.357573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.384608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 0119d397b2ec43fea98a4665c52014dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:58.384898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.385612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.385815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1611/3256] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:58 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:58.388019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1646/3257] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:58 2022] DELETE /identity/v3/roles/0119d397b2ec43fea98a4665c52014dc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:58.393127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.393251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.394795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.394925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.467613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454209-e8bd-4659-a964-e90e7a218e09 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.478776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361adc3-6212-4f9c-88fb-973ce5d623c5 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.488881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.489690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.490491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.490872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.493921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.496037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.546444 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1647/3258] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:58 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:58.547600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.551017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.552163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.552558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.552939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/993684f494ba45c5843a2add7c207415` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.554475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=993684f494ba45c5843a2add7c207415)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.557141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.558995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8cc6f-c033-429b-b2b2-016798a97fde admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.564839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.565775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.566073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.566472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.567214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.569350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.584489 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1648/3259] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:58.588597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.610464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636036-232b-4d11-a18a-e14267bc6fec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.614848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.616321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.616667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.617010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.617907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.619779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.633896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1649/3260] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:56:58.638330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.647516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993684f494ba45c5843a2add7c207415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.651368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7a5a-1b88-4e3d-a781-556a5bf6347a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.659489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.660778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.661167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.661506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] PATH_INFO: `/v3/projects/a1a3f8d3d3e94b31ab9aa73d8905b12a/users/4eaee1ddad0041828fb2e65677e2da25/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.669809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993684f494ba45c5843a2add7c207415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.670645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993684f494ba45c5843a2add7c207415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.681655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993684f494ba45c5843a2add7c207415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.693815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993684f494ba45c5843a2add7c207415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.702997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a3f8d3d3e94b31ab9aa73d8905b12a, user_id=4eaee1ddad0041828fb2e65677e2da25, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.704650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1612/3261] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:58 2022] DELETE /identity/v3/users/993684f494ba45c5843a2add7c207415 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:58.708762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.708900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de607b-cf7d-40b8-a28c-a2c9caa930fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.710239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.739937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1650/3262] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:58 2022] PUT /identity/v3/projects/a1a3f8d3d3e94b31ab9aa73d8905b12a/users/4eaee1ddad0041828fb2e65677e2da25/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:58.741481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.741775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.742055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.778098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:58.779348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.838096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54603e9e-e6d3-42b8-b734-a0b9fc667b16 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.873001 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1651/3263] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:58.883421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:58.884869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:58.902065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.903080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.903459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.904448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.906066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5b5e270fc7c4640b51cb3b4fc2704a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.908246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.944000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e369692-7e6d-4c10-9d06-408793c551e6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:58.948169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:58.948860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:58.949144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:58.949421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:58.958421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:58.960019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:58.967259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'request_id': 'req-dac6895b-2bf1-4a76-82c6-4618edab8f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.970576 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1652/3264] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:58.973973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'request_id': 'req-dac6895b-2bf1-4a76-82c6-4618edab8f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.979496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b5e270fc7c4640b51cb3b4fc2704a7', 'request_id': 'req-dac6895b-2bf1-4a76-82c6-4618edab8f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.994858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project f5b5e270fc7c4640b51cb3b4fc2704a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:56:58.994858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:58.995810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:56:59.002623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1613/3265] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:56:58 2022] DELETE /identity/v3/projects/f5b5e270fc7c4640b51cb3b4fc2704a7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:59.005972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.022007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6880-f171-4a8b-bb8e-c39bda0063ec service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.089583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.090445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.090857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.091242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.092078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.094186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.130187 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1653/3266] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/projects => generated 329 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:59.134237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.136154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:59.150406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6895b-2bf1-4a76-82c6-4618edab8f4e tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.210784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.211550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.212055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.212416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.213275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.215301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.236752 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1614/3267] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/users => generated 410 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:59.241189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.253977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c55e-fe6b-4053-a784-9c7e0abf8aa8 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.258866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.259491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.259919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.260206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.261033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.262647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.277121 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1654/3268] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/roles => generated 244 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:59.281101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.293430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c44f2b-7c08-42de-9c35-d9191e2ceaf6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.301926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.302676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.302993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.303282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.304167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.305865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.322670 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1615/3269] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/roles => generated 246 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:56:59.323840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.339591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b511245-8139-4991-9f5d-c82d0a1a072f tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.357419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.358533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.358891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.359182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/7599aee2eadd477b8318e02573870bca/users/54f3ecec3ff3487cacda54ca322ef45f/roles/79d9e7b226284c1c94820f35b245fd98` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.376497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7599aee2eadd477b8318e02573870bca, user_id=54f3ecec3ff3487cacda54ca322ef45f, role_id=79d9e7b226284c1c94820f35b245fd98)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.379606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.395930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1655/3270] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:59 2022] PUT /identity/v3/projects/7599aee2eadd477b8318e02573870bca/users/54f3ecec3ff3487cacda54ca322ef45f/roles/79d9e7b226284c1c94820f35b245fd98 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:56:59.400427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.414218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bacd-bac9-41ce-9c0a-47502080edc7 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.482045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.482946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.483553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.483553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/7599aee2eadd477b8318e02573870bca/users/54f3ecec3ff3487cacda54ca322ef45f/roles/0758533851f542199e18b64e7a78501d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.486256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7599aee2eadd477b8318e02573870bca, user_id=54f3ecec3ff3487cacda54ca322ef45f, role_id=0758533851f542199e18b64e7a78501d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.488964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822fb8a-5583-4f5e-a388-e30e3bd14eac tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.502356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1616/3271] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:56:59 2022] PUT /identity/v3/projects/7599aee2eadd477b8318e02573870bca/users/54f3ecec3ff3487cacda54ca322ef45f/roles/0758533851f542199e18b64e7a78501d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:56:59.506330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.517202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f0bb-e80b-4ade-aa5e-9ccdaa4baa99 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.576465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.577235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.577582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.577846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.578597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.580523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b27740-7661-4321-81db-a57c04f1fa70 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.615801 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1656/3272] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:56:59 2022] GET /identity/v3/users => generated 8890 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:56:59.617860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c6ac-85ab-4e81-83fb-426da0548526 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.618197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c6ac-85ab-4e81-83fb-426da0548526 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.618509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c6ac-85ab-4e81-83fb-426da0548526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.660646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-aa27c6ac-85ab-4e81-83fb-426da0548526 None None] MFA Rules not processed for user `54f3ecec3ff3487cacda54ca322ef45f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:59.662092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa27c6ac-85ab-4e81-83fb-426da0548526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:59.732122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.732641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.732745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.755415 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1617/3273] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:56:59.766199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.766904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.769424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.786014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] MFA Rules not processed for user `4eaee1ddad0041828fb2e65677e2da25`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:59.787310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:59.796477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] MFA Rules not processed for user `54f3ecec3ff3487cacda54ca322ef45f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:56:59.797019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:59.806473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1618/3274] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:59.810564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.822550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0700f-80e6-4fbf-81b0-0eb8dc30eb87 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.829610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.830391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.830876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.832279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.833060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:create_trust()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.835813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:56:59.906116 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1657/3275] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:56:59.910809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.912588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:56:59.943664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1619/3276] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:56:59.948115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:56:59.966166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e2d5-3d45-47c7-94ec-45b6abd5655a tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:56:59.972989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:56:59.974109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:56:59.974396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:56:59.974673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:56:59.982246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:get_trust(trust_id=15254d895eac4a6da549806a566a994e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:56:59.983915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.017676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1620/3277] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:59 2022] GET /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e => generated 835 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:00.018406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.029302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0a54-e649-4f85-b0e8-ae26f5d91e1c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.035625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.036428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.036944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.037281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.037979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.039972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.050269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd7c2c-280e-47f8-be70-a5ae2df349a9 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.065171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.068888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.069198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.069537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.078792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=15254d895eac4a6da549806a566a994e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.086189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.086869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1658/3278] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:56:59 2022] POST /identity/v3/projects => generated 395 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:00.088268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.115651 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1621/3279] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles => generated 371 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:00.116846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.141860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42dfdc-2e67-4e5d-9457-cc60e2675f95 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.220732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43825b4c-f9e4-4b2b-bc80-b823c0005cdf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.226039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.226795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.227090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.227375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.228123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.230297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.238226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.239196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.239479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.239758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/79d9e7b226284c1c94820f35b245fd98` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.249704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:get_role_for_trust(trust_id=15254d895eac4a6da549806a566a994e, role_id=79d9e7b226284c1c94820f35b245fd98)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.252368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.267641 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1622/3280] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/79d9e7b226284c1c94820f35b245fd98 => generated 244 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:00.271714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.274919 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1659/3281] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:00 2022] POST /identity/v3/users => generated 304 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:00.278003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.285562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432afa6c-acef-4a94-bb67-f122052b3bc0 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.290026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.290950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c232-26c5-485d-8f85-40947bd6cd58 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.291067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.291169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.291417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/79d9e7b226284c1c94820f35b245fd98` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.297435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.297952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.298246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.298730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.298952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:get_role_for_trust(trust_id=15254d895eac4a6da549806a566a994e, role_id=79d9e7b226284c1c94820f35b245fd98)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.299584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.301537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.303298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.313584 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1623/3282] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:57:00 2022] HEAD /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/79d9e7b226284c1c94820f35b245fd98 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 02 20:57:00.318692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.322647 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1660/3283] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/roles => generated 1892 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:00.327020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.331445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c7f3-5e5a-433f-bab7-3135bc1b5408 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.339729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68b899-73cc-421f-9888-688e0f92fd0c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.340913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.342041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.343480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.343990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/0758533851f542199e18b64e7a78501d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.344733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.345722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.346104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.346569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] PATH_INFO: `/v3/projects/09f4379a528841c1958b6ab4261cdc7c/users/88915c35925848a7b83e873c6ae399c5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.352058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:get_role_for_trust(trust_id=15254d895eac4a6da549806a566a994e, role_id=0758533851f542199e18b64e7a78501d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.354221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.366254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f4379a528841c1958b6ab4261cdc7c, user_id=88915c35925848a7b83e873c6ae399c5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.370659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.376681 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Could not find role: 0758533851f542199e18b64e7a78501d.: keystone.exception.RoleNotFound: Could not find role: 0758533851f542199e18b64e7a78501d. Apr 02 20:57:00.382655 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1624/3284] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/0758533851f542199e18b64e7a78501d => generated 110 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 20:57:00.384059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.393765 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1661/3285] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:00 2022] PUT /identity/v3/projects/09f4379a528841c1958b6ab4261cdc7c/users/88915c35925848a7b83e873c6ae399c5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:00.397561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d90ccd-7e4f-4a79-89d3-41eeb33aad3c tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.409410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.483829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.484777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.485132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.485525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/0758533851f542199e18b64e7a78501d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.493456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:get_role_for_trust(trust_id=15254d895eac4a6da549806a566a994e, role_id=0758533851f542199e18b64e7a78501d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.495053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.503992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60727-5df4-4e67-825a-34bd178368c3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.509252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.509876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.510161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.510440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.511162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.513400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.518988 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Could not find role: 0758533851f542199e18b64e7a78501d.: keystone.exception.RoleNotFound: Could not find role: 0758533851f542199e18b64e7a78501d. Apr 02 20:57:00.525887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1625/3286] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Apr 2 20:57:00 2022] HEAD /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e/roles/0758533851f542199e18b64e7a78501d => generated 0 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Apr 02 20:57:00.528395 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1662/3287] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/roles => generated 1892 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:00.532320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.533185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.547004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9f8d-a42c-4a46-86b4-68493ee5f296 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.550927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5031d-6637-49dd-9e63-9bbb99f76968 tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.553997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.555418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.555783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.556090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.556234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.557036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.557828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.558123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] PATH_INFO: `/v3/projects/09f4379a528841c1958b6ab4261cdc7c/users/88915c35925848a7b83e873c6ae399c5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.560201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f4379a528841c1958b6ab4261cdc7c, user_id=88915c35925848a7b83e873c6ae399c5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.563794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.564121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorizing `identity:delete_trust(trust_id=15254d895eac4a6da549806a566a994e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.566220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.577417 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1626/3288] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:00 2022] PUT /identity/v3/projects/09f4379a528841c1958b6ab4261cdc7c/users/88915c35925848a7b83e873c6ae399c5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:00.595024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '15254d895eac4a6da549806a566a994e', 'request_id': 'req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:00.595833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '15254d895eac4a6da549806a566a994e', 'request_id': 'req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:00.605500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '15254d895eac4a6da549806a566a994e', 'request_id': 'req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:00.613676 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1663/3289] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 20:57:00 2022] DELETE /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:00.617885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.619674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:00.688013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49df6-9aeb-47ed-97d5-e0234d2a078e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.693029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54f3ecec3ff3487cacda54ca322ef45f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7599aee2eadd477b8318e02573870bca', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1198828436', 'tempest-NotDelegatedRole-782492191'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.693974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.694360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.694788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] PATH_INFO: `/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.707875 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Could not find trust: 15254d895eac4a6da549806a566a994e.: keystone.exception.TrustNotFound: Could not find trust: 15254d895eac4a6da549806a566a994e. Apr 02 20:57:00.709405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1627/3290] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:57:00 2022] GET /identity/v3/OS-TRUST/trusts/15254d895eac4a6da549806a566a994e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:57:00.713623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.715121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:00.782968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e1416-1df8-4143-ace9-1cce5a1fa28d tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:00.849034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:00.849910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:00.850191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:00.850488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/0758533851f542199e18b64e7a78501d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:00.851984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0758533851f542199e18b64e7a78501d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:00.853593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:00.893932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 0758533851f542199e18b64e7a78501d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:00.894415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:00.895300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:00.897296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1664/3291] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:00 2022] DELETE /identity/v3/roles/0758533851f542199e18b64e7a78501d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:00.901369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:00.903122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:00.930435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c518-befc-487e-adab-63812ff9f51e tempest-TrustsV3TestJSON-1040271735 tempest-user-75679023] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:01.011058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:01.012665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.013130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.013580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/roles/79d9e7b226284c1c94820f35b245fd98` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.015296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_role(role_id=79d9e7b226284c1c94820f35b245fd98)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:01.017088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:01.066614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invalidating the token cache because role 79d9e7b226284c1c94820f35b245fd98 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:01.066910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.067860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.069480 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1628/3292] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:00 2022] DELETE /identity/v3/roles/79d9e7b226284c1c94820f35b245fd98 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:01.073953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:01.088552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ad-50a6-41b4-8d6c-89adb9284bb6 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:01.153325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:01.154598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.154988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.155335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/users/54f3ecec3ff3487cacda54ca322ef45f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.156791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=54f3ecec3ff3487cacda54ca322ef45f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:01.158741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:01.218630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f3ecec3ff3487cacda54ca322ef45f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.234978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f3ecec3ff3487cacda54ca322ef45f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.235791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f3ecec3ff3487cacda54ca322ef45f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.237013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f3ecec3ff3487cacda54ca322ef45f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.250862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b9e6b6ef-8e09-44ef-9189-ce03572d5b4b tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f3ecec3ff3487cacda54ca322ef45f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.272584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1665/3293] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:01 2022] DELETE /identity/v3/users/54f3ecec3ff3487cacda54ca322ef45f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:01.274812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:01.276240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.290757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f64ec8-db80-4633-a7f7-27cb8487aa15 tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:01.378856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76ef484c9e674cfb96e71af121f3af54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e386dec76b2741698ac7fd422b1c95e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:01.380123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.380524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.380801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] PATH_INFO: `/v3/projects/7599aee2eadd477b8318e02573870bca` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.382702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7599aee2eadd477b8318e02573870bca)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:01.385336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:01.439614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f41175-8ec0-4423-9ade-acef387433b3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.441141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f41175-8ec0-4423-9ade-acef387433b3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.441141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f41175-8ec0-4423-9ade-acef387433b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.469720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7599aee2eadd477b8318e02573870bca', 'request_id': 'req-a84272af-c594-4df0-894c-d5c5b3f66c2a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.479590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7599aee2eadd477b8318e02573870bca', 'request_id': 'req-a84272af-c594-4df0-894c-d5c5b3f66c2a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.488619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7599aee2eadd477b8318e02573870bca', 'request_id': 'req-a84272af-c594-4df0-894c-d5c5b3f66c2a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.505329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36f41175-8ec0-4423-9ade-acef387433b3 None None] MFA Rules not processed for user `88915c35925848a7b83e873c6ae399c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:01.506755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36f41175-8ec0-4423-9ade-acef387433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.507067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] The token cache is being invalidate because project 7599aee2eadd477b8318e02573870bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:01.507558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.508951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.511323 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1629/3294] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:01 2022] DELETE /identity/v3/projects/7599aee2eadd477b8318e02573870bca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:01.521269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:01.522887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.608627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84272af-c594-4df0-894c-d5c5b3f66c2a tempest-TrustsV3TestJSON-563093094 tempest-TrustsV3TestJSON-563093094-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:01.614362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:01.615635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.616115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.616618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] PATH_INFO: `/v3/users/ceafe7a92def430eaae6030fc33ad797` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.618254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceafe7a92def430eaae6030fc33ad797)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:01.620853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:01.697937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceafe7a92def430eaae6030fc33ad797'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.700654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1666/3295] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:01.720101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.721098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.721499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceafe7a92def430eaae6030fc33ad797'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.722547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceafe7a92def430eaae6030fc33ad797'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.723072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.734933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceafe7a92def430eaae6030fc33ad797'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.744915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0a4f0fcf-4cb6-49b6-a86f-7e45b322d9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceafe7a92def430eaae6030fc33ad797'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:01.754243 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1630/3296] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:01 2022] DELETE /identity/v3/users/ceafe7a92def430eaae6030fc33ad797 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:01.759655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.760534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.761810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.771373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] MFA Rules not processed for user `4eaee1ddad0041828fb2e65677e2da25`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:01.775004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.801433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:01.802691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.845726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1667/3297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:01.886473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1631/3298] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:01.907031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:01.908575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.915939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:01.917594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:01.968312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2dd5-40a0-4d23-8ed0-3755ed32ea88 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:01.972632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:01.974441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:01.974441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:01.974441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:01.984397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:01.986123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:01.996412 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1668/3299] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:02.005027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e0be4-22c4-4d21-b7b1-3bb30fef79c5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:02.013896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:02.014666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:02.015044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:02.015424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:02.017332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:02.032268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:02.034816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:02.048774 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1632/3300] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:02.415580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:02.417185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:02.432143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57c36b-5d4a-42a0-9fe2-1e2e5576dd29 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:02.437271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:02.438349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:02.438801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:02.439241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] PATH_INFO: `/v3/projects/df525d29a1954e9c98ebad547e311d27` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:02.441887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df525d29a1954e9c98ebad547e311d27)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:02.456964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:02.507855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df525d29a1954e9c98ebad547e311d27', 'request_id': 'req-6a6c37b2-f0e0-4881-988d-f314e1713e1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.516303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df525d29a1954e9c98ebad547e311d27', 'request_id': 'req-6a6c37b2-f0e0-4881-988d-f314e1713e1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.524650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df525d29a1954e9c98ebad547e311d27', 'request_id': 'req-6a6c37b2-f0e0-4881-988d-f314e1713e1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.536946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] The token cache is being invalidate because project df525d29a1954e9c98ebad547e311d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:02.537181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.537987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.539911 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1669/3301] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:02 2022] DELETE /identity/v3/projects/df525d29a1954e9c98ebad547e311d27 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:02.544047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:02.561618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b80f-060e-4751-a01c-b1c11f580c77 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:02.638157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:02.638879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:02.639546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:02.639830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] PATH_INFO: `/v3/users/76ef484c9e674cfb96e71af121f3af54` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:02.641099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ef484c9e674cfb96e71af121f3af54)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:02.643020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:02.726031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ef484c9e674cfb96e71af121f3af54'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.743017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ef484c9e674cfb96e71af121f3af54'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.743801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ef484c9e674cfb96e71af121f3af54'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.765136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ef484c9e674cfb96e71af121f3af54'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.774519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7256be87-b3a9-4716-adcc-226708066e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ef484c9e674cfb96e71af121f3af54'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:02.785414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1633/3302] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:02 2022] DELETE /identity/v3/users/76ef484c9e674cfb96e71af121f3af54 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:03.229459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.230978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:03.245114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c37b2-f0e0-4881-988d-f314e1713e1c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.315719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.316676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.316961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.317280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] PATH_INFO: `/v3/projects/e386dec76b2741698ac7fd422b1c95e6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.318471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e386dec76b2741698ac7fd422b1c95e6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.320658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.369915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e386dec76b2741698ac7fd422b1c95e6', 'request_id': 'req-b163af07-f176-42ba-b4f8-678926e07cc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:03.375968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e386dec76b2741698ac7fd422b1c95e6', 'request_id': 'req-b163af07-f176-42ba-b4f8-678926e07cc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:03.383462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e386dec76b2741698ac7fd422b1c95e6', 'request_id': 'req-b163af07-f176-42ba-b4f8-678926e07cc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:03.394628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] The token cache is being invalidate because project e386dec76b2741698ac7fd422b1c95e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:03.394921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:03.395555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b163af07-f176-42ba-b4f8-678926e07cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:03.397120 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1670/3303] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:03 2022] DELETE /identity/v3/projects/e386dec76b2741698ac7fd422b1c95e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:03.401842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.402341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.402577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.425783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:03.427006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:03.492880 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1634/3304] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:03.500382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.500718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.501200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.521909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:03.523640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:03.531898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1671/3305] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:03.536323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.547167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901804-1f7a-4fd7-9e62-7920cdff3e1a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.552078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.552778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.553066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.553342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.554362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:03.554696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.556825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.571071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1635/3306] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:03.575579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.586370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4190457-f4ef-4a1b-b071-cc7ef516520c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.591781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.592525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.592985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.593266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.593985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.595889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.624342 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1672/3307] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:03 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:03.629091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.639524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be812e-d881-42f6-86ec-e4d3e64f15ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.701636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.702307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.702591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.702867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.703543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.705479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.726564 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1636/3308] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:03 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:03.730839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.741356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f04a7d-d054-462c-a69e-bc18e2334a51 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.745974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.746642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.746924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.747201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.747919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.749623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.761341 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1673/3309] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:03.765232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.781525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d6d1-d40a-47b9-8ac8-f1bae2dc538c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.787853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.790268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.790268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.790268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.790268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.793049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e487f4-5eef-4e61-be36-21eed89b1de1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.811892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1637/3310] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:03.813034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:03.825744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1055c-1df9-419c-996f-ca25ddcc91bb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:03.834641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:03.835550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.835837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.836116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] PATH_INFO: `/v3/projects/b4b83bb1d5d54810acbc3b1848fe0e2c/users/764de33a5dbd48a49815dfc106d1a122/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.851562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b83bb1d5d54810acbc3b1848fe0e2c, user_id=764de33a5dbd48a49815dfc106d1a122, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:03.854254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:03.871196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1674/3311] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:03 2022] PUT /identity/v3/projects/b4b83bb1d5d54810acbc3b1848fe0e2c/users/764de33a5dbd48a49815dfc106d1a122/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:03.881274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:03.881788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:03.882142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:03.910755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] MFA Rules not processed for user `764de33a5dbd48a49815dfc106d1a122`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:03.911966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:04.000395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1638/3312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:04.002162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:04.014758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0958-5389-460c-a608-8b12bbc945da admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:04.031754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '764de33a5dbd48a49815dfc106d1a122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b83bb1d5d54810acbc3b1848fe0e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:04.032862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.033154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.033440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] PATH_INFO: `/v3/auth/catalog` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.034448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:04.035542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a360c-e8a3-401a-b4bc-3d175c0efa22 tempest-IdentityCatalogTest-1212573907 tempest-IdentityCatalogTest-1212573907-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:04.037918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1675/3313] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:57:04 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:04.042437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:04.123249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50768-0863-41b5-89c1-d40ae0a25d13 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:04.130118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:04.131000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.131290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.131566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] PATH_INFO: `/v3/users/764de33a5dbd48a49815dfc106d1a122` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.133755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764de33a5dbd48a49815dfc106d1a122)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:04.135719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:04.187588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764de33a5dbd48a49815dfc106d1a122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.200389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764de33a5dbd48a49815dfc106d1a122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.201221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764de33a5dbd48a49815dfc106d1a122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.211030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764de33a5dbd48a49815dfc106d1a122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.219639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764de33a5dbd48a49815dfc106d1a122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.226823 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1639/3314] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:04 2022] DELETE /identity/v3/users/764de33a5dbd48a49815dfc106d1a122 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:04.231470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.232011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.232011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.250124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:04.252421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:04.324566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1676/3315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:04.333985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:04.335594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:04.401927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504c7a9-0e5a-4bf2-bcc6-8c4d3db830b0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:04.405709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:04.406565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.406846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.407124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.416729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:04.418138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c01de-e87e-4bcf-bc94-3fd374801ea0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:04.428445 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1640/3316] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:04.742331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:04.743860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:04.764013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c66329-af72-4f4e-8d56-db3799a17dc1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:04.771189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:04.772131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.772426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.772747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] PATH_INFO: `/v3/projects/b4b83bb1d5d54810acbc3b1848fe0e2c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.774046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b83bb1d5d54810acbc3b1848fe0e2c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:04.775968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:04.840481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b83bb1d5d54810acbc3b1848fe0e2c', 'request_id': 'req-ce6d81de-4613-40d0-aafb-c232d440e874'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.849102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b83bb1d5d54810acbc3b1848fe0e2c', 'request_id': 'req-ce6d81de-4613-40d0-aafb-c232d440e874'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.860546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b83bb1d5d54810acbc3b1848fe0e2c', 'request_id': 'req-ce6d81de-4613-40d0-aafb-c232d440e874'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.873931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] The token cache is being invalidate because project b4b83bb1d5d54810acbc3b1848fe0e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:04.874221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.877139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce6d81de-4613-40d0-aafb-c232d440e874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:04.882452 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1677/3317] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:04 2022] DELETE /identity/v3/projects/b4b83bb1d5d54810acbc3b1848fe0e2c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:04.884938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.884938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.885456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:04.905082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:04.906522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:04.984012 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1641/3318] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:04.992447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:04.992878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:04.993236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.017107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:05.020725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:05.038915 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1678/3319] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:05.040980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.052698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23059-c145-4cea-a673-f56a8ff56aea None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.058055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.058813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.059331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.059804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.061354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:05.061862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.063722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.078292 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1642/3320] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:05.083662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.098089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe20d0e-29e9-45b0-86c7-39ce66367b17 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.104908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.105830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.106173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.106552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.107594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.110261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.153187 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1679/3321] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:05.157301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.170760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3369bad-1066-4b29-b808-559169379848 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.299076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.302359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.303147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.304664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.305820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.314188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.356242 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1643/3322] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:05.361261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.385841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051effa0-ed6a-41f8-aed7-c1eae9aeaf4c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.393904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.394594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.394878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.395153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.395936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.399943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.412721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1680/3323] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:05.417451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.432176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a9da-2fcd-4bd4-a538-828ca5fdadc9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.467137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.468153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.468623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.469060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.470053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.475527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad40e-370b-4130-9033-781beadd5910 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.495951 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1644/3324] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:05.498581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.513770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bab7-ad65-4708-b165-2638a7b4faca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.520479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.521462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.521755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.522038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] PATH_INFO: `/v3/projects/005199d6e7da48b78da9c064d16a849c/users/c8d749976e694051a643b35ff5509dc5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.540175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=005199d6e7da48b78da9c064d16a849c, user_id=c8d749976e694051a643b35ff5509dc5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.543399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c37ba-5f0c-4ec3-81e9-3979a083b26c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.547053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.547349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.547630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.560529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1681/3325] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:05 2022] PUT /identity/v3/projects/005199d6e7da48b78da9c064d16a849c/users/c8d749976e694051a643b35ff5509dc5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:05.568000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] MFA Rules not processed for user `ee8c4a666eb94960b71b0353d32b5f67`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:05.569256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:05.572812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.573113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.573537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.600145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] MFA Rules not processed for user `c8d749976e694051a643b35ff5509dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:05.601326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:05.626827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1645/3326] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:05.676092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1682/3327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:05.680938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.692499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9184ca-72b7-49ce-a25f-e1ee52bd17a5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.698907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.700194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.700704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.701159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.701984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.703881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.743675 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1646/3328] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:05.746995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.757437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498945b-f2ea-4cc6-9b5b-2acb8aa8e6b2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.764521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.765703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.766154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.766774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/ea46cb99fea24c249c8d44bf293e8e5a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.769881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=ea46cb99fea24c249c8d44bf293e8e5a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.771383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.795892 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1683/3329] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Apr 2 20:57:05 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/ea46cb99fea24c249c8d44bf293e8e5a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:05.801982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.814971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b6c6-f32f-4c12-b08f-be3164208a3c tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.820890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.821924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.822335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.822680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.823418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.825019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.863916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1647/3330] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:05.865206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.874887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0daf7-4415-4272-9ffd-f52592c839f8 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.880584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.881629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.881967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.882246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/0ee7c42b68c848bba5655683e94e733a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.884341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=0ee7c42b68c848bba5655683e94e733a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.885829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:05.903004 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1684/3331] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Apr 2 20:57:05 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/0ee7c42b68c848bba5655683e94e733a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:05.907546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.919228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322423-871f-4fee-bb0f-016a60b02b16 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.923843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.925362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.925635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.926102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/0ee7c42b68c848bba5655683e94e733a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.945451 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Could not find credential: 4d0648f420dbc784318f3590263e26879447c27b009f8c0ee60bf9536dead821.: keystone.exception.CredentialNotFound: Could not find credential: 4d0648f420dbc784318f3590263e26879447c27b009f8c0ee60bf9536dead821. Apr 02 20:57:05.950727 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1648/3332] 10.222.0.18 () {58 vars in 1376 bytes} [Sat Apr 2 20:57:05 2022] GET /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/0ee7c42b68c848bba5655683e94e733a => generated 148 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 20:57:05.954159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:05.969317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f929c7-7328-4f56-adac-2aa4951f2697 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:05.974767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:05.975601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:05.975885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:05.976358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:05.977070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:05.978546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.004904 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1685/3333] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Apr 2 20:57:05 2022] POST /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:06.005273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.016816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55200829-9592-43ac-967b-fde0562b18f2 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.023222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.024764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.025311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.025712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.026471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.028063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.062632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1649/3334] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Apr 2 20:57:06 2022] POST /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:06.066969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.080230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ff2f-b893-4b17-9f77-b7e879b47e38 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.087337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.088880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.089330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.090173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.091323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.094127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.111158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1686/3335] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 20:57:06 2022] GET /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 865 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:06.117069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.126341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ed280-8f0b-4510-ad6d-a1623e745cdc tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.132256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.132910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.133203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.133488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/40f3dda005fd44649c3a7a1bd860f552` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.135566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=40f3dda005fd44649c3a7a1bd860f552)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.137120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.156960 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1650/3336] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Apr 2 20:57:06 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/40f3dda005fd44649c3a7a1bd860f552 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:06.161965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.173049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5fd30-ace1-4bc8-957c-20d038d33f07 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.178772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.179937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.180518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.181077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/7d66fee5b2ad4276895191d021696189` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.183651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=7d66fee5b2ad4276895191d021696189)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.185892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.206696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1687/3337] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Apr 2 20:57:06 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/7d66fee5b2ad4276895191d021696189 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:06.212260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.223230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef21d9-e4fc-4c08-ab5a-bf2a66348975 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.229672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.230902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.231037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.232017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.232892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.234553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.251926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1651/3338] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Apr 2 20:57:06 2022] POST /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2 => generated 367 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:06.256162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.271267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c303-2e40-4275-ba26-dcf87ff58f40 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.276397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.277704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.278068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.278876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/8718394685164b30a4074c941b04b605` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.280622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=8718394685164b30a4074c941b04b605)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.282282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.286265 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1688/3339] 10.222.0.18 () {58 vars in 1376 bytes} [Sat Apr 2 20:57:06 2022] GET /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/8718394685164b30a4074c941b04b605 => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:57:06.291385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.303307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15104db2-8768-4965-b74a-ba5efc6b805b tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.308096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d749976e694051a643b35ff5509dc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '005199d6e7da48b78da9c064d16a849c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.309010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.309297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.309572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/8718394685164b30a4074c941b04b605` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.311586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=c8d749976e694051a643b35ff5509dc5, credential_id=8718394685164b30a4074c941b04b605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.313057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3a07-7000-4f61-ba0a-a1a72dc1dc6f tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.339730 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1652/3340] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Apr 2 20:57:06 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5/credentials/OS-EC2/8718394685164b30a4074c941b04b605 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:06.345875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.435089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f954c-2438-423c-9a28-fd7211e65ff5 tempest-EC2CredentialsTest-1563080502 tempest-EC2CredentialsTest-1563080502-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.441268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.442227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.442522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.442802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] PATH_INFO: `/v3/users/c8d749976e694051a643b35ff5509dc5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.444032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d749976e694051a643b35ff5509dc5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.446517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.509462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d749976e694051a643b35ff5509dc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:06.522212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d749976e694051a643b35ff5509dc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:06.523020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d749976e694051a643b35ff5509dc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:06.523672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d749976e694051a643b35ff5509dc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:06.531170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d749976e694051a643b35ff5509dc5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:06.555758 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1689/3341] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:06 2022] DELETE /identity/v3/users/c8d749976e694051a643b35ff5509dc5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:06.568924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.569399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.569484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.599816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:06.599816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:06.676197 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1653/3342] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:06.687490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:06.689033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:06.762154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d4eb-1fd2-4337-b5b5-ad1759622b19 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:06.766778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:06.767567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:06.767977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:06.768283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:06.780959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:06.782945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:06.795083 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1690/3343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:07.184412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.185865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:07.201962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce127d72-7187-4648-8199-b0ba2d6e43dd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.208200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.209298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.209592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.209993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.212591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:07.228424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.231240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.239099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.240819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:07.246945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1654/3344] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:07.248122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.259402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005d5e-ce2e-4180-83e6-6d68807c8502 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.262856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.263901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.264341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.264669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.276828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.278582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e066d-3e0f-431b-9091-932b1a331446 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.283630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea36b39-8cf1-4aa5-af9b-15f9babe26cf service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.290036 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1655/3345] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:07.298377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.299617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.300511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.300802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] PATH_INFO: `/v3/projects/005199d6e7da48b78da9c064d16a849c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.302037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=005199d6e7da48b78da9c064d16a849c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.303958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.365497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005199d6e7da48b78da9c064d16a849c', 'request_id': 'req-7e07dd91-fb4c-491e-861e-780fda7644fa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:07.372701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005199d6e7da48b78da9c064d16a849c', 'request_id': 'req-7e07dd91-fb4c-491e-861e-780fda7644fa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:07.383950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005199d6e7da48b78da9c064d16a849c', 'request_id': 'req-7e07dd91-fb4c-491e-861e-780fda7644fa'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:07.399859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] The token cache is being invalidate because project 005199d6e7da48b78da9c064d16a849c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:07.400208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:07.401048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7e07dd91-fb4c-491e-861e-780fda7644fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:07.407635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.407867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.408169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.410420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1691/3346] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:07 2022] DELETE /identity/v3/projects/005199d6e7da48b78da9c064d16a849c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:07.435239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:07.436932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:07.524137 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1656/3347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:07.533545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.533975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.534809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.570944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:07.573294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:07.590831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1692/3348] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:07.591547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.608997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47cd5a-467a-4f7c-b389-998461defaf1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.619629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.620320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.620747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.621033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.625023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:07.625518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.627297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.675286 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1657/3349] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:07.679665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.690320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca0c5-c375-4bcf-9e99-9152175a0ec3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.695864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.696570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.696860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.697145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.697910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.699973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.744578 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1693/3350] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:07 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:07.745677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.755958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a803a1-b5cf-411a-abcf-2a223333b945 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.820294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.821026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.821468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.821755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.822464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.824497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.851889 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1658/3351] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:07 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:07.853258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.865005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8d5f-cf86-4f93-aa64-4658e144e965 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.871527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.872557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.872920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.873265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.874393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.876380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.891479 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1694/3352] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:07.895892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:07.913516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5e3a-0dfa-4f6c-8d7a-05e1ffaadc99 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:07.919274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:07.921082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:07.921720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:07.922157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] PATH_INFO: `/v3/projects/791183392f85473e9d05a1a38247d159/users/5acb8318c5cc4ac78671c8eff67e7c55/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:07.958134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] RBAC: Authorizing `identity:create_grant(project_id=791183392f85473e9d05a1a38247d159, user_id=5acb8318c5cc4ac78671c8eff67e7c55, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:07.962694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:07.990063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.012848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1659/3353] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:07 2022] PUT /identity/v3/projects/791183392f85473e9d05a1a38247d159/users/5acb8318c5cc4ac78671c8eff67e7c55/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:08.038048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2af217-9c9c-43d9-b4d6-088e9c239fc3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.133480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.134231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.134548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.134807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.136121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.137914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6237fcc-f782-4908-855a-989a641fbf72 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.153898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1695/3354] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:08.154127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.165746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2904c-83e6-4f33-bbbd-48b9f6b0434e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.172270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.173289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.173289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.173750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] PATH_INFO: `/v3/projects/791183392f85473e9d05a1a38247d159/users/5acb8318c5cc4ac78671c8eff67e7c55/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.176022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791183392f85473e9d05a1a38247d159, user_id=5acb8318c5cc4ac78671c8eff67e7c55, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.179013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.194299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1660/3355] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:08 2022] PUT /identity/v3/projects/791183392f85473e9d05a1a38247d159/users/5acb8318c5cc4ac78671c8eff67e7c55/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:08.204926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.205729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.206845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.237666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] MFA Rules not processed for user `5acb8318c5cc4ac78671c8eff67e7c55`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:08.239273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:08.339753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1696/3356] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:08.345349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.471842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eca31-f750-4bcd-9b82-7ba2634ad619 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.481080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.481878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.482240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.482596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.483384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.485771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.537514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1661/3357] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:08 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:08.541872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.560873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b51e-6c64-4d2f-9b5c-317475ace4fa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.682913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.684864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.685480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.686500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.687322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.690114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.726330 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1697/3358] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:08 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:08.727475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.743159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81f44d-1c6c-4519-8247-990db55965f4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.755428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.756676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.757231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.757724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.759543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.761660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.782309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1662/3359] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:08.787522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.803432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9210c-53d1-4cb4-8930-f747565ed040 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.809889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.810730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.811021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.811301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.812139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.815017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9ecf1-6618-4e5b-b6c1-41734dc60da4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.833561 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1698/3360] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:08.838080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:08.851970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a16cf6-9c67-4b82-8486-e2595def8bc2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:08.863764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:08.875741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:08.875741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:08.875741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] PATH_INFO: `/v3/projects/a40e41e7bfa04085915ac11c24094421/users/8810d100ca7e4c84b86e1e1d4490133f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:08.902574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40e41e7bfa04085915ac11c24094421, user_id=8810d100ca7e4c84b86e1e1d4490133f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:08.906860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:08.926733 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1663/3361] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:08 2022] PUT /identity/v3/projects/a40e41e7bfa04085915ac11c24094421/users/8810d100ca7e4c84b86e1e1d4490133f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:09.019679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:09.020234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:09.020540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:09.072596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] MFA Rules not processed for user `8810d100ca7e4c84b86e1e1d4490133f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:09.074279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:09.202020 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1699/3362] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:09.220638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:09.220638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:09.293497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82918040-e6a7-41b4-aad6-2837bb0617ba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:09.325920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:09.343045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:09.343226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:09.343566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:09.573928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:09.576300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ab11-b9a6-41d3-984e-d7c165e3a1f1 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:09.608203 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1664/3363] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:10.586640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:10.661306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f861e3-6cf7-48aa-8e18-9a37f5bb36fc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:10.667311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:10.667518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:10.667847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:10.668183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] PATH_INFO: `/v3/users/5acb8318c5cc4ac78671c8eff67e7c55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:10.670088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acb8318c5cc4ac78671c8eff67e7c55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:10.672257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:10.746069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acb8318c5cc4ac78671c8eff67e7c55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:10.764003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acb8318c5cc4ac78671c8eff67e7c55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:10.764832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acb8318c5cc4ac78671c8eff67e7c55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:10.766249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acb8318c5cc4ac78671c8eff67e7c55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:10.777822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acb8318c5cc4ac78671c8eff67e7c55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:10.815225 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1700/3364] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:10 2022] DELETE /identity/v3/users/5acb8318c5cc4ac78671c8eff67e7c55 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:10.817362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:10.818216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:10.818691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:10.842597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:10.845253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:10.943575 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1665/3365] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:11.010284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:11.012738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:11.120186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd3d46-b2d5-4de5-b79d-14ac01a778a1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:11.124670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:11.125979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:11.126491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:11.126931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:11.146719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:11.148191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:11.184027 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1701/3366] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:12.056698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:12.058205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:12.091325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5647f50-51c4-47c2-b189-a5165e6bdae3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:12.119400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:12.120286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:12.120585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:12.121044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] PATH_INFO: `/v3/projects/791183392f85473e9d05a1a38247d159` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:12.126439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791183392f85473e9d05a1a38247d159)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:12.129038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:12.201933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791183392f85473e9d05a1a38247d159', 'request_id': 'req-806a24db-c074-43f7-b078-f8fd6811ae66'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.210053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791183392f85473e9d05a1a38247d159', 'request_id': 'req-806a24db-c074-43f7-b078-f8fd6811ae66'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.217645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791183392f85473e9d05a1a38247d159', 'request_id': 'req-806a24db-c074-43f7-b078-f8fd6811ae66'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.232436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] The token cache is being invalidate because project 791183392f85473e9d05a1a38247d159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:12.233062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.233898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.236332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1666/3367] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:12 2022] DELETE /identity/v3/projects/791183392f85473e9d05a1a38247d159 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:12.240245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:12.251577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9287b-b1f4-4dd9-a505-f8e2c218a46e service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:12.321426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:12.322565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:12.323088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:12.323927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] PATH_INFO: `/v3/users/8810d100ca7e4c84b86e1e1d4490133f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:12.325348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8810d100ca7e4c84b86e1e1d4490133f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:12.329633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:12.400732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8810d100ca7e4c84b86e1e1d4490133f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.426329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8810d100ca7e4c84b86e1e1d4490133f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.427049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8810d100ca7e4c84b86e1e1d4490133f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.427718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8810d100ca7e4c84b86e1e1d4490133f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.446455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2b27519e-555c-4bd4-b4f6-18620414666b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8810d100ca7e4c84b86e1e1d4490133f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:12.483398 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1702/3368] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:12 2022] DELETE /identity/v3/users/8810d100ca7e4c84b86e1e1d4490133f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:13.061752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.064493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:13.097822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a24db-c074-43f7-b078-f8fd6811ae66 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.192368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.193760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.194049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.194327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] PATH_INFO: `/v3/projects/a40e41e7bfa04085915ac11c24094421` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.195798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40e41e7bfa04085915ac11c24094421)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.197898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.252012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40e41e7bfa04085915ac11c24094421', 'request_id': 'req-9999311e-d244-4e5f-a23a-91d10a2fd347'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:13.258333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40e41e7bfa04085915ac11c24094421', 'request_id': 'req-9999311e-d244-4e5f-a23a-91d10a2fd347'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:13.263914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40e41e7bfa04085915ac11c24094421', 'request_id': 'req-9999311e-d244-4e5f-a23a-91d10a2fd347'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:13.277425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] The token cache is being invalidate because project a40e41e7bfa04085915ac11c24094421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:13.277715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:13.278406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9999311e-d244-4e5f-a23a-91d10a2fd347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:13.280922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1667/3369] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:13 2022] DELETE /identity/v3/projects/a40e41e7bfa04085915ac11c24094421 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:13.286569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.287103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.287204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.305603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:13.306923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:13.370478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1703/3370] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:13.377969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.378260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.378537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.398271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:13.399483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:13.408353 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1668/3371] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:13.413136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.423545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127fbb5-8be6-49c7-bcf3-95bb7a87d96b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.429437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.430003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.430292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.430878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.431306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:13.431615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.433458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.449507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1704/3372] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:13.453615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.467181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dcf02-438c-4529-8e63-88460a4fb434 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.473022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.473748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.474030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.474362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.475097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.477031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.508523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1669/3373] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:13.510462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.521233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4426d3-0b93-4382-9190-cfc31eb17578 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.590916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.591617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.592040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.592987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.593700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.596903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.635477 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1705/3374] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:13.637457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.648434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b619-315d-4bc6-8a8f-155d2b73faa5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.653565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.654236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.654729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.655013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.655741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.657382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.668160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1670/3375] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:13.672966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.683614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889f08-68c0-48c3-9b04-cb86afea8b91 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.689109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.690105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.690913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.691265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] PATH_INFO: `/v3/projects/67b055c6391d4e06a8164230548e1973/users/4ffd9cabb482464f9947c6d8a6a3af44/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.708200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b055c6391d4e06a8164230548e1973, user_id=4ffd9cabb482464f9947c6d8a6a3af44, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.710938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.724924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1706/3376] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:13 2022] PUT /identity/v3/projects/67b055c6391d4e06a8164230548e1973/users/4ffd9cabb482464f9947c6d8a6a3af44/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:13.729196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.740377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852938d9-9f6c-42a3-b2cf-75c23afee422 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.809488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.810300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.810590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.810872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.811601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.813250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638fa31-6ad5-4189-92cc-4c876b2a1cf4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.824237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1671/3377] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:13.828497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:13.840030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162b2c-6e59-4bcf-b90e-0967a7585bb7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:13.844941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:13.845837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.846123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.847081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] PATH_INFO: `/v3/projects/67b055c6391d4e06a8164230548e1973/users/4ffd9cabb482464f9947c6d8a6a3af44/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.849252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b055c6391d4e06a8164230548e1973, user_id=4ffd9cabb482464f9947c6d8a6a3af44, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:13.852623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:13.864088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1707/3378] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:13 2022] PUT /identity/v3/projects/67b055c6391d4e06a8164230548e1973/users/4ffd9cabb482464f9947c6d8a6a3af44/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:13.874327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:13.874622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:13.874905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:13.902016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] MFA Rules not processed for user `4ffd9cabb482464f9947c6d8a6a3af44`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:13.903252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:13.980309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1672/3379] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:13.985036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.050623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9772d-58f8-418b-b988-14b6d01ce8d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.056137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.056919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.057338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.057658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.058496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.060730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.095151 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1708/3380] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:13 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:14.099531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.110329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b0326-7874-421e-915e-6f246ba4e5c3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.176302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.177075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.182968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.183441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.184247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.186401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.211767 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1673/3381] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:14 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:14.212973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.224500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f2f7-1d27-4cfe-93a5-fd1e09dc793f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.229155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.229822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.230114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.230394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.231108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.232838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.244560 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1709/3382] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:14.248888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.259894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33c43-a343-4fe7-a7f3-24def36f4506 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.266673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.267358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.267650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.267925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.268766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.270391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad36aa3-9e56-40e7-b2f3-f7fbd43a0d89 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.286008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1674/3383] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:14.287142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.301291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147c9ca-8812-4c9b-b773-84d52e9ba8bc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.307147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.308523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.309085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.309463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] PATH_INFO: `/v3/projects/2199b5d004b141a2b20dcae879677073/users/b946446acec744d0b917e39b67bdd642/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.328537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2199b5d004b141a2b20dcae879677073, user_id=b946446acec744d0b917e39b67bdd642, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.332446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.359455 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1710/3384] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:14 2022] PUT /identity/v3/projects/2199b5d004b141a2b20dcae879677073/users/b946446acec744d0b917e39b67bdd642/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:14.362706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.362999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.363340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.392862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] MFA Rules not processed for user `b946446acec744d0b917e39b67bdd642`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:14.394568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:14.468509 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1675/3385] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:14.480439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.482195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:14.546329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5b47a-7bc3-4ef4-b776-608c80bfaddd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.550139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.550799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.551087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.551367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.614685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.616141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5640bdc-95c9-44ea-a168-7bd820ca860e service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:14.626451 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1711/3386] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:14.883399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:14.959082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9256279-96ba-4923-bb91-fcf226316895 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:14.970446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:14.971491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:14.971849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:14.972203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] PATH_INFO: `/v3/users/4ffd9cabb482464f9947c6d8a6a3af44` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:14.973640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffd9cabb482464f9947c6d8a6a3af44)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:14.975717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:15.056799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffd9cabb482464f9947c6d8a6a3af44'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.072206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffd9cabb482464f9947c6d8a6a3af44'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.072961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffd9cabb482464f9947c6d8a6a3af44'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.082168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffd9cabb482464f9947c6d8a6a3af44'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.090261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffd9cabb482464f9947c6d8a6a3af44'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.096305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1676/3387] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:14 2022] DELETE /identity/v3/users/4ffd9cabb482464f9947c6d8a6a3af44 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:15.101006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:15.101299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:15.101598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:15.119332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:15.120567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:15.185228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1712/3388] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:15.204269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:15.206377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:15.267394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ea350-3be7-45d9-812b-32b1c7bf9697 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:15.272223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:15.273246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:15.273595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:15.273938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:15.285115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:15.286668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:15.297083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1677/3389] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:15.715889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:15.718351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:15.734544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83626c6f-7c02-4cad-970e-67343eb6f708 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:15.740745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:15.742449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:15.742972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:15.743467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] PATH_INFO: `/v3/projects/67b055c6391d4e06a8164230548e1973` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:15.745021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b055c6391d4e06a8164230548e1973)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:15.748131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:15.815083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b055c6391d4e06a8164230548e1973', 'request_id': 'req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.825954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b055c6391d4e06a8164230548e1973', 'request_id': 'req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.839351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b055c6391d4e06a8164230548e1973', 'request_id': 'req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.855413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] The token cache is being invalidate because project 67b055c6391d4e06a8164230548e1973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:15.856037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.857214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:15.861026 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1713/3390] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:15 2022] DELETE /identity/v3/projects/67b055c6391d4e06a8164230548e1973 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:15.864777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:15.882095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed83f-bb5a-480b-9731-bd7666dccf99 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:15.990523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:15.991612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:15.992116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:15.993635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] PATH_INFO: `/v3/users/b946446acec744d0b917e39b67bdd642` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:15.996008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b946446acec744d0b917e39b67bdd642)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:15.998490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:16.140868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b946446acec744d0b917e39b67bdd642'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:16.163638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b946446acec744d0b917e39b67bdd642'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:16.164508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b946446acec744d0b917e39b67bdd642'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:16.194439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b946446acec744d0b917e39b67bdd642'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:16.204827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e0c353d7-333c-4f9c-8a50-d16ad408b697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b946446acec744d0b917e39b67bdd642'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:16.220853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1678/3391] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:15 2022] DELETE /identity/v3/users/b946446acec744d0b917e39b67bdd642 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:16.828328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:16.830951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:16.851831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89510f1c-ff80-4fd9-8be1-36ccc5dedb7e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:16.973204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:16.974057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:16.974326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:16.974629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] PATH_INFO: `/v3/projects/2199b5d004b141a2b20dcae879677073` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:16.983973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2199b5d004b141a2b20dcae879677073)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:16.986347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.042981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2199b5d004b141a2b20dcae879677073', 'request_id': 'req-ccffaa74-bc4d-42cf-aff9-bbb40559da16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:17.049361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2199b5d004b141a2b20dcae879677073', 'request_id': 'req-ccffaa74-bc4d-42cf-aff9-bbb40559da16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:17.057460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2199b5d004b141a2b20dcae879677073', 'request_id': 'req-ccffaa74-bc4d-42cf-aff9-bbb40559da16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:17.071859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] The token cache is being invalidate because project 2199b5d004b141a2b20dcae879677073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:17.072158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:17.072841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ccffaa74-bc4d-42cf-aff9-bbb40559da16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:17.074391 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1714/3392] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:16 2022] DELETE /identity/v3/projects/2199b5d004b141a2b20dcae879677073 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:17.079342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.079877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.080195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.102261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:17.103510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:17.165585 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1679/3393] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:17.173307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.173604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.173886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.197079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:17.199043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:17.207260 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1715/3394] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:17.212314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.223776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf371a-e0f9-4f0f-b383-cc967a4e106c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.229019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.229901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.230192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.230476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.231202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:17.231678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.233343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.246551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1680/3395] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:17.250978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.265456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed28d-f936-4654-a564-ea4e83a405ef None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.272106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.272823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.273336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.273636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.274332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.279406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.319343 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1716/3396] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:17 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:17.323923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.335660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78877-d563-4ac8-bffa-b41c07135511 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.422065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.422811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.423275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.423957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.424336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.427064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.465118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1681/3397] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:17 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:17.469334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.479788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6603f7-0914-4512-9d60-ebc26f047cc1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.491148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.491836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.492125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.492717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.493336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.495119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.507702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1717/3398] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:17.511856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.525094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea060-cc96-496d-aba4-56181175d6ac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.530895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.531577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.531862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.532142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.533143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.535787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd805c4-1c8d-44dc-83a7-9da43aca3a68 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.549946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1682/3399] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:17.556170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.576271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6495-7bbe-44ce-8199-2b79a10fc3ac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.582106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.583566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.584016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.584288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] PATH_INFO: `/v3/projects/f37ab5362f1a48b8a72973e0c3b874ec/users/2ed30d38a7bf4a459cdbdf2accea53a9/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.602929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37ab5362f1a48b8a72973e0c3b874ec, user_id=2ed30d38a7bf4a459cdbdf2accea53a9, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.605750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.619544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1718/3400] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:17 2022] PUT /identity/v3/projects/f37ab5362f1a48b8a72973e0c3b874ec/users/2ed30d38a7bf4a459cdbdf2accea53a9/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:17.630274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.630569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.630858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.670927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] MFA Rules not processed for user `2ed30d38a7bf4a459cdbdf2accea53a9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:17.672719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:17.748832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1683/3401] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:17.761023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:17.769305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:17.834626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e978df-aece-47dd-81ff-0cae93b474e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:17.840178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:17.841015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:17.841300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:17.841579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:17.856490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:17.857906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fc668-6979-4f76-8c6d-61a95110536b service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:17.868471 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1719/3402] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:17.976011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:18.048684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6103b0-cdb4-4194-88d6-f8a0b1522c1a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:18.054390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:18.055267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.055739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.056019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] PATH_INFO: `/v3/users/2ed30d38a7bf4a459cdbdf2accea53a9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:18.057400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed30d38a7bf4a459cdbdf2accea53a9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:18.059836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:18.129340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed30d38a7bf4a459cdbdf2accea53a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.141439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed30d38a7bf4a459cdbdf2accea53a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.142380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed30d38a7bf4a459cdbdf2accea53a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.150769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed30d38a7bf4a459cdbdf2accea53a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.157965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed30d38a7bf4a459cdbdf2accea53a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.165521 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1684/3403] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:17 2022] DELETE /identity/v3/users/2ed30d38a7bf4a459cdbdf2accea53a9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:18.170337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.170636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.170926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:18.188197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:18.189447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:18.246678 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1720/3404] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:18.256237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:18.257695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:18.314071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b5984-bac8-4948-ae68-9ed584ca47c4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:18.317677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:18.318326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.318614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.318894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:18.328159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:18.329629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d78b6-0f20-4f03-8904-8f1b25ab6762 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:18.340145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1685/3405] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:18.746152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:18.749584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:18.772092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa53d3-2bba-4ae0-8a47-4658317c9377 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:18.777800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:18.778729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.779033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.780038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] PATH_INFO: `/v3/projects/f37ab5362f1a48b8a72973e0c3b874ec` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:18.781096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37ab5362f1a48b8a72973e0c3b874ec)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:18.783087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:18.848092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37ab5362f1a48b8a72973e0c3b874ec', 'request_id': 'req-3854c6df-df17-4e00-80b3-11cb7260839e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.854191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37ab5362f1a48b8a72973e0c3b874ec', 'request_id': 'req-3854c6df-df17-4e00-80b3-11cb7260839e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.861596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37ab5362f1a48b8a72973e0c3b874ec', 'request_id': 'req-3854c6df-df17-4e00-80b3-11cb7260839e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.876694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] The token cache is being invalidate because project f37ab5362f1a48b8a72973e0c3b874ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:18.877110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.877859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3854c6df-df17-4e00-80b3-11cb7260839e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:18.879993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1721/3406] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:18 2022] DELETE /identity/v3/projects/f37ab5362f1a48b8a72973e0c3b874ec => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:18.884676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.885145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.885529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:18.910783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:18.912264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:18.995171 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1686/3407] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:18.997455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:18.998154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:18.998447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.037475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:19.038912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:19.049132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1722/3408] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:19.053538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.067215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ccaee-77cb-4a3e-89e3-74ec492d963e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.075721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.076641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.076930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.077225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.078008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:19.078317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.080086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.100738 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1687/3409] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:57:19.103709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.114747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054ffd-9e7d-45cd-8f2f-cfb2771ca0e0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.121198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.122242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.122932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.123363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.124161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.127465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.172743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.180756 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1723/3410] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:19 2022] POST /identity/v3/projects => generated 359 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:19.185460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8826b-dd9e-48ec-8d48-996c46a75f3c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.288614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.289331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.289646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.289890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.290581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.293504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.322145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1688/3411] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:19 2022] POST /identity/v3/users => generated 280 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:19.326882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.343223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e3a5-aa93-4e21-bd4e-610a71faa168 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.349945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.350777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.351182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.351647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.352799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.354188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.372503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1724/3412] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:19.374951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.387525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a2cfe-c5df-4e79-a4e3-e0a49128daa2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.392410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.393188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.394112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.394457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.395258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.398263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd47a58-a552-4105-8d0e-cb34d7dcbc70 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.409463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1689/3413] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:19.413912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.423999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6481ba-4ca9-406d-accb-78a8c1ef9b6f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.429197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.430063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.430345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.430624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] PATH_INFO: `/v3/projects/3be5cf242d3c4456aa4db1b09d0a2dec/users/2f5c6a016bc74140895c03ade6c7ee2b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.447331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be5cf242d3c4456aa4db1b09d0a2dec, user_id=2f5c6a016bc74140895c03ade6c7ee2b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.450206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.477462 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1725/3414] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:19 2022] PUT /identity/v3/projects/3be5cf242d3c4456aa4db1b09d0a2dec/users/2f5c6a016bc74140895c03ade6c7ee2b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:19.479201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9803-0790-4c06-be28-0b9436637520 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.479495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9803-0790-4c06-be28-0b9436637520 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.479882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9803-0790-4c06-be28-0b9436637520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.513378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ebfb9803-0790-4c06-be28-0b9436637520 None None] MFA Rules not processed for user `2f5c6a016bc74140895c03ade6c7ee2b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:19.514730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ebfb9803-0790-4c06-be28-0b9436637520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:19.599482 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1690/3415] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:19.614115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.682364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7068e6-4e5a-4cd1-8776-c8f63a71b044 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:19.687616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:19.688654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.689038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.689414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] PATH_INFO: `/v3/users/2f5c6a016bc74140895c03ade6c7ee2b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.691442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5c6a016bc74140895c03ade6c7ee2b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:19.693817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:19.750166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5c6a016bc74140895c03ade6c7ee2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:19.759983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5c6a016bc74140895c03ade6c7ee2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:19.762307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5c6a016bc74140895c03ade6c7ee2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:19.763920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5c6a016bc74140895c03ade6c7ee2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:19.773480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5c6a016bc74140895c03ade6c7ee2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:19.810274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1726/3416] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:19 2022] DELETE /identity/v3/users/2f5c6a016bc74140895c03ade6c7ee2b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:19.814746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:19.815308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:19.816021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:19.844660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:19.846039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:19.908964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.911463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:19.926336 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1691/3417] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:19.938799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:19.941260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.049425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754c3e6-2fd2-4372-9321-876fc3b5972b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:20.057510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:20.058427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.058869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.059624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.061620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.078610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:20.080670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:20.083392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d66ea3-39d4-4b13-b3a8-c64eac1de406 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:20.092713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:20.095535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.095830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.095968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1727/3418] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:20.096403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.112078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:20.114652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:20.125402 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1692/3419] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:20.245730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:20.247429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.264057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dba2f-75c7-405e-95a1-e5649ec2fa9f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:20.268120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:20.269504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.269892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.270286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.274736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.293196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:20.295316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2469f-99ab-4ea3-8594-ea4a817685c0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:20.318518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1728/3420] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:20.671962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:20.673643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.722559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e265-2727-4242-93da-d6456ddf1878 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:20.734179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:20.735162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.735728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.735884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] PATH_INFO: `/v3/projects/3be5cf242d3c4456aa4db1b09d0a2dec` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.737333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be5cf242d3c4456aa4db1b09d0a2dec)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:20.739376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:20.791605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be5cf242d3c4456aa4db1b09d0a2dec', 'request_id': 'req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:20.801423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be5cf242d3c4456aa4db1b09d0a2dec', 'request_id': 'req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:20.808056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be5cf242d3c4456aa4db1b09d0a2dec', 'request_id': 'req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:20.822932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] The token cache is being invalidate because project 3be5cf242d3c4456aa4db1b09d0a2dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:20.823231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:20.824060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c5b1dce-b3cc-4106-a37d-5d7b4f3ffa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:20.840996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1693/3421] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:20 2022] DELETE /identity/v3/projects/3be5cf242d3c4456aa4db1b09d0a2dec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:20.842309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.842611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.842890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.861459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:20.862743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.923177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1729/3422] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:20.930948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.931243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.931575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.950339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:20.951552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:20.964038 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1694/3423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:20.969908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:20.983782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105060e1-9913-4c93-b9f0-53f3a80ab060 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:20.988579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:20.989403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:20.989688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:20.990060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:20.990847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:20.991325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:20.992959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.005692 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1730/3424] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:21.011387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.021384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1907e-5b26-4eac-9c08-c22e72698124 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.026341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.027003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.027291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.028030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.028369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.030299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.071015 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1695/3425] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:21.075457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.088108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f14b96-ddff-4026-813b-1b810446811b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.145284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.145969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.146257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.146540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.147239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.149282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.168884 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1731/3426] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:21.173059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.183854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a4487-3e61-4703-b1d0-55f166f59592 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.189008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.190103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.191096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.191440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.192744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.194634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.207230 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1696/3427] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:21.211382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.221224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f8b9-0d3f-45ec-9670-6686626444e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.225903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.226574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.226862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.227144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.227876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.229509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.239929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1732/3428] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:21.244668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.255686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb23caf-c1e1-4f12-9257-21b87c523e55 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.261912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.263123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.263582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.264014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] PATH_INFO: `/v3/projects/f0af3d2e7cb14b82975aed99fa956a21/users/f9c5c7b2c2d044e6b4174c06bb9d8b4c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.286610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0af3d2e7cb14b82975aed99fa956a21, user_id=f9c5c7b2c2d044e6b4174c06bb9d8b4c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.289964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ff6e-6431-4c45-baf7-299961984c8a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.309712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1697/3429] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:21 2022] PUT /identity/v3/projects/f0af3d2e7cb14b82975aed99fa956a21/users/f9c5c7b2c2d044e6b4174c06bb9d8b4c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:21.312649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.322486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.322687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.323326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.323665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.340250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ef51f-887f-4b12-8f37-7a11cb1551a6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.353507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] MFA Rules not processed for user `f9c5c7b2c2d044e6b4174c06bb9d8b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:21.354906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.419820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.420738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.421024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.421307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] PATH_INFO: `/v3/users/6bf48963161747228e3cafa0bc045729` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.422569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf48963161747228e3cafa0bc045729)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.425067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.434801 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1698/3430] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:21.441463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.458705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6c2d-158c-47c0-8138-83d7e954892d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.463949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.464666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.464955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.465236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.465927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.467839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.481524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf48963161747228e3cafa0bc045729'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.491900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf48963161747228e3cafa0bc045729'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.492738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf48963161747228e3cafa0bc045729'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.493476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf48963161747228e3cafa0bc045729'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.502338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1699/3431] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:21.503402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.505973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3b12ba7-c1a1-40fa-8fdd-657ed16b49b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf48963161747228e3cafa0bc045729'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.506173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.526713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1733/3432] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:21 2022] DELETE /identity/v3/users/6bf48963161747228e3cafa0bc045729 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:21.531037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.531330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.531611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.555362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:21.556612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.586876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb6eb-4e51-4254-883d-af3dfd229755 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.631070 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1734/3433] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:21.646028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.648015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.677912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.678856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.679249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.679633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.680430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.683508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.712228 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1700/3434] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:21 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:21.717455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.723779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf3f0-25ab-47de-abee-a780fb95b142 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.728250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.729373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.729762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.730043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.735904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ee35-5a0a-42bb-b9d7-991df163b1a7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.741413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.741600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.742518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.742989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.745992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.746587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.748116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.749770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.755621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1735/3435] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:21.756665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.758462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.761481 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1701/3436] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:21.766244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.774830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a37068-43d2-40e6-8995-247bb8ce4335 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.777679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc99caa-722e-4e87-847a-2d3aed193edd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.780372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.781455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.781891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.782170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] PATH_INFO: `/v3/users/a2e061bb9a054fb1945417baf444eaee` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.782618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.783502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.783788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.784137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] PATH_INFO: `/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0/users/55ba3ce84d104641806ac47d9624ca35/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.785933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e061bb9a054fb1945417baf444eaee)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.788139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.799262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29e745952f34ae3b4be9f0299e5d6e0, user_id=55ba3ce84d104641806ac47d9624ca35, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.802251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.819111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1702/3437] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:21 2022] PUT /identity/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0/users/55ba3ce84d104641806ac47d9624ca35/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:21.823623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.850768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e061bb9a054fb1945417baf444eaee'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.861525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e061bb9a054fb1945417baf444eaee'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.863067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e061bb9a054fb1945417baf444eaee'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.864321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e061bb9a054fb1945417baf444eaee'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.872737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e061bb9a054fb1945417baf444eaee'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:21.894184 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1736/3438] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:21 2022] DELETE /identity/v3/users/a2e061bb9a054fb1945417baf444eaee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:21.900055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ef5e-df24-4046-92c5-e3a5113cbe4c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:21.968953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:21.969818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:21.970165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:21.970557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:21.971445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:21.973126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5e505-5a83-4376-8373-913ff0e5020b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:21.988289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:21.989847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:21.992340 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1703/3439] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:22.006156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a37ffd-27aa-405d-b51a-14d902413a73 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.011808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.013434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.013882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.014332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] PATH_INFO: `/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0/users/55ba3ce84d104641806ac47d9624ca35/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.016655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29e745952f34ae3b4be9f0299e5d6e0, user_id=55ba3ce84d104641806ac47d9624ca35, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.020409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.042936 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1737/3440] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:21 2022] PUT /identity/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0/users/55ba3ce84d104641806ac47d9624ca35/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:22.058051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.059396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.059396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.099325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] MFA Rules not processed for user `55ba3ce84d104641806ac47d9624ca35`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:22.101340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.110050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.113127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.214020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b528-3f01-48a3-81e8-48517db14206 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.220817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.222949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.223471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.223983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] PATH_INFO: `/v3/projects/5f8ef84a62894a7da5457cafc1bcf172` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.225487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8ef84a62894a7da5457cafc1bcf172)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.227925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.239510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1704/3441] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:22.244632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.254542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec323-3cd2-4fd9-932c-e21a64fd6d7a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.259345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ba3ce84d104641806ac47d9624ca35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29e745952f34ae3b4be9f0299e5d6e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.260038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.260321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.260630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.261347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:22.261728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.263317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.280183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1705/3442] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:22.280183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.280183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.295629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d79c-0808-4977-8c7a-a2866ad02d3b tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.301325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8ef84a62894a7da5457cafc1bcf172', 'request_id': 'req-72777d1b-6639-4432-96ca-be2ce087d6bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.308678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8ef84a62894a7da5457cafc1bcf172', 'request_id': 'req-72777d1b-6639-4432-96ca-be2ce087d6bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.317545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8ef84a62894a7da5457cafc1bcf172', 'request_id': 'req-72777d1b-6639-4432-96ca-be2ce087d6bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.333899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] The token cache is being invalidate because project 5f8ef84a62894a7da5457cafc1bcf172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:22.334188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.334858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.339704 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1738/3443] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:22 2022] DELETE /identity/v3/projects/5f8ef84a62894a7da5457cafc1bcf172 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:22.340643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.341978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.358266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.359752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.360041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.360626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] PATH_INFO: `/v3/projects/1e586602a4da4d659974e36ab71486a7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.361554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e586602a4da4d659974e36ab71486a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.364094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.414880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777d1b-6639-4432-96ca-be2ce087d6bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.419568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e586602a4da4d659974e36ab71486a7', 'request_id': 'req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.428744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e586602a4da4d659974e36ab71486a7', 'request_id': 'req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.434770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e586602a4da4d659974e36ab71486a7', 'request_id': 'req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.467063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] The token cache is being invalidate because project 1e586602a4da4d659974e36ab71486a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:22.467291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.467943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.469539 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1706/3444] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:22 2022] DELETE /identity/v3/projects/1e586602a4da4d659974e36ab71486a7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:22.470301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.474301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.479250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ba3ce84d104641806ac47d9624ca35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29e745952f34ae3b4be9f0299e5d6e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.479914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.480205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.480506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.481190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.483121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.508477 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1739/3445] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:22 2022] POST /identity/v3/projects => generated 348 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:22.509309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.510873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.546011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f93ef0-ec42-4048-bdc4-d15d27a6c575 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.582592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6513-6cef-4e4f-8b2a-d589765d3f42 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.587254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.588331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.588651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.588931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] PATH_INFO: `/v3/users/65483dc9763e4e7db4365cae3329c6a2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.590137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65483dc9763e4e7db4365cae3329c6a2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.592095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.604480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.605407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.605690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.605967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] PATH_INFO: `/v3/users/de7792f5df104265a1ba0a778b3339ac` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.607198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7792f5df104265a1ba0a778b3339ac)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.609187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.646102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65483dc9763e4e7db4365cae3329c6a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.653336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65483dc9763e4e7db4365cae3329c6a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.654095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65483dc9763e4e7db4365cae3329c6a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.654831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65483dc9763e4e7db4365cae3329c6a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.662696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7792f5df104265a1ba0a778b3339ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.664344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65483dc9763e4e7db4365cae3329c6a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.674711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7792f5df104265a1ba0a778b3339ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.675384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7792f5df104265a1ba0a778b3339ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.684911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7792f5df104265a1ba0a778b3339ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.691110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1740/3446] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:22 2022] DELETE /identity/v3/users/65483dc9763e4e7db4365cae3329c6a2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:22.691110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.693277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7792f5df104265a1ba0a778b3339ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:22.701236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.701438 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1707/3447] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:22 2022] DELETE /identity/v3/users/de7792f5df104265a1ba0a778b3339ac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:22.805508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e5da9-cf61-4abc-94ab-9aa430c50711 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.875281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ba3ce84d104641806ac47d9624ca35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29e745952f34ae3b4be9f0299e5d6e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.876198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.876714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.877367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.877875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:22.878567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:22.879828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:22.893008 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1741/3448] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:22.904417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.906005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.922334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:22.926487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:22.990404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eb13-cea2-4eae-ab53-fc5a97b43c9b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:22.994885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:22.995550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:22.995837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:22.996118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:22.998019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.015115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.016588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.027209 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1708/3449] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:23.028246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.029608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.031839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86858-2037-46e9-b976-9bddf5c6ae06 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.038796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.038796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.038796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.038796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] PATH_INFO: `/v3/projects/d45dddfdc67d465bb598fe5710515486` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.040135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45dddfdc67d465bb598fe5710515486)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.043893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.045388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864f195-e54d-4932-9a73-e652eb05043c service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.050214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.051196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.051552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.051898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] PATH_INFO: `/v3/projects/1b0aa5573931449796e2c01365d4292f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.053560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0aa5573931449796e2c01365d4292f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.055824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.113321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0aa5573931449796e2c01365d4292f', 'request_id': 'req-e117160b-9560-405d-9d3b-bb071ddb0032'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.119625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0aa5573931449796e2c01365d4292f', 'request_id': 'req-e117160b-9560-405d-9d3b-bb071ddb0032'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.125262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0aa5573931449796e2c01365d4292f', 'request_id': 'req-e117160b-9560-405d-9d3b-bb071ddb0032'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.128330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45dddfdc67d465bb598fe5710515486', 'request_id': 'req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.138051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45dddfdc67d465bb598fe5710515486', 'request_id': 'req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.140903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] The token cache is being invalidate because project 1b0aa5573931449796e2c01365d4292f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:23.141652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.142322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e117160b-9560-405d-9d3b-bb071ddb0032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.144717 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1709/3450] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:23 2022] DELETE /identity/v3/projects/1b0aa5573931449796e2c01365d4292f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:23.148636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45dddfdc67d465bb598fe5710515486', 'request_id': 'req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.151643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4d6b-afb0-4709-b710-44b362564b3a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.151931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4d6b-afb0-4709-b710-44b362564b3a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.152210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a4d6b-afb0-4709-b710-44b362564b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.162783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] The token cache is being invalidate because project d45dddfdc67d465bb598fe5710515486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:23.163110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.163915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ff23a57-cb33-4c01-b6c1-e77f3026bed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:23.165525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1742/3451] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:22 2022] DELETE /identity/v3/projects/d45dddfdc67d465bb598fe5710515486 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:23.172784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d10d-7a9d-43e8-be1b-64914a92764b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.173504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d10d-7a9d-43e8-be1b-64914a92764b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.173998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5d10d-7a9d-43e8-be1b-64914a92764b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.179073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0d6a4d6b-afb0-4709-b710-44b362564b3a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:23.180569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d6a4d6b-afb0-4709-b710-44b362564b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.194297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0de5d10d-7a9d-43e8-be1b-64914a92764b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:23.196145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0de5d10d-7a9d-43e8-be1b-64914a92764b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.255223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1710/3452] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:23.263727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.264140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.264665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.280324 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1743/3453] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:23.288194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.289978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.289978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.300230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:23.303472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.317896 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1711/3454] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:23.322257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.323064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:23.325262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.334441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520aae3-822b-44fc-b10b-f87b1b421fbf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.336532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1744/3455] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:23.340647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.343127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.343901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.344176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.344519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.345377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:23.345740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.347896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.358938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7601e-f0b9-4660-89ad-bf39343f4a26 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.364635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1712/3456] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:57:23.368947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.369210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.369992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.370455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.370853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.371749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:23.372151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.373877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.381092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa8f7-849e-4c8d-8456-f3e624f950eb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.387111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.387834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.388203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.388385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.389100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.392494 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1745/3457] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:57:23.394958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.395451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.408199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e4f-94aa-49ab-9736-bcebe4ecd6ca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.414708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.415457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.415741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.416018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.416746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.418826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.427319 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1713/3458] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:23.431311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.471458 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1746/3459] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:23.472588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.523362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ea77-8340-4820-8f5d-5a0e599ffea6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.553860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0ef1a-4b41-450e-86b1-19240a1594c8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.568029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.568029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.568029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.568029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.568418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.568418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.606304 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1747/3460] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:23.617547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.629362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff4d2-6599-4d7e-9589-ed57697b85c6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.649991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.651016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.651159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.651313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.651601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.652338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.652582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.653012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.653432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.654084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.654459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.656552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.677667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1748/3461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:23.678644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.706235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1714/3462] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:23.707398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526aa9-f8fb-49c4-a79a-e38319009876 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.707587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.725078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877ab0-58b2-41f9-97aa-85c489a749c7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.727806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.728595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.728890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.729226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.730433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.732053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.733298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.734238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.734700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.735134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.736120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.739489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.748499 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1749/3463] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:23.753357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.768654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1715/3464] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:23.774378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.776691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fb558-ceb4-49e9-9c9a-ded73d3a0c5b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.790168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.791086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.791375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.791654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] PATH_INFO: `/v3/projects/82778196a3e64b9ebad84d9ca398da76/users/5e10a6edd86a492b8e51e40c176b1084/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.795537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195d74-5dce-4ee9-a00f-7e0437648b22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.808504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.810863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.812236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.812911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.816030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.819249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82778196a3e64b9ebad84d9ca398da76, user_id=5e10a6edd86a492b8e51e40c176b1084, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.821088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.825620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991b92-a72b-42b0-b64c-849da435a60e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.838036 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1716/3465] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:23.842088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.859646 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1750/3466] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:23 2022] PUT /identity/v3/projects/82778196a3e64b9ebad84d9ca398da76/users/5e10a6edd86a492b8e51e40c176b1084/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:23.861417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.861774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.862861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.865920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942889-5a35-48f7-a7e2-b5680ce2dbd9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:23.895245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] MFA Rules not processed for user `5e10a6edd86a492b8e51e40c176b1084`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:23.897022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:23.945879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:23.947103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:23.947688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:23.948000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] PATH_INFO: `/v3/projects/ea36b5ea8240418798f4b465c3dedc13/users/071643fd690943b4974043a040e53df8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:23.966492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea36b5ea8240418798f4b465c3dedc13, user_id=071643fd690943b4974043a040e53df8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:23.970444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a9207-3807-4882-991a-838dcdfae8db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:23.984726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1751/3467] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:23.990179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:23.991528 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1717/3468] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:23 2022] PUT /identity/v3/projects/ea36b5ea8240418798f4b465c3dedc13/users/071643fd690943b4974043a040e53df8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:24.001546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.001993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.002536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.006577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7db24-c848-4894-9780-7c9bfb111533 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.038255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] MFA Rules not processed for user `071643fd690943b4974043a040e53df8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:24.039729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:24.083731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.085635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.085936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.086222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.087825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.090603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.129140 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1752/3469] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/projects => generated 395 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:24.132919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.133451 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1718/3470] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:24.137614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.149978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32dbd-b3db-418a-b5f2-b8c3ec4bf277 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.217081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47561-c5ce-4e43-8275-e5bf6683753f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.224442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.226868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.227459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.228050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.229677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.232063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.244886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.245614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.245974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.246673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.247535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.249615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.258159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1753/3471] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:24 2022] POST /identity/v3/users => generated 304 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:24.261748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.275146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0944d8-af16-4fb0-9824-0d6ce0f43fe1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.285050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.285943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.287027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.287027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.288957 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1719/3472] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:24 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:24.289634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.292656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.292995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.312523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1754/3473] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:24.314252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.326285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69077c0a-fbea-4044-837c-94e798f954c7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.360677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa12ca-c680-4790-9cb5-695177e26c73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.366858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.367652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.367940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.368793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.369578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.372325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.392624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.394560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.394916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.395261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] PATH_INFO: `/v3/projects/8281eab17f3048639e952dcef350d3b5/users/d4e4b7c2aa854b8eb0afed7a75177b89/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.400310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1720/3474] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:24 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:24.402040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.414577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7ad00-deb4-4cb1-a7eb-327ce8f0ca66 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.417928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8281eab17f3048639e952dcef350d3b5, user_id=d4e4b7c2aa854b8eb0afed7a75177b89, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.420175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.420992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.421227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.421355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.421550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.422916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.425057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.439445 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1755/3475] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:24 2022] PUT /identity/v3/projects/8281eab17f3048639e952dcef350d3b5/users/d4e4b7c2aa854b8eb0afed7a75177b89/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:24.443788 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1721/3476] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:24.444722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.444959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.470701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f8b9-bdc3-45c3-9a2d-4dd659b122d8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.520576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf04fd9-f436-4cf5-80b8-ba73ac5d532d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.529404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.530243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.530713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.531183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.532025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.534412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.551887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1756/3477] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:24.557235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.587149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0ecd-3c17-4e0a-8ab9-c125c724f20d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.591359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.592266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.593320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.593473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.593591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] PATH_INFO: `/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0/users/91a03920da624889b51fe7da7135623f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.595295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.595295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.595295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] PATH_INFO: `/v3/projects/8281eab17f3048639e952dcef350d3b5/users/d4e4b7c2aa854b8eb0afed7a75177b89/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.597708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8281eab17f3048639e952dcef350d3b5, user_id=d4e4b7c2aa854b8eb0afed7a75177b89, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.601437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8ca5-1164-4c95-8df5-ac61525ba986 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.613376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bc7a865e6c4870b84dcbd54eafc2a0, user_id=91a03920da624889b51fe7da7135623f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.616282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.627325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1757/3478] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:24 2022] PUT /identity/v3/projects/8281eab17f3048639e952dcef350d3b5/users/d4e4b7c2aa854b8eb0afed7a75177b89/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:24.634305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1722/3479] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:24 2022] PUT /identity/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0/users/91a03920da624889b51fe7da7135623f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:24.634445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.634534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.634956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.638216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.665678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] MFA Rules not processed for user `d4e4b7c2aa854b8eb0afed7a75177b89`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:24.667034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:24.761989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdceff-fe9b-4433-95df-a61e639b0f36 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.768889 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1758/3480] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:24.773391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.774117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.774407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.774690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.775441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.777145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce4ce6-622f-4d3a-b190-033630e95bf0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.791841 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1723/3481] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:24.795830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:24.810958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d6882-4ded-4c2a-8521-b5fd7bb84875 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:24.818369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:24.819283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.819573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.819851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] PATH_INFO: `/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0/users/91a03920da624889b51fe7da7135623f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.822198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bc7a865e6c4870b84dcbd54eafc2a0, user_id=91a03920da624889b51fe7da7135623f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:24.826582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:24.868498 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1759/3482] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:24 2022] PUT /identity/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0/users/91a03920da624889b51fe7da7135623f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:24.874423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:24.874726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:24.875662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:24.910799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] MFA Rules not processed for user `91a03920da624889b51fe7da7135623f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:24.912036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.000715 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1724/3483] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:25.121738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.123487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.205581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.208220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.224036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6e7a-00a0-4ab3-855a-12b8efbc25ab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.232770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.233800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.234219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.234616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.305485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638659d9-a2a5-4921-a64e-cc01c5e49f94 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.314864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ba3ce84d104641806ac47d9624ca35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b29e745952f34ae3b4be9f0299e5d6e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.316348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.316659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.317062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] PATH_INFO: `/v3/projects/fdcee3feeab64ec69745f844d1414c9d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.318340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fdcee3feeab64ec69745f844d1414c9d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.321395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.346588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.348260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.358938 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1760/3484] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:25.359852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.361223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.376813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06cc42-a9a1-4b30-8511-295dfa317da2 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.391095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdcee3feeab64ec69745f844d1414c9d', 'request_id': 'req-e21023be-41d3-4d6a-8fe3-eba3c7fec975'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.398139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdcee3feeab64ec69745f844d1414c9d', 'request_id': 'req-e21023be-41d3-4d6a-8fe3-eba3c7fec975'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.405826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdcee3feeab64ec69745f844d1414c9d', 'request_id': 'req-e21023be-41d3-4d6a-8fe3-eba3c7fec975'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.423798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] The token cache is being invalidate because project fdcee3feeab64ec69745f844d1414c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:25.426437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.426437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.427346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1725/3485] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:25 2022] DELETE /identity/v3/projects/fdcee3feeab64ec69745f844d1414c9d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:25.432148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.434202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.476559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.477408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.477767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.478116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.481612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.535701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21023be-41d3-4d6a-8fe3-eba3c7fec975 tempest-QuotasNegativeTest-469474539 tempest-QuotasNegativeTest-469474539-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.545280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.546174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.546457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.546730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] PATH_INFO: `/v3/users/f9c5c7b2c2d044e6b4174c06bb9d8b4c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.548080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c5c7b2c2d044e6b4174c06bb9d8b4c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.550979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.570894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.572509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.582840 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1761/3486] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:25.607972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c5c7b2c2d044e6b4174c06bb9d8b4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.622096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c5c7b2c2d044e6b4174c06bb9d8b4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.623430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c5c7b2c2d044e6b4174c06bb9d8b4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.632312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c5c7b2c2d044e6b4174c06bb9d8b4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.645265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.646833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.647585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8cfe9145-0083-4dbf-a432-0f41fbb1dd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c5c7b2c2d044e6b4174c06bb9d8b4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:25.655408 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1726/3487] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:25 2022] DELETE /identity/v3/users/f9c5c7b2c2d044e6b4174c06bb9d8b4c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:25.659852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.660177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.660429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.679544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:25.680790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.707457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212026-a1c8-4c1d-aec2-78d7161f40da service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.745787 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1727/3488] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:25.756524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.758003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.762797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.763456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.763749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.764029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.765896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:25.772121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510934e-5b79-474d-9067-c7685685b8e3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:25.777623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.778581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:25.779061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.779228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:25.779516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:25.779850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:25.788434 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1762/3489] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:25.789653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:25.791150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:25.801620 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1728/3490] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:25.990422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:25.992494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.128328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce93-7293-43a1-b10e-0aacfd3a3745 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:26.142224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:26.144050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.147569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:26.148739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.149239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.149532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.153275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.167631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d90a-b014-46b1-a354-5b851071823a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:26.172795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:26.173780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.174283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.175231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] PATH_INFO: `/v3/projects/f0af3d2e7cb14b82975aed99fa956a21` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.176579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0af3d2e7cb14b82975aed99fa956a21)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:26.179328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:26.238587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0af3d2e7cb14b82975aed99fa956a21', 'request_id': 'req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.243923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:26.246527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750fd23-9073-43aa-9dbc-f3348d51b114 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:26.251855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0af3d2e7cb14b82975aed99fa956a21', 'request_id': 'req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.259608 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1763/3491] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:26.261309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0126-7231-4921-b0ff-2d1cf4c2bb7f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.261600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0126-7231-4921-b0ff-2d1cf4c2bb7f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.261895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad0126-7231-4921-b0ff-2d1cf4c2bb7f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.265216 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1764/3492] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:57:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:57:26.268322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0af3d2e7cb14b82975aed99fa956a21', 'request_id': 'req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.286665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.287075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.287453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.294667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] The token cache is being invalidate because project f0af3d2e7cb14b82975aed99fa956a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:26.295424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.296708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.298588 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1729/3493] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:26 2022] DELETE /identity/v3/projects/f0af3d2e7cb14b82975aed99fa956a21 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:26.303168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:26.304825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.322783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:26.324179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.390250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa933f0-0d2f-444f-aaca-b28a210fdf5e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:26.396105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:26.397343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.397648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.398063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] PATH_INFO: `/v3/users/55ba3ce84d104641806ac47d9624ca35` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.399324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ba3ce84d104641806ac47d9624ca35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:26.401507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:26.430203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1765/3494] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:26.466445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:26.468664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.497390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223e9b-340d-45da-97b6-973d0d85ecbe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:26.508477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:26.509473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.509863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.510245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.537458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ba3ce84d104641806ac47d9624ca35'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.554764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:26.556512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1541ad1-907f-4706-b21d-356102f6544a service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:26.563593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ba3ce84d104641806ac47d9624ca35'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.564921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ba3ce84d104641806ac47d9624ca35'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.580180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ba3ce84d104641806ac47d9624ca35'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.589992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ba3ce84d104641806ac47d9624ca35'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:26.591515 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1766/3495] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:26.597891 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1730/3496] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:26 2022] DELETE /identity/v3/users/55ba3ce84d104641806ac47d9624ca35 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:26.605114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:26.605410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:26.605692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:26.627484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:26.628827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:26.794414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1767/3497] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:26.870157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:26.871984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.018895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57534e5-61a8-4bc9-88fb-cc73e65ced76 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:27.024343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:27.025149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.025440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.025716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.035207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:27.037050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:27.048995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1731/3498] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:27.077711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:27.079158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.222067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc081ca4-f521-4628-9ecc-dd8c2acf1bc4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:27.228433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:27.229283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.229922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.230359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.232689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.326427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:27.328797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:27.342951 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1768/3499] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:27.364610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:27.366689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.438314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60217e3e-2b6c-4919-afab-5eee64b90deb service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:27.450570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:27.454026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.454316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.454594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] PATH_INFO: `/v3/users/5e10a6edd86a492b8e51e40c176b1084` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.460562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e10a6edd86a492b8e51e40c176b1084)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:27.464933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:27.590819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:27.593369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.613345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196bd-294d-493d-9c48-7afefc32586a service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:27.621041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e10a6edd86a492b8e51e40c176b1084'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.627427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:27.628287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.628595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.628878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] PATH_INFO: `/v3/users/071643fd690943b4974043a040e53df8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.630081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=071643fd690943b4974043a040e53df8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:27.631996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:27.672864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e10a6edd86a492b8e51e40c176b1084'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.673655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e10a6edd86a492b8e51e40c176b1084'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.692688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e10a6edd86a492b8e51e40c176b1084'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.706044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6878e2e8-1e03-4b35-8908-6b854b54b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e10a6edd86a492b8e51e40c176b1084'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.721086 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1732/3500] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:27 2022] DELETE /identity/v3/users/5e10a6edd86a492b8e51e40c176b1084 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:27.726711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.727292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.727717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.733401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071643fd690943b4974043a040e53df8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.767531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:27.769253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.770960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071643fd690943b4974043a040e53df8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.771615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071643fd690943b4974043a040e53df8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.772285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071643fd690943b4974043a040e53df8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.787059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab6ee01b-bba3-45f1-ac33-e73811bb2e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071643fd690943b4974043a040e53df8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:27.843291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1769/3501] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:27 2022] DELETE /identity/v3/users/071643fd690943b4974043a040e53df8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:27.854048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:27.854507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:27.854797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:27.904937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:27.906168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.942067 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1733/3502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:27.942067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:27.942817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:27.957832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12433e8b-5986-424c-8e52-fbc618ef6419 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:28.036213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:28.037218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.037740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.038302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] PATH_INFO: `/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.039869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29e745952f34ae3b4be9f0299e5d6e0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:28.042118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:28.070580 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1770/3503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:28.109459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:28.111470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.165984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29e745952f34ae3b4be9f0299e5d6e0', 'request_id': 'req-1f55c6dd-de73-4d32-8be6-f1dc6241838a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:28.176758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29e745952f34ae3b4be9f0299e5d6e0', 'request_id': 'req-1f55c6dd-de73-4d32-8be6-f1dc6241838a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:28.185061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29e745952f34ae3b4be9f0299e5d6e0', 'request_id': 'req-1f55c6dd-de73-4d32-8be6-f1dc6241838a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:28.203755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] The token cache is being invalidate because project b29e745952f34ae3b4be9f0299e5d6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:28.204347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:28.206549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:28.212663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1734/3504] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:27 2022] DELETE /identity/v3/projects/b29e745952f34ae3b4be9f0299e5d6e0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:28.214088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:28.216126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.267377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad482e-d764-4cb9-a3db-b10e768d177d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:28.313714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55c6dd-de73-4d32-8be6-f1dc6241838a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:28.329600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:28.330402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.330730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.331024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.344434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.401311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:28.402263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.402882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.403332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.418085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.450226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:28.452899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e18ed7-9f1d-491d-b310-5e35473e5be1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:28.469924 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1735/3505] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:28.472578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffdbe-fc0d-48fd-be05-8df695f13485 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.478798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffdbe-fc0d-48fd-be05-8df695f13485 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.479687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ffdbe-fc0d-48fd-be05-8df695f13485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.566724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2f1ffdbe-fc0d-48fd-be05-8df695f13485 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:28.567977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f1ffdbe-fc0d-48fd-be05-8df695f13485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.610927 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1736/3506] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:28.613428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.613959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.614250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.642087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:28.643256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:28.657921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1737/3507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:28.659526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:28.672796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789466-6e72-4ce0-8359-76649e973172 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:28.677566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:28.679038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:28.681503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:28.682361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.682815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.683064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.683920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:28.684309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:28.686815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:28.712959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1738/3508] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:28.715171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:28.736482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4616a-b324-4fd1-8ff8-547618f6a361 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:28.744984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:28.745669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:28.745961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:28.746259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:28.747000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:28.749305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:28.750982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1771/3509] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:28.825780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1739/3510] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:28 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:28.831454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:28.845095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f597e45-7032-4ba6-b673-002a95265561 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.110366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.115562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.117902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.118216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.118939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.120976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.199231 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1772/3511] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:28 2022] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:29.203336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.217817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d037-9d31-4372-a50d-92c14e385d34 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.230270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.231344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.231872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.232359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.233399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.235926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.262851 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1740/3512] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:29.266493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.291577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9d97-d8f1-48b0-b6f9-d8ec3af9cdae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.304742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.305654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.306111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.306548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.307451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.310787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ac818-2fe9-4873-8002-54857d960d15 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.378739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.379079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1773/3513] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:29.417549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e61d1-1f13-4fdc-877e-2dd018ca265e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.438963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.440001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.440425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.440842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] PATH_INFO: `/v3/projects/68f0b9e069a343c0920953cc14f0bde0/users/73bca10f8df245f19148ca4743c3d135/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.497313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f0b9e069a343c0920953cc14f0bde0, user_id=73bca10f8df245f19148ca4743c3d135, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.500383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.538366 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1741/3514] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:29 2022] PUT /identity/v3/projects/68f0b9e069a343c0920953cc14f0bde0/users/73bca10f8df245f19148ca4743c3d135/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:29.550905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfb817-42dc-439e-9fdd-2fbcc29d7d59 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.551190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfb817-42dc-439e-9fdd-2fbcc29d7d59 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.551474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfb817-42dc-439e-9fdd-2fbcc29d7d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.618876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4dfb817-42dc-439e-9fdd-2fbcc29d7d59 None None] MFA Rules not processed for user `73bca10f8df245f19148ca4743c3d135`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:29.619889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.621828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:29.622291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4dfb817-42dc-439e-9fdd-2fbcc29d7d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:29.767808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff3125-2060-4d04-b66f-652f6f537d3e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.786171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.787109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.787443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.787820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] PATH_INFO: `/v3/projects/82778196a3e64b9ebad84d9ca398da76` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.790464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82778196a3e64b9ebad84d9ca398da76)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.792505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1774/3515] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:29.792798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.793770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.795833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.796093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.801733 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1775/3516] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:57:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:57:29.802577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.804902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:29.829337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca10110-5cb6-4261-9861-480d1445a562 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:29.838143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:29.838143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.838489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.839324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] PATH_INFO: `/v3/projects/ea36b5ea8240418798f4b465c3dedc13` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:29.841402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea36b5ea8240418798f4b465c3dedc13)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:29.843469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:29.882760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82778196a3e64b9ebad84d9ca398da76', 'request_id': 'req-ba16a511-f141-416c-b9b1-ee1da1f5ba00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.891926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82778196a3e64b9ebad84d9ca398da76', 'request_id': 'req-ba16a511-f141-416c-b9b1-ee1da1f5ba00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.901682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82778196a3e64b9ebad84d9ca398da76', 'request_id': 'req-ba16a511-f141-416c-b9b1-ee1da1f5ba00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.926322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] The token cache is being invalidate because project 82778196a3e64b9ebad84d9ca398da76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:29.926902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.927787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.930378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1742/3517] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:29 2022] DELETE /identity/v3/projects/82778196a3e64b9ebad84d9ca398da76 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:29.931910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:29.933836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea36b5ea8240418798f4b465c3dedc13', 'request_id': 'req-f9ba173c-6fb9-4a96-bddd-1124538e02eb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.934947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:29.941683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea36b5ea8240418798f4b465c3dedc13', 'request_id': 'req-f9ba173c-6fb9-4a96-bddd-1124538e02eb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.957590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea36b5ea8240418798f4b465c3dedc13', 'request_id': 'req-f9ba173c-6fb9-4a96-bddd-1124538e02eb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.974941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] The token cache is being invalidate because project ea36b5ea8240418798f4b465c3dedc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:29.975789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.978249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f9ba173c-6fb9-4a96-bddd-1124538e02eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:29.984093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1776/3518] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:29 2022] DELETE /identity/v3/projects/ea36b5ea8240418798f4b465c3dedc13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:29.985794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:29.988344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:29.992136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.035271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:30.036960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a511-f141-416c-b9b1-ee1da1f5ba00 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.037580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.157252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.157977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.158266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.158548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.159757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.161312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:30.215111 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1777/3519] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:30.217419 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1743/3520] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:29 2022] POST /identity/v3/projects => generated 399 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:30.218211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:30.225930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.227942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:30.231798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.276269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6f0d0-148b-4e10-a9b0-e7fc0305c117 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.359066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.360212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.360872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.361738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] PATH_INFO: `/v3/users/d4e4b7c2aa854b8eb0afed7a75177b89` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.367204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e4b7c2aa854b8eb0afed7a75177b89)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.372966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:30.384096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52450b0c-6b08-4ef3-aa78-38b567114149 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.398174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.400006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.400307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.400895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] PATH_INFO: `/v3/users/91a03920da624889b51fe7da7135623f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.403761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a03920da624889b51fe7da7135623f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.405794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:30.467694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e4b7c2aa854b8eb0afed7a75177b89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.480725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e4b7c2aa854b8eb0afed7a75177b89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.481577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e4b7c2aa854b8eb0afed7a75177b89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.482301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e4b7c2aa854b8eb0afed7a75177b89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.498253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e4b7c2aa854b8eb0afed7a75177b89'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.501942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a03920da624889b51fe7da7135623f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.543517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a03920da624889b51fe7da7135623f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.547584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1778/3521] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:30 2022] DELETE /identity/v3/users/d4e4b7c2aa854b8eb0afed7a75177b89 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:30.548404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:30.552893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.553480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a03920da624889b51fe7da7135623f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.568588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a03920da624889b51fe7da7135623f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.584783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a03920da624889b51fe7da7135623f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:30.595809 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1744/3522] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:30 2022] DELETE /identity/v3/users/91a03920da624889b51fe7da7135623f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:30.599752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:30.602708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.709963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521a9dd-5b5a-4f23-9375-19c23fa2bf1c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.767854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296e325-ee7c-4b76-8934-4a8e19191d52 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.775030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.775910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.776307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.776809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.779434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.802465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.804215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:30.828623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1745/3523] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:30.859143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.859722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.860677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.861036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.861831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.877441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:30.933635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1779/3524] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:30 2022] POST /identity/v3/users => generated 306 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:30.934836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:30.936474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:30.959313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d86986-a448-4185-88d3-d07de4de8edc service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:30.972833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:30.973628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:30.974028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:30.974431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:30.975375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:30.980571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.002549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1746/3525] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:31.006731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.029634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43aa3-ff00-4f42-aa6f-789075cca94b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.042409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:31.043614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.043869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.044151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] PATH_INFO: `/v3/projects/a250fa602a094997a25a6871084bda1f/users/c0329230d7f6467fb6ddb4afdbb9e005/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.093997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a250fa602a094997a25a6871084bda1f, user_id=c0329230d7f6467fb6ddb4afdbb9e005, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:31.117654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.140329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.142921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.148923 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1780/3526] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:31 2022] PUT /identity/v3/projects/a250fa602a094997a25a6871084bda1f/users/c0329230d7f6467fb6ddb4afdbb9e005/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:31.152816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.170455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f99a29-de88-4fed-93aa-671d4d8f3c74 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.270244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec64b01-8567-4c63-b720-f4b8a2e07c02 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.279960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:31.280888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.281157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.281835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.282780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:31.286379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.293434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:31.295133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.295763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.296253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] PATH_INFO: `/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.298421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bc7a865e6c4870b84dcbd54eafc2a0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:31.303015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.319897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1781/3527] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:31.324854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.329209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.369277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2e8ce-6a85-44dd-af47-8781c880f311 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.382263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bc7a865e6c4870b84dcbd54eafc2a0', 'request_id': 'req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.392233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bc7a865e6c4870b84dcbd54eafc2a0', 'request_id': 'req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.409806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bc7a865e6c4870b84dcbd54eafc2a0', 'request_id': 'req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.439699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] The token cache is being invalidate because project 91bc7a865e6c4870b84dcbd54eafc2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:31.440369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.442620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.445563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1747/3528] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:31 2022] DELETE /identity/v3/projects/91bc7a865e6c4870b84dcbd54eafc2a0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:31.448006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.456983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.494988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:31.494988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.494988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.494988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] PATH_INFO: `/v3/projects/8281eab17f3048639e952dcef350d3b5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.495925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8281eab17f3048639e952dcef350d3b5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:31.497696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.569220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8281eab17f3048639e952dcef350d3b5', 'request_id': 'req-9210ea67-155d-4c4f-af05-014cd62d14b1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.576071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8281eab17f3048639e952dcef350d3b5', 'request_id': 'req-9210ea67-155d-4c4f-af05-014cd62d14b1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.589150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4d2f-6c3e-40d3-8fae-f7e3e2692c3d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.612757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8281eab17f3048639e952dcef350d3b5', 'request_id': 'req-9210ea67-155d-4c4f-af05-014cd62d14b1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.635051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] The token cache is being invalidate because project 8281eab17f3048639e952dcef350d3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:31.636824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.637580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9210ea67-155d-4c4f-af05-014cd62d14b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:31.641349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1782/3529] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:31 2022] DELETE /identity/v3/projects/8281eab17f3048639e952dcef350d3b5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:31.650884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589f39-84da-4de6-8a16-36e19a9a2941 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.651177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589f39-84da-4de6-8a16-36e19a9a2941 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.651451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589f39-84da-4de6-8a16-36e19a9a2941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.700949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:31.701953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.702161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.702439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] PATH_INFO: `/v3/projects/a250fa602a094997a25a6871084bda1f/users/c0329230d7f6467fb6ddb4afdbb9e005/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.704840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a250fa602a094997a25a6871084bda1f, user_id=c0329230d7f6467fb6ddb4afdbb9e005, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:31.708296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a267c3-89d3-4125-89fe-7f422e3907ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:31.709288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bf589f39-84da-4de6-8a16-36e19a9a2941 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:31.710509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bf589f39-84da-4de6-8a16-36e19a9a2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.720201 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1748/3530] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:31 2022] PUT /identity/v3/projects/a250fa602a094997a25a6871084bda1f/users/c0329230d7f6467fb6ddb4afdbb9e005/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:31.722304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e2ef4-0bcd-4b86-9335-cb02bbb7a582 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.722591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e2ef4-0bcd-4b86-9335-cb02bbb7a582 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.722865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e2ef4-0bcd-4b86-9335-cb02bbb7a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.749586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7b2e2ef4-0bcd-4b86-9335-cb02bbb7a582 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:31.750803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b2e2ef4-0bcd-4b86-9335-cb02bbb7a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.808594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1783/3531] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:31.811326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.812154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.812769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.851331 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1749/3532] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:31.853593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] MFA Rules not processed for user `c0329230d7f6467fb6ddb4afdbb9e005`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:31.855376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.861042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968be-9bca-4643-ab57-0c8e260f20f0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.861920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968be-9bca-4643-ab57-0c8e260f20f0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.861920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968be-9bca-4643-ab57-0c8e260f20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.900762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b2d968be-9bca-4643-ab57-0c8e260f20f0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:31.902217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2d968be-9bca-4643-ab57-0c8e260f20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:31.931124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1750/3533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:31.933232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:31.933769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:31.934305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:31.988543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1784/3534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:31.988543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:31.998114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc97d6-7cff-4f6a-b17a-a90bab28a437 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:31.998277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:32.003752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.004435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.005125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.005412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.006195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:32.006509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.008114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.011796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:32.031777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1785/3535] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:32.033132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.035053 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1751/3536] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:32.035935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:32.036666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.063682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9e19-5aea-4f59-b22e-dd8335e42ff5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.084167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.085026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.085475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.085870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.086687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.094314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.145758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1752/3537] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:32 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:32.147229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.170828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e8e5f-a23a-4032-a144-589c72d5bc89 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.277583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342ca2-9ce6-4696-8e0d-32c11a831545 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.277829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.277829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.277829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.278143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.280378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:32.283174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.284126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.284528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.285121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.286068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:32.286454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.288414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.304370 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1753/3538] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:32.305668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.319414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caed7e-d5a3-4690-aac6-051e8df42e3a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.327676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.328570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.328914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.329292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.330337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.332556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.368741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1754/3539] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:32 2022] POST /identity/v3/users => generated 297 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:32.371812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.387893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97bbce-c25e-4064-bab6-8091c5eb9709 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.408413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.409802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.410159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.410449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.411256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.413479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.422773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.425295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.450680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1786/3540] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:32.451525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.473803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ec0f7-c19a-4fa2-b60e-049e94556bd4 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.504045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.505769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.506193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.506688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.507617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.513501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.532288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1755/3541] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:32 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:32.535776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1787/3542] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:32.539657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.541426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.570639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0e83-c5a7-46e0-831a-b1f1cb104ff5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.718407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88375-8faf-4b34-8017-5a1323867d68 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.733927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.734986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.735176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.735625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.736118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.736976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.737782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.738070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.738362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.738777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.741947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.742500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.760217 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1788/3543] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:32.764663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.789373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f375-e575-40a8-ba62-65bc9e4e15b9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.793541 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1756/3544] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:32 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:32.797269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.798083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.798684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.799168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.800253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] PATH_INFO: `/v3/projects/d0e22715a8e849e0871b68d772ed29fd/users/821ac6c697bc4706ad36b8be4e9276a5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.811186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d9350-7985-4599-a285-d316646449f0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.826508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.827112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.827412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.827700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.830074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.831337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e22715a8e849e0871b68d772ed29fd, user_id=821ac6c697bc4706ad36b8be4e9276a5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:32.832135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.838695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840ebc1-934f-40dd-b5f8-1dce5b535f89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:32.854233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1757/3545] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:32.859195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:32.866559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1789/3546] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:32 2022] PUT /identity/v3/projects/d0e22715a8e849e0871b68d772ed29fd/users/821ac6c697bc4706ad36b8be4e9276a5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:32.872902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:32.873188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:32.873523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:32.877867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d54b4c-caec-4145-a592-e8dcc26ba6bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:32.896853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:32.898499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:32.991343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:32.997257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1790/3547] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:33.002093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.002756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.002914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.004835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.005109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.006619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:33.007745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.023875 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1758/3548] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:33.027499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.056863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141ff17-2598-4b8f-af6a-2dc9a4f8b193 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.074745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.076426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.076743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.077021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] PATH_INFO: `/v3/projects/d84de315abb1452fa5187770db66041e/users/a9953e57681446849124a494fa1cdf44/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.107840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2892-333d-4dc3-8b31-d291b08de9e7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.109226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84de315abb1452fa5187770db66041e, user_id=a9953e57681446849124a494fa1cdf44, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.111914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5bf0-683d-4c3e-9d7e-89da2cc6cf85 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.119764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.120948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.121509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.121956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.139342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.141282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.154247 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1791/3549] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:33.154630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1759/3550] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:33 2022] PUT /identity/v3/projects/d84de315abb1452fa5187770db66041e/users/a9953e57681446849124a494fa1cdf44/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:33.165405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.165696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.165983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.206946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] MFA Rules not processed for user `a9953e57681446849124a494fa1cdf44`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:33.208558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:33.363737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1760/3551] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:33.369716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.384340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570c94-e240-45c9-9a84-3138d9a37dfc service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.492073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.493799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.494240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.494812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.495716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.497912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.610838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1792/3552] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:33 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:33.615708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.666517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b228-9739-4476-9ca7-41992cbe9ce4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.722567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.726817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:33.765620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.766362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.766651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.766930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.767621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.770384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.795551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1761/3553] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:33 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:33.800394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.826621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddec3b-a8c8-45dd-9ade-37f844b87bec admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.833859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.835023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.835316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.835644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.836385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.839472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.852630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1762/3554] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:33.856761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:33.871110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cbbde-3ff6-46ce-8f7c-c79c544abdfa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.891288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.892299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.892674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.893031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] PATH_INFO: `/v3/projects/8ea0483355034dd9a9fadf514384a916/users/b4291ca807d24faf81284d3951525d0f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.911595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c52dc-deb1-44c4-812b-ec30a2b9cbc9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:33.927463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:33.928368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:33.929504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea0483355034dd9a9fadf514384a916, user_id=b4291ca807d24faf81284d3951525d0f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:33.929870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:33.930221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:33.934258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:33.976691 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1763/3555] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:33 2022] PUT /identity/v3/projects/8ea0483355034dd9a9fadf514384a916/users/b4291ca807d24faf81284d3951525d0f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:33.980464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:34.046677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:34.051996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:34.086059 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1793/3556] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:34.161873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214d576-99d2-48a9-b417-7d0813aa9a71 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:34.186391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:34.186913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:34.187205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:34.187484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:34.191016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:34.192650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0041a-965f-48e0-9fdd-588d32815085 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:34.218802 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1764/3557] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:34.219554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:34.232918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509daa2-98cc-4a81-8037-e15d84daa1da service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:34.238973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:34.240120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:34.240640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:34.241127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] PATH_INFO: `/v3/projects/8ea0483355034dd9a9fadf514384a916/users/b4291ca807d24faf81284d3951525d0f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:34.245076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea0483355034dd9a9fadf514384a916, user_id=b4291ca807d24faf81284d3951525d0f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:34.248292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c03cd1-0f8e-4734-94f0-cda597f855b0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:34.277571 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1794/3558] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:34 2022] PUT /identity/v3/projects/8ea0483355034dd9a9fadf514384a916/users/b4291ca807d24faf81284d3951525d0f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:34.279033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:34.279500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:34.279947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:34.321840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] MFA Rules not processed for user `b4291ca807d24faf81284d3951525d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:34.324189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:34.512433 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1765/3559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:34.528339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623b87-5ea1-482f-94c2-c676c6e1b10e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:34.528339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623b87-5ea1-482f-94c2-c676c6e1b10e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:34.528339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623b87-5ea1-482f-94c2-c676c6e1b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:34.571143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05623b87-5ea1-482f-94c2-c676c6e1b10e None None] MFA Rules not processed for user `a9953e57681446849124a494fa1cdf44`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:34.574524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05623b87-5ea1-482f-94c2-c676c6e1b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:34.743286 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1795/3560] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:35.166869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:35.168675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:35.352061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe96053-ba1e-47fd-90a0-771bea843a88 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:35.362927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:35.364482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:35.364959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:35.365413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:35.377704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:35.380813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac6da-1fe1-4fa7-80dc-a6c8702cb34c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:35.421157 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1766/3561] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:36.305817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:36.306906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:36.307434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:36.343056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] MFA Rules not processed for user `a9953e57681446849124a494fa1cdf44`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:36.360843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:36.375673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1796/3562] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:37.837645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:37.838194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:37.838406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:37.882739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:37.886284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:38.029994 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1767/3563] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:38.048235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:38.050566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:38.259426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927f186-74dc-4c65-9fe6-032e07a9a3d6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:38.267953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:38.269515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:38.270364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:38.270647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:38.286892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:38.288497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:38.298300 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1797/3564] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:57:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:50.429776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:50.468635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc55c-9c59-4ce3-8c6b-1831e168d039 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:50.483961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:50.484664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:50.490826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:50.491121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:50.498988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:50.519323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:50.521705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcea0b-a2cf-45f0-a6ee-73136f8f52e3 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:50.551167 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1768/3565] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:51.355543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:51.358962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:51.553561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd802080-902a-44ee-b8a0-19c38e590535 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:51.563499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:51.565628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:51.568113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:51.568603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] PATH_INFO: `/v3/users/369aaa621e1a4e8788a3e18afeea57a8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:51.572599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=369aaa621e1a4e8788a3e18afeea57a8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:51.574777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:51.649812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369aaa621e1a4e8788a3e18afeea57a8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:51.664724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369aaa621e1a4e8788a3e18afeea57a8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:51.667650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369aaa621e1a4e8788a3e18afeea57a8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:51.668667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369aaa621e1a4e8788a3e18afeea57a8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:51.677641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369aaa621e1a4e8788a3e18afeea57a8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:51.712324 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1798/3566] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:51 2022] DELETE /identity/v3/users/369aaa621e1a4e8788a3e18afeea57a8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:51.717063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:51.718213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:51.718871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:51.763016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:51.764286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:51.909859 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1769/3567] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:51.938665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:51.942526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:52.122306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ecead-8f01-4636-ae49-17899a430a8c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:52.130797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:52.131699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:52.132433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:52.133105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:52.145564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:52.147057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a53f75-cac9-47f0-bb7b-50f43cc33653 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:52.162800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1799/3568] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:52.526676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:52.528303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:52.551331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25791-8b36-4000-96f5-5d2ac65e9bb5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:52.564118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:52.565206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:52.565594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:52.566040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] PATH_INFO: `/v3/users/73bca10f8df245f19148ca4743c3d135` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:52.571036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bca10f8df245f19148ca4743c3d135)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:52.573235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:52.671307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bca10f8df245f19148ca4743c3d135'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:52.692302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bca10f8df245f19148ca4743c3d135'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:52.693802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bca10f8df245f19148ca4743c3d135'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:52.715622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bca10f8df245f19148ca4743c3d135'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:52.731364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bca10f8df245f19148ca4743c3d135'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:52.742226 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1770/3569] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:52 2022] DELETE /identity/v3/users/73bca10f8df245f19148ca4743c3d135 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:52.747967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:52.748531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:52.749021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:52.778685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:52.780192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:52.882164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1800/3570] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:52.892750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:52.896344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:52.979289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab84c5a-a850-4882-9802-e9510a261625 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:52.984246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:52.985170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:52.985663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:52.986126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:52.997752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:52.999716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:53.017086 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1771/3571] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:53.643993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:53.645627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:53.668733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58537ec8-c9a7-4b20-8ff5-de85550554a9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:53.682446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:53.683335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:53.683617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:53.683923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] PATH_INFO: `/v3/projects/68f0b9e069a343c0920953cc14f0bde0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:53.685088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f0b9e069a343c0920953cc14f0bde0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:53.687018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:53.835564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:53.836063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f0b9e069a343c0920953cc14f0bde0', 'request_id': 'req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:53.837949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:53.844429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f0b9e069a343c0920953cc14f0bde0', 'request_id': 'req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:53.859238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bb5a7-3474-47ae-92e4-285fb7671940 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:53.878029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f0b9e069a343c0920953cc14f0bde0', 'request_id': 'req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:53.913456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] The token cache is being invalidate because project 68f0b9e069a343c0920953cc14f0bde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:53.914478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:53.916784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:53.925089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1801/3572] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:53 2022] DELETE /identity/v3/projects/68f0b9e069a343c0920953cc14f0bde0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:53.928731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:53.930667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:53.996534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:53.997706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:53.998143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:53.998580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] PATH_INFO: `/v3/projects/39ae799bc6f1400186ad8199388612a1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.009438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ae799bc6f1400186ad8199388612a1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.011918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.067939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c942ea-a0b0-4f15-b05e-a357ecdb7ad7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.095367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.096852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.097093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.097513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] PATH_INFO: `/v3/users/c0329230d7f6467fb6ddb4afdbb9e005` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.101375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0329230d7f6467fb6ddb4afdbb9e005)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.127001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.130838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ae799bc6f1400186ad8199388612a1', 'request_id': 'req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.138561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ae799bc6f1400186ad8199388612a1', 'request_id': 'req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.154842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ae799bc6f1400186ad8199388612a1', 'request_id': 'req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.179127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] The token cache is being invalidate because project 39ae799bc6f1400186ad8199388612a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:54.179431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.180935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe5f42bf-3d65-4b1b-881d-2f9448ce4b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.184638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1772/3573] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:53 2022] DELETE /identity/v3/projects/39ae799bc6f1400186ad8199388612a1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:54.201535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.202164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.202655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.228231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0329230d7f6467fb6ddb4afdbb9e005'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.241813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0329230d7f6467fb6ddb4afdbb9e005'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.243181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0329230d7f6467fb6ddb4afdbb9e005'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.244070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0329230d7f6467fb6ddb4afdbb9e005'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.247119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:54.248361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:54.253749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3dca0eb6-6426-462f-beb7-b69f0ed890f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0329230d7f6467fb6ddb4afdbb9e005'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:54.278923 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1802/3574] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:57:53 2022] DELETE /identity/v3/users/c0329230d7f6467fb6ddb4afdbb9e005 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:54.358816 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1773/3575] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:54.366389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.366959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.367456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.387997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:54.389727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:54.475536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1803/3576] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:54.479558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.490682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312ebb-cf02-4e38-872a-a5dcadc203c6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.499062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.499997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.500861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.501531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.503209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:54.503891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.506000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.522530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1774/3577] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:54.528114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.539576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e658e-5c47-406b-b907-09aecc368f82 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.545088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.545951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.546347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.546785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.550171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.552441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.611170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1804/3578] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:54 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:54.615638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.631951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987560f-2c93-42f5-b025-586cf1ac51e0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.781671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.783090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.783351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.783686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.784613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.786552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.838511 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1775/3579] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:54 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:54.840156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.852279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86513b-ffdd-4da4-a1e5-ae68a23fbb4b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.872601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.873544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.873951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.874354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.875201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.877023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.903138 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1805/3580] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:54.906953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.927099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cd98c-af14-4d0c-b64b-dfb5ff77f6ae admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:54.941170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:54.943417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:54.944045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:54.944826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:54.945935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:54.947795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6dc46-4f49-4501-993d-3dc41b66c1c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:54.977512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1776/3581] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:54.980383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:54.995200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98bcb0-6e0f-44df-861d-53d02930d033 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:55.008020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:55.009526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.010204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.012566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] PATH_INFO: `/v3/projects/da03d0fc36de405d87c8e99d209af9fe/users/449253ed73e04f47bcd09c3a1cca6e8c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.048909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da03d0fc36de405d87c8e99d209af9fe, user_id=449253ed73e04f47bcd09c3a1cca6e8c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:55.054531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:55.099371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1806/3582] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:54 2022] PUT /identity/v3/projects/da03d0fc36de405d87c8e99d209af9fe/users/449253ed73e04f47bcd09c3a1cca6e8c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:55.104844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.108866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.109430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.151054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:55.152982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.199237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:55.201455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.323284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1777/3583] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:55.352846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:55.354628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.378878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f950-6fc5-47ad-ada6-0d1062c3d9bd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:55.389894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:55.390781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.391043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.391425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.395566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.433766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:55.446300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93379412-6927-4401-a620-1ea08f820aa6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:55.460055 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1807/3584] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:55.483454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1c82-096b-496b-a69b-16b5a918f3e3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:55.494186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:55.494867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.495156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.495437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.518247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:55.519775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c603f-408a-4804-81ac-abf8e4614030 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:55.530833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1778/3585] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:57:55.748103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.748645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.749007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.791993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] MFA Rules not processed for user `4eaee1ddad0041828fb2e65677e2da25`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:55.794871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.803530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4ce3-522d-4045-aa60-c10cc2d4db35 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.803826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4ce3-522d-4045-aa60-c10cc2d4db35 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.804111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e4ce3-522d-4045-aa60-c10cc2d4db35 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.805993 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1779/3586] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:57:55.818181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:55.818547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:55.818835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:55.872621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:55.879682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:55.938414 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1808/3587] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:56.082631 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1780/3588] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:56.126721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:56.129160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:56.282797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b5a06-a865-4fdf-b07b-80d6b66cb76d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:56.296141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:56.296967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.297327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.297677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.315649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:56.316951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8bfe0-8fc9-49fb-ac42-7b697b511848 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:56.339689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1809/3589] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:56.415403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:56.417496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:56.466218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87858-f6c8-4192-8fda-10eead8cc6ec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:56.479478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:56.482498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.482859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.485303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] PATH_INFO: `/v3/projects/a250fa602a094997a25a6871084bda1f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.487183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a250fa602a094997a25a6871084bda1f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:56.490702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:56.625981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a250fa602a094997a25a6871084bda1f', 'request_id': 'req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:56.640353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a250fa602a094997a25a6871084bda1f', 'request_id': 'req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:56.646920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a250fa602a094997a25a6871084bda1f', 'request_id': 'req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:56.666554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] The token cache is being invalidate because project a250fa602a094997a25a6871084bda1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:57:56.666926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:56.670251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb4e50bc-a558-4ca0-9ccc-65f0c7ea3fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:57:56.672175 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1781/3590] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:56 2022] DELETE /identity/v3/projects/a250fa602a094997a25a6871084bda1f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:56.678380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b8a4-dc58-479f-986c-35ef53f6e8df None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.678974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b8a4-dc58-479f-986c-35ef53f6e8df None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.679491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484b8a4-dc58-479f-986c-35ef53f6e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.708918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64827-f5ff-4d57-b055-46274e8d5e52 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.709230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64827-f5ff-4d57-b055-46274e8d5e52 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.709517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f64827-f5ff-4d57-b055-46274e8d5e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.718353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4484b8a4-dc58-479f-986c-35ef53f6e8df None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:56.723828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4484b8a4-dc58-479f-986c-35ef53f6e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:56.767012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9f64827-f5ff-4d57-b055-46274e8d5e52 None None] MFA Rules not processed for user `821ac6c697bc4706ad36b8be4e9276a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:56.767012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9f64827-f5ff-4d57-b055-46274e8d5e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:56.885712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1810/3591] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:56.893768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.898204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.898204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.910314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1782/3592] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:57:56.934256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:56.934546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:56.936722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:56.949167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:56.951842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:56.968573 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1811/3593] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:56.974934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:56.995800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917e13b-6a28-41bf-a8a4-6b003ee2683e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.000772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] MFA Rules not processed for user `821ac6c697bc4706ad36b8be4e9276a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:57.005185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:57.009368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.010289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.011107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.011865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.013529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:57:57.014552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.016908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.035695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1783/3594] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:57.043584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1812/3595] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:57:57.050014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:57.068116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b0bf3-eb1a-49cf-ad8b-b5ebedfa508f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.080036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.083137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.085087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.085377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.086969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.093737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.169675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:57.170590 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1784/3596] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:57 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:57.186223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11110bf3-73a5-4101-b1b7-d312909b6ce4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.341013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.341724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.342020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.342649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.343041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.345081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.411296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1813/3597] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:57 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:57:57.415588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:57.435711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd291c4-1336-4aef-a61a-2acc459e98fd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.459068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.459822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.460096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.460497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.461235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.464150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.491902 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1785/3598] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:57.495930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:57.511605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b3d8-6f54-4a70-8341-befeee6ef549 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.523664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.524219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.524426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.524741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.525652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.528444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262b46-a772-4be7-9cf5-a52a1acf1df8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.552546 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1814/3599] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:57.555125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:57.585520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7ffa-a6c7-4f7d-8df4-df0cd5b7db1d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:57.610845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:57.616671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.619685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.619685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] PATH_INFO: `/v3/projects/5eea9d710d914c99bd60dacbc66362b7/users/0ab2788d303b4e77afac3137082e39bf/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.675154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eea9d710d914c99bd60dacbc66362b7, user_id=0ab2788d303b4e77afac3137082e39bf, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:57.677877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:57.722476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:57.722890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:57.723152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:57.724770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1786/3600] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:57 2022] PUT /identity/v3/projects/5eea9d710d914c99bd60dacbc66362b7/users/0ab2788d303b4e77afac3137082e39bf/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:57.796875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] MFA Rules not processed for user `0ab2788d303b4e77afac3137082e39bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:57.798176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:58.084352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1815/3601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:58.097965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.194976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.198545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:58.269965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614511-eccc-4e31-bdf5-45a4e348aef6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:58.290791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:58.291048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:58.291145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:58.291408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:58.292106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:58.299280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:58.362370 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1787/3602] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:57:58 2022] POST /identity/v3/projects => generated 391 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:58.363322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.414979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb140a-952a-4cae-9537-f0462f2d447d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:58.557651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67195df-cf4e-41a5-8431-669260f4e6f8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:58.580141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:58.582670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:58.582987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:58.583299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:58.584016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:58.586097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:58.638134 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1788/3603] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:57:58 2022] POST /identity/v3/users => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:57:58.641461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:58.642410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:58.642941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:58.643393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:58.647260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.676113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161cb5f-abc8-4ea5-b713-8f0b2f547df8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:58.691040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:58.692289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:58.692812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:58.693253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:58.695952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:58.697983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:58.729051 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1789/3604] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:57:58.730190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.753959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51250d-76c3-4c88-9f0d-bb89d9c35a7b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:58.780134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:58.781415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:58.783321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:58.784725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] PATH_INFO: `/v3/projects/7f6d535ec9854bc98190f90ca1715ca9/users/447d9f2994034d96b98376d2caa3532a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:58.807066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:58.809432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:58.823868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6d535ec9854bc98190f90ca1715ca9, user_id=447d9f2994034d96b98376d2caa3532a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:58.829811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:58.848535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1816/3605] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:57:58.875091 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1790/3606] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:58 2022] PUT /identity/v3/projects/7f6d535ec9854bc98190f90ca1715ca9/users/447d9f2994034d96b98376d2caa3532a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:57:58.878957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:58.911493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc344-6ed0-42c7-b027-9baa1d0f9f46 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:59.075612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:59.077740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:59.078441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:59.079110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:59.083297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:59.089493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335883-f1b4-4600-a4dc-dabfedf2a2a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:59.132436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:59.133209 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1817/3607] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:57:59.158966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80726d5-6282-4679-9005-8103ae97909a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:59.173147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:59.176092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:59.177436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:59.177981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] PATH_INFO: `/v3/projects/7f6d535ec9854bc98190f90ca1715ca9/users/447d9f2994034d96b98376d2caa3532a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:59.187406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6d535ec9854bc98190f90ca1715ca9, user_id=447d9f2994034d96b98376d2caa3532a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:59.196686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:59.224183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1791/3608] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:57:59 2022] PUT /identity/v3/projects/7f6d535ec9854bc98190f90ca1715ca9/users/447d9f2994034d96b98376d2caa3532a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:57:59.236075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fab03-aa73-4bc4-b90a-f9a93c20be66 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:59.236489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fab03-aa73-4bc4-b90a-f9a93c20be66 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:59.237044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fab03-aa73-4bc4-b90a-f9a93c20be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:59.314500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-336fab03-aa73-4bc4-b90a-f9a93c20be66 None None] MFA Rules not processed for user `447d9f2994034d96b98376d2caa3532a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:57:59.316199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-336fab03-aa73-4bc4-b90a-f9a93c20be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:59.493355 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1818/3609] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:57:59.531475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:57:59.537316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:57:59.741398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97a9c-5160-400c-adc8-51d3c26c89a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:57:59.745435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:57:59.746094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:57:59.746378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:57:59.746658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:57:59.770266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:57:59.772067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:57:59.792003 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1792/3610] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:00.959701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6181-6156-423b-a01c-27e144ee33d8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:00.960178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6181-6156-423b-a01c-27e144ee33d8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:00.960679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6181-6156-423b-a01c-27e144ee33d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:00.991847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d44e6181-6156-423b-a01c-27e144ee33d8 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:00.995379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d44e6181-6156-423b-a01c-27e144ee33d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:01.123513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1819/3611] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:01.133314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:01.135556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:01.293293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636771c-df33-4964-86ae-dbe475c4526e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:01.300880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:01.301691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:01.302199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:01.302617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:01.314313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:01.316078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:01.327971 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1793/3612] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 20:58:01.809944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b3b1-3dc9-4594-84d2-0807f23a896a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:01.809944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b3b1-3dc9-4594-84d2-0807f23a896a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:01.811374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b3b1-3dc9-4594-84d2-0807f23a896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:01.883608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ad12b3b1-3dc9-4594-84d2-0807f23a896a None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:01.888077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad12b3b1-3dc9-4594-84d2-0807f23a896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:01.924283 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1820/3613] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:01.965758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:01.994387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04dc34-f264-4d81-8bb6-63a3c88be8b7 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:02.024908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:02.025967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:02.031800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:02.032482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:02.072556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:02.094867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:02.162943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1794/3614] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:05.888997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ea5cc-f6f4-4339-b0e3-a6edc721c2c6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:05.890648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ea5cc-f6f4-4339-b0e3-a6edc721c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:05.891121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ea5cc-f6f4-4339-b0e3-a6edc721c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:05.944508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-826ea5cc-f6f4-4339-b0e3-a6edc721c2c6 None None] MFA Rules not processed for user `2e7bca7cae174c2c9b83217ea73a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:05.947776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-826ea5cc-f6f4-4339-b0e3-a6edc721c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:06.117284 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1821/3615] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:09.628267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:09.817454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48134976-51dc-4f2b-8415-71ae40658a46 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:09.831789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:09.833237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:09.833798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:09.834242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] PATH_INFO: `/v3/users/0ab2788d303b4e77afac3137082e39bf` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:09.840237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab2788d303b4e77afac3137082e39bf)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:09.847881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:09.959699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab2788d303b4e77afac3137082e39bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:09.990934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab2788d303b4e77afac3137082e39bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:09.993187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab2788d303b4e77afac3137082e39bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:10.037734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab2788d303b4e77afac3137082e39bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:10.065659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab2788d303b4e77afac3137082e39bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:10.114064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1795/3616] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:09 2022] DELETE /identity/v3/users/0ab2788d303b4e77afac3137082e39bf => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:10.118440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:10.118952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:10.119056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:10.192845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:10.192845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:10.390936 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1822/3617] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:10.456168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:10.459380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:10.635915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79d61-b3bf-4af8-87e9-88d8281bb519 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:10.655422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:10.656561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:10.657103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:10.657618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:10.680076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:10.691003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7697c-054a-4736-96e6-4a226013bbff service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:10.720912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1796/3618] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:12.303772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:12.306762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:12.330482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1125b-dea9-41be-9d9b-0c3b79fc1ef5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:12.335695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:12.337118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:12.337666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:12.338182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] PATH_INFO: `/v3/projects/5eea9d710d914c99bd60dacbc66362b7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:12.339890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eea9d710d914c99bd60dacbc66362b7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:12.342372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:12.423435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eea9d710d914c99bd60dacbc66362b7', 'request_id': 'req-f4cdaf15-5896-4599-9573-0dfff3a69d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.431076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eea9d710d914c99bd60dacbc66362b7', 'request_id': 'req-f4cdaf15-5896-4599-9573-0dfff3a69d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.448654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eea9d710d914c99bd60dacbc66362b7', 'request_id': 'req-f4cdaf15-5896-4599-9573-0dfff3a69d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.456799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:12.457369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:12.457369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:12.489794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] The token cache is being invalidate because project 5eea9d710d914c99bd60dacbc66362b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:12.490094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.490784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.493030 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1823/3619] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:12 2022] DELETE /identity/v3/projects/5eea9d710d914c99bd60dacbc66362b7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:12.496759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:12.498795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:12.507118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] MFA Rules not processed for user `a9953e57681446849124a494fa1cdf44`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:12.512705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:12.577821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdaf15-5896-4599-9573-0dfff3a69d66 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:12.591757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:12.593187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:12.594160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:12.594456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] PATH_INFO: `/v3/users/447d9f2994034d96b98376d2caa3532a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:12.600610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447d9f2994034d96b98376d2caa3532a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:12.603046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:12.672581 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1797/3620] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:12.702167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447d9f2994034d96b98376d2caa3532a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.726559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447d9f2994034d96b98376d2caa3532a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.729079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447d9f2994034d96b98376d2caa3532a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.730977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447d9f2994034d96b98376d2caa3532a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.771490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c56b7430-85ac-42f6-a7c7-f82ee471cd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447d9f2994034d96b98376d2caa3532a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:12.844614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1824/3621] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:12 2022] DELETE /identity/v3/users/447d9f2994034d96b98376d2caa3532a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:14.082552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:14.113913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06323b1-d4c8-4001-8a37-b83e30f715da None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:14.312484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:14.312484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:14.312484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:14.312484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] PATH_INFO: `/v3/projects/7f6d535ec9854bc98190f90ca1715ca9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:14.313031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6d535ec9854bc98190f90ca1715ca9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:14.316882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:14.458030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6d535ec9854bc98190f90ca1715ca9', 'request_id': 'req-87cffbec-e062-49b1-b2dc-cf4c504073ef'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:14.491100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6d535ec9854bc98190f90ca1715ca9', 'request_id': 'req-87cffbec-e062-49b1-b2dc-cf4c504073ef'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:14.502453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6d535ec9854bc98190f90ca1715ca9', 'request_id': 'req-87cffbec-e062-49b1-b2dc-cf4c504073ef'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:14.528408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] The token cache is being invalidate because project 7f6d535ec9854bc98190f90ca1715ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:14.537893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:14.540375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87cffbec-e062-49b1-b2dc-cf4c504073ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:14.545518 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1798/3622] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:14 2022] DELETE /identity/v3/projects/7f6d535ec9854bc98190f90ca1715ca9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:14.550202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:14.551235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:14.551774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:14.577052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:14.579909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:14.687152 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1825/3623] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:14.695577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:14.696487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:14.696845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:14.758737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:14.760199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:14.781730 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1799/3624] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:14.786816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:14.798702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0f27-c49c-4a11-b581-ce29fbeda54f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:14.805821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:14.806849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:14.807214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:14.807595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:14.808444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:14.808898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:14.816722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:14.839313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1826/3625] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:14.844674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:14.857978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb08a-bf3b-4014-9b13-f7a57a8be8d1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:14.866845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:14.867957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:14.868522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:14.869020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:14.870353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:14.873838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:14.921894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1800/3626] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:14 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:14.927451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:14.948622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdec56c-c0a1-4df2-884f-6264c11521f9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:15.031197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:15.031886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.032172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.032470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.033710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:15.035637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:15.059929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1827/3627] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:14 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:15.065331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:15.077381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489521-66f4-47d1-9208-a4c457ad06ce admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:15.094936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:15.097621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.098248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.098773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.099856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:15.102360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:15.115905 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1801/3628] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:15.122274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:15.138117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3227653-b705-4f69-b15c-bcb50c8829fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:15.144233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:15.145780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.146031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.146399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.147362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:15.149049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46345e08-4760-4e03-b4c9-6599932421fe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:15.171185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1828/3629] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:15.175658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:15.185956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4923f-56f6-4bb0-8542-570274749607 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:15.191001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:15.192512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.192885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.193716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] PATH_INFO: `/v3/projects/cdd4166fe44345ed898f38da3ba8431b/users/bcf0abc869ac41e0aa22d5f8c9ccebfc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.210771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd4166fe44345ed898f38da3ba8431b, user_id=bcf0abc869ac41e0aa22d5f8c9ccebfc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:15.213598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:15.234495 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1802/3630] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:15 2022] PUT /identity/v3/projects/cdd4166fe44345ed898f38da3ba8431b/users/bcf0abc869ac41e0aa22d5f8c9ccebfc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:58:15.248221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.248566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.248845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.284537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] MFA Rules not processed for user `bcf0abc869ac41e0aa22d5f8c9ccebfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:15.287402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:15.384118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1829/3631] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:15.396515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:15.398272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:15.496374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e4fa-57a7-4d9e-a714-2b038768e130 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:15.501355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:15.502638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:15.502939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:15.503219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:15.517030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:15.519863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff450d98-9e4a-413e-97cf-41d55a7cf972 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:15.537869 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1803/3632] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:16.424600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:16.547585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314788d-fe1c-4cbc-a188-9d265e30a45d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:16.556734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:16.557235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:16.557526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:16.558669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] PATH_INFO: `/v3/users/bcf0abc869ac41e0aa22d5f8c9ccebfc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:16.560706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf0abc869ac41e0aa22d5f8c9ccebfc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:16.562817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:16.674335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf0abc869ac41e0aa22d5f8c9ccebfc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:16.688953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf0abc869ac41e0aa22d5f8c9ccebfc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:16.690295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf0abc869ac41e0aa22d5f8c9ccebfc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:16.690974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf0abc869ac41e0aa22d5f8c9ccebfc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:16.707013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf0abc869ac41e0aa22d5f8c9ccebfc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:16.746813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653283e-7a8d-4a87-b3c3-640001af086e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:16.747860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653283e-7a8d-4a87-b3c3-640001af086e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:16.748312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653283e-7a8d-4a87-b3c3-640001af086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:16.750442 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1830/3633] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:16 2022] DELETE /identity/v3/users/bcf0abc869ac41e0aa22d5f8c9ccebfc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:16.774277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2653283e-7a8d-4a87-b3c3-640001af086e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:16.777349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2653283e-7a8d-4a87-b3c3-640001af086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:16.845442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1804/3634] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:16.855726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:16.857331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:16.900681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:16.901221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:16.901672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:16.937328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] MFA Rules not processed for user `449253ed73e04f47bcd09c3a1cca6e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:16.940569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:16.964259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c65aa-890f-4b3b-b76a-9d523577254f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:16.968438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:16.970894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:16.971618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:16.971618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:16.982665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:16.984040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:16.996585 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1831/3635] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:17.031863 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1805/3636] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:17.039797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:17.041844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:17.176359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83574-f2e3-4d2e-93c9-f358f8f04e6f service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:17.186296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:17.187830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:17.188806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:17.193110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:17.215844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:17.217619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6030e-5d5c-4653-9506-7dd01ce90c92 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:17.233415 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1832/3637] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:17.679507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:17.681152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:17.702452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242f26a-41a3-4ceb-bfc6-930c01d1d614 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:17.708721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:17.710948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:17.710948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:17.711205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] PATH_INFO: `/v3/projects/cdd4166fe44345ed898f38da3ba8431b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:17.715105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd4166fe44345ed898f38da3ba8431b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:17.718729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:17.817165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd4166fe44345ed898f38da3ba8431b', 'request_id': 'req-c3ceae09-d018-4c69-91c2-3b4b7a03309b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:17.833828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd4166fe44345ed898f38da3ba8431b', 'request_id': 'req-c3ceae09-d018-4c69-91c2-3b4b7a03309b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:17.849915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd4166fe44345ed898f38da3ba8431b', 'request_id': 'req-c3ceae09-d018-4c69-91c2-3b4b7a03309b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:17.873225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] The token cache is being invalidate because project cdd4166fe44345ed898f38da3ba8431b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:17.875949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:17.876276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3ceae09-d018-4c69-91c2-3b4b7a03309b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:17.878613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1806/3638] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:17 2022] DELETE /identity/v3/projects/cdd4166fe44345ed898f38da3ba8431b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:17.883573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983d88-c73d-48bc-b880-c37366592869 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:17.884442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983d88-c73d-48bc-b880-c37366592869 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:17.884923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983d88-c73d-48bc-b880-c37366592869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:17.920018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05983d88-c73d-48bc-b880-c37366592869 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:17.922551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05983d88-c73d-48bc-b880-c37366592869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:18.023976 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1833/3639] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:18.031822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.032427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.032915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.065202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:18.066858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:18.076994 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1807/3640] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:18.081688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05983d88-c73d-48bc-b880-c37366592869 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.095012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05983d88-c73d-48bc-b880-c37366592869 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.104067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.105319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.105845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.106293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.107373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:18.107921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.110606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.129612 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1834/3641] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:18.133576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.145812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df0c89-aebe-4bfa-b355-164a6e330beb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.152690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.153701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.154178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.154640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.156256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.158474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.194802 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1808/3642] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:18 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:18.199307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.214702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e42db-47cf-4daf-becf-11e576766683 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.312391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.313550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.314186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.315292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.316368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.318591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.350744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1835/3643] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:18 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:18.354765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.376027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0615feb-ac55-4103-a0e9-7a9875377b97 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.383886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.385801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.386394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.386837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.388054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.390186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.407454 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1809/3644] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:18.411099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.422387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b14c0e-87ea-499e-a5bd-675fbd8e90e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.429170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.429952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.430292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.430786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.431468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.435233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbd76d-77fd-4e0e-9294-840ef8b86211 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.458541 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1836/3645] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:18.460051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.481466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4569-6134-4649-9812-74ee6b0eb11a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:18.494771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:18.496357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.496936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.497965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] PATH_INFO: `/v3/projects/64b74a57fede4f16be49ff815f0ba74b/users/27ab71996ffa44ef830b360ea2c75fe3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.524017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b74a57fede4f16be49ff815f0ba74b, user_id=27ab71996ffa44ef830b360ea2c75fe3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:18.528525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:18.563312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1810/3646] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:18 2022] PUT /identity/v3/projects/64b74a57fede4f16be49ff815f0ba74b/users/27ab71996ffa44ef830b360ea2c75fe3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:18.565588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:18.565894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:18.566182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:18.609932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] MFA Rules not processed for user `27ab71996ffa44ef830b360ea2c75fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:18.611923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:18.734548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1837/3647] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:18.835487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:18.837310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:19.013712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7564d-4480-44ab-a615-b39c875d8e0e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:19.020039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:19.020731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:19.021016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:19.021291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:19.057162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:19.058847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e8677-d1a3-47a2-8240-6b850f0235aa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:19.071207 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1811/3648] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:19.120633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:19.297032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc757e50-d00d-4565-b111-78a90ff22337 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:19.302641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:19.303754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:19.304137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:19.304710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] PATH_INFO: `/v3/users/27ab71996ffa44ef830b360ea2c75fe3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:19.306925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ab71996ffa44ef830b360ea2c75fe3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:19.309218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:19.392362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ab71996ffa44ef830b360ea2c75fe3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:19.410684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ab71996ffa44ef830b360ea2c75fe3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:19.411515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ab71996ffa44ef830b360ea2c75fe3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:19.412520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ab71996ffa44ef830b360ea2c75fe3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:19.421287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ab71996ffa44ef830b360ea2c75fe3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:19.468049 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1838/3649] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:19 2022] DELETE /identity/v3/users/27ab71996ffa44ef830b360ea2c75fe3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:19.473607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:19.473956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:19.474245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:19.498477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:19.499900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:19.636172 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1812/3650] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:19.667739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:19.669217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:19.794162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036de75-3d44-40c3-8308-aa5cb8574c14 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:19.800792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:19.802166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:19.802457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:19.803051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:19.817984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:19.824660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4a8a-8521-4330-a73b-e0ef85992411 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:19.839294 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1839/3651] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:21.089883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:21.091603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:21.111350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f746bb2-1f5a-4ef6-b2e8-6482dac3c73a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:21.141677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:21.144217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:21.145127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:21.148402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] PATH_INFO: `/v3/projects/64b74a57fede4f16be49ff815f0ba74b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:21.151276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b74a57fede4f16be49ff815f0ba74b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:21.153504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:21.294938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b74a57fede4f16be49ff815f0ba74b', 'request_id': 'req-d8ab800b-f8f6-42f0-baea-3187afe994cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:21.304983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b74a57fede4f16be49ff815f0ba74b', 'request_id': 'req-d8ab800b-f8f6-42f0-baea-3187afe994cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:21.321261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b74a57fede4f16be49ff815f0ba74b', 'request_id': 'req-d8ab800b-f8f6-42f0-baea-3187afe994cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:21.386809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] The token cache is being invalidate because project 64b74a57fede4f16be49ff815f0ba74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:21.390803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:21.392114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8ab800b-f8f6-42f0-baea-3187afe994cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:21.395480 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1813/3652] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:21 2022] DELETE /identity/v3/projects/64b74a57fede4f16be49ff815f0ba74b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:58:21.400781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:21.401235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:21.401235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:21.456057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:21.457345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:21.724510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1840/3653] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:21.733083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:21.733754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:21.734261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:21.781599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:21.783308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:21.799842 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1814/3654] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:21.804283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:21.817936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53143e6-03e5-458b-8955-22d18ad622b7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:21.834196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:21.834990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:21.835364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:21.835871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:21.836721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:21.837105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:21.838830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:21.855985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1841/3655] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:21.857200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:21.868036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82c569-a832-44d4-8c42-80923680e19e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:21.875025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:21.875788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:21.876149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:21.876550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:21.877557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:21.879564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6eff2-2edb-49be-b826-a3f1474d23a6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:21.943640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1815/3656] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:21 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:58:21.945843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:21.963366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a428a5-e69e-4a17-b609-757886850884 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:22.121944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.122855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.124196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.152749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] MFA Rules not processed for user `c1d982c5db7e47a6ae521f2137af3204`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:22.154963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:22.180024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:22.181079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.181620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.182101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.183021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:22.186038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:22.239301 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1842/3657] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:21 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:22.240498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1816/3658] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:22.243245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:22.255392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e72-ada2-4c50-b0c9-def6cfe3cea8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:22.261131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:22.261807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.262087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.262345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.263129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:22.265226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf280f4-6664-48fd-bc7d-d38d5cfb4c78 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:22.280830 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1843/3659] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:58:22.285369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:22.319517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1983b-a9ea-4457-b0a9-c55e3d7c93fa None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:22.330879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:22.331672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.332034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.332390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.334582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:22.336294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:22.347162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.347526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.347899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.377042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] MFA Rules not processed for user `449253ed73e04f47bcd09c3a1cca6e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:22.379294 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1817/3660] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:22.380015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:22.385832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:22.410123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ad2-cb21-4d7e-beab-f30f3778ab45 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:22.424171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:22.425408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.425859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.426316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] PATH_INFO: `/v3/projects/94de7d95b2594f7f9ca0182d57ae454a/users/feb6004edca04f8196301828a4967803/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.452110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94de7d95b2594f7f9ca0182d57ae454a, user_id=feb6004edca04f8196301828a4967803, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:22.458186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc070f6-080a-442e-b231-56d878d0da1e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:22.491689 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1818/3661] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:22 2022] PUT /identity/v3/projects/94de7d95b2594f7f9ca0182d57ae454a/users/feb6004edca04f8196301828a4967803/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:22.504976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.505617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.506096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.539753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1844/3662] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:22.591536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] MFA Rules not processed for user `feb6004edca04f8196301828a4967803`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:22.592823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:22.749377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:22.756987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1819/3663] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:22.766244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352a8d8-0e73-4660-bae9-b6ec90c44ce1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:22.883966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:22.884881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:22.885330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:22.885655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:22.886694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:22.889192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:22.931425 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1845/3664] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:22 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:22.936534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:22.951731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb2070-8063-49d1-a630-3454f919b748 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.016778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.018135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.022046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.022572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.023519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.026341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.065416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.065631 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1820/3665] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:22 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:23.084313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bcf0c-f759-4970-a180-24e4c1ed7161 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.092059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.092929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.093304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.093710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.094930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.097803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.116278 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1846/3666] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:23.118110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.137935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949efb0f-e06b-4da1-85a2-2d90311fc865 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.147344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.149330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.150353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.152133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] PATH_INFO: `/v3/projects/63dee14720e449859a21030c16100cf4/users/61eb80f157934e1d962a9cc24f5c1af1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.196339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dee14720e449859a21030c16100cf4, user_id=61eb80f157934e1d962a9cc24f5c1af1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.199398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.226996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1821/3667] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:23 2022] PUT /identity/v3/projects/63dee14720e449859a21030c16100cf4/users/61eb80f157934e1d962a9cc24f5c1af1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:23.228388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.246924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd91691-47ea-44e6-bb39-38f87324daa1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.360263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.360874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.361162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.361479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.362205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.367927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836d5a3-9e31-41ee-b839-81e4a23f809e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.393597 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1847/3668] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:23.396593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.413242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fda6e-7826-489b-ae1a-94078768aae8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.419010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.420049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.420400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.420766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] PATH_INFO: `/v3/projects/63dee14720e449859a21030c16100cf4/users/61eb80f157934e1d962a9cc24f5c1af1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.423214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dee14720e449859a21030c16100cf4, user_id=61eb80f157934e1d962a9cc24f5c1af1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.428536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.456875 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1822/3669] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:23 2022] PUT /identity/v3/projects/63dee14720e449859a21030c16100cf4/users/61eb80f157934e1d962a9cc24f5c1af1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:23.468304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.468657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.468905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.516190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] MFA Rules not processed for user `61eb80f157934e1d962a9cc24f5c1af1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:23.518258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:23.648807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1848/3670] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:23.660556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.662523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:23.769111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b34470-90c7-4949-b5be-5d5c98c55afa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.779959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.780729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.781147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.781332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:23.793928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:23.798551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbffb29-8d88-45bd-bf59-ac73cb89243e service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:23.816037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1823/3671] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:23.950347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:23.964241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7947bf-edbe-4c54-9934-af6695845bee None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:23.968510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:23.969355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:23.969857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:23.970320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:24.068931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:24.078909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:24.106348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1849/3672] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:24.321843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ad58-c258-4e3b-9694-e06276b4078d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:24.322324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ad58-c258-4e3b-9694-e06276b4078d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:24.322425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ad58-c258-4e3b-9694-e06276b4078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:24.364324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ffa3ad58-c258-4e3b-9694-e06276b4078d None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:24.365620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffa3ad58-c258-4e3b-9694-e06276b4078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:24.520840 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1824/3673] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:24.544528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:24.547351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:24.681467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cfdb6-1d90-41ef-97fb-b0c9d9495349 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:24.691365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:24.692781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:24.694133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:24.694690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:24.724678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:24.727468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af53fd-cae8-4d49-87bd-b31f14cdfff2 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:24.751700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1850/3674] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:28.078537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:28.079496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:28.080585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:28.083680 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1825/3675] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:58:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:28.089382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:28.089913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:28.089913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:28.124898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:28.126152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:28.270061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1851/3676] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:28.302478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:28.304990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:28.339635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19e257-18bf-4331-81a7-1f90d185df66 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:28.351499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:28.352368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:28.352786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:28.353179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:28.369696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:28.372868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:28.393600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1826/3677] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:28.661512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:28.692391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f3133-ab6c-4cdd-977c-50f953a7f315 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:28.706661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:28.707335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:28.707624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:28.707893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:28.711829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:28.731559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:28.733806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:28.746913 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1852/3678] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:29.412252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:29.416371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:29.522695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039905bf-7271-4ee4-9214-d6f3e261ad81 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:29.540834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:29.541630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:29.541987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:29.542334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:29.544817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:29.682041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:29.683493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801034bb-27b7-4c4a-bd25-2651b60f710e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:29.703878 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1827/3679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:29.807261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:29.823156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de520fa-f4ee-49dc-a59c-6d656f1a4277 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:29.829254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:29.830044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:29.830445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:29.830724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:29.842787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:29.863704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:29.865222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:29.879582 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1853/3680] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:33.065853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98696-c464-4de7-af2b-cb86271a6f8b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:33.066303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98696-c464-4de7-af2b-cb86271a6f8b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:33.066844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98696-c464-4de7-af2b-cb86271a6f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:33.087421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d7b98696-c464-4de7-af2b-cb86271a6f8b None None] MFA Rules not processed for user `821ac6c697bc4706ad36b8be4e9276a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:33.088905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d7b98696-c464-4de7-af2b-cb86271a6f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:33.157912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1828/3681] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:33.883125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:33.884795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:33.905764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca93594-695e-4cc9-9f54-e9254bf22734 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:33.912950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:33.913680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:33.914034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:33.914372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:33.917097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:34.031782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:34.034066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768440-8ebc-47b3-a7a8-b6b327d2f3e1 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:34.063551 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1854/3682] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:36.658009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:36.658514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:36.658700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:36.660953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1829/3683] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:36.667091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ca40-7106-4452-b2d6-375040f3dc37 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:36.667987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ca40-7106-4452-b2d6-375040f3dc37 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:36.668308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1ca40-7106-4452-b2d6-375040f3dc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:36.690810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-12e1ca40-7106-4452-b2d6-375040f3dc37 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:36.692260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12e1ca40-7106-4452-b2d6-375040f3dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:36.708564 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1855/3684] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:36.727317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:36.729100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:36.750881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456276-fe7a-43c9-80b9-169704f1117f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:36.757967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:36.758643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:36.759030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:36.759318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:36.774884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:36.777080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ea5ab-43cd-4511-a70c-25ac9faa9eb8 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:36.809551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1830/3685] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:37.405302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317ac6-dadf-4c75-9cde-51bce9e9a434 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:37.405747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317ac6-dadf-4c75-9cde-51bce9e9a434 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:37.406117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317ac6-dadf-4c75-9cde-51bce9e9a434 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:37.408649 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1856/3686] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:37.416231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:37.416890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:37.417281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:37.451912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:37.456230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:37.472061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1831/3687] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:37.492732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317ac6-dadf-4c75-9cde-51bce9e9a434 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:37.515048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317ac6-dadf-4c75-9cde-51bce9e9a434 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:37.522895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:37.523565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:37.523852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:37.524134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:37.540974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:37.543901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad3fd7-9bb2-4250-8482-286498d94307 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:37.563810 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1857/3688] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:49.520916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:49.524216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:49.639228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb04e1-2f06-4fac-acd9-a65b548698ab None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:49.644892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:49.646075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:49.646560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:49.646860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] PATH_INFO: `/v3/users/ee8c4a666eb94960b71b0353d32b5f67` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:49.648107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8c4a666eb94960b71b0353d32b5f67)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:49.650109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:49.709750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8c4a666eb94960b71b0353d32b5f67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:49.723402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8c4a666eb94960b71b0353d32b5f67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:49.724396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8c4a666eb94960b71b0353d32b5f67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:49.733520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8c4a666eb94960b71b0353d32b5f67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:49.742236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8c4a666eb94960b71b0353d32b5f67'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:49.755766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1832/3689] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:49 2022] DELETE /identity/v3/users/ee8c4a666eb94960b71b0353d32b5f67 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:49.839575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0713f2-1657-4756-b777-e33360417fc1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:49.840058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0713f2-1657-4756-b777-e33360417fc1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:49.840174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0713f2-1657-4756-b777-e33360417fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:49.858535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3f0713f2-1657-4756-b777-e33360417fc1 None None] MFA Rules not processed for user `4eaee1ddad0041828fb2e65677e2da25`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:49.859762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f0713f2-1657-4756-b777-e33360417fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:49.919109 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1858/3690] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:50.026620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.028048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:50.147378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11de28-310c-4ca0-a873-22b3e241e08a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.158046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.159855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.160430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.161317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] PATH_INFO: `/v3/projects/99e28f04f7dd4777891efe100377f141` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.163481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e28f04f7dd4777891efe100377f141)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.166836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.231555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e28f04f7dd4777891efe100377f141', 'request_id': 'req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:50.239785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e28f04f7dd4777891efe100377f141', 'request_id': 'req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:50.246557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e28f04f7dd4777891efe100377f141', 'request_id': 'req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:50.272479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] The token cache is being invalidate because project 99e28f04f7dd4777891efe100377f141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:50.272758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:50.273672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a805a11a-4f7d-48c7-b300-7bb7e801e6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:50.275539 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1833/3691] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:50 2022] DELETE /identity/v3/projects/99e28f04f7dd4777891efe100377f141 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:50.280268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.280591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.280872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.303091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:50.304306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:50.379689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1859/3692] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:50.386960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.388889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.389429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.414526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:50.415825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:50.429076 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1834/3693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:50.429685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.448759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9037430-17ce-48ec-9cdd-39df9e9d7817 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.468448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.469421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.469794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.470072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.470799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:50.471449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.473808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.486565 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1860/3694] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:58:50.491832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.504217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fe4b0-50ff-4e83-852f-a20b61fda28f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.509628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.510247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.510540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.510821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.511520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.513632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.565406 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1835/3695] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:50 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:50.569624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.581424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8bcfa-9312-4885-8013-be5c164fed3a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.661789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.662435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.662730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.663015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.663719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.665905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.704559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1861/3696] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:50 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:58:50.706036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.718823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d74cca-a3f8-4dce-84d1-4d21eb6f678c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.724606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.725381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.725767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.726141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.726958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.729210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.745109 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1836/3697] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:58:50.746399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.760441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15469a-432b-43d7-9f9b-eed181af4ed1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.766362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.767360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.767656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.770751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.771912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.773626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d813d43-61c4-444e-82c9-3ce65bed8649 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.796395 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1862/3698] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:50.800907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:50.821154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf56b-742a-4b58-a4c8-b562d9db1bab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:50.827829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:50.829021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.829851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.830239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] PATH_INFO: `/v3/projects/2ea9b15425794ef6b5d2cafb92421ea5/users/5d177b495a0a4da8b0b853db440d912a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.876861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea9b15425794ef6b5d2cafb92421ea5, user_id=5d177b495a0a4da8b0b853db440d912a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:50.882940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:50.922825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61f9-86ce-4199-8c77-9c0428fe696f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:50.923368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61f9-86ce-4199-8c77-9c0428fe696f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:50.923555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a61f9-86ce-4199-8c77-9c0428fe696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:50.923962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1837/3699] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:50 2022] PUT /identity/v3/projects/2ea9b15425794ef6b5d2cafb92421ea5/users/5d177b495a0a4da8b0b853db440d912a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:58:50.959890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d28a61f9-86ce-4199-8c77-9c0428fe696f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:50.961842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d28a61f9-86ce-4199-8c77-9c0428fe696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:51.138817 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1863/3700] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:51.150199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:51.151958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:51.242969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3612b97-b3c6-46cb-b447-314df072c050 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:51.250048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:51.250925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:51.251087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:51.251665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:51.266305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:51.268005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:51.281374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1838/3701] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:52.546701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:52.547736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:52.548020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:52.626138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] MFA Rules not processed for user `5d177b495a0a4da8b0b853db440d912a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:52.627585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:52.785420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1864/3702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:53.898213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:53.911244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009d68-508a-4709-9cda-8e6e515b616e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:53.916523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:53.917414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:53.917702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:53.917980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] PATH_INFO: `/v3/users/5d177b495a0a4da8b0b853db440d912a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:53.919227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d177b495a0a4da8b0b853db440d912a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:53.921217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:53.968243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d177b495a0a4da8b0b853db440d912a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:53.980691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d177b495a0a4da8b0b853db440d912a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:53.981384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d177b495a0a4da8b0b853db440d912a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:53.989836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d177b495a0a4da8b0b853db440d912a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:53.997893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb14870d-f11f-4f2e-ae9c-157fbe6dc1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d177b495a0a4da8b0b853db440d912a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.004762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1839/3703] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:53 2022] DELETE /identity/v3/users/5d177b495a0a4da8b0b853db440d912a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:54.278039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.290988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ed480-f6ba-4236-8045-e524ef32c680 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.369802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.370833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.371122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.371755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] PATH_INFO: `/v3/projects/2ea9b15425794ef6b5d2cafb92421ea5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.374148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea9b15425794ef6b5d2cafb92421ea5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:54.376072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:54.436653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea9b15425794ef6b5d2cafb92421ea5', 'request_id': 'req-f2a1e83f-0159-4363-865e-d5d2cc15279d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.446743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea9b15425794ef6b5d2cafb92421ea5', 'request_id': 'req-f2a1e83f-0159-4363-865e-d5d2cc15279d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.459019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea9b15425794ef6b5d2cafb92421ea5', 'request_id': 'req-f2a1e83f-0159-4363-865e-d5d2cc15279d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.473781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] The token cache is being invalidate because project 2ea9b15425794ef6b5d2cafb92421ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:54.474431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.476148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f2a1e83f-0159-4363-865e-d5d2cc15279d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:54.478111 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1865/3704] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:54 2022] DELETE /identity/v3/projects/2ea9b15425794ef6b5d2cafb92421ea5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:54.483510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.484264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.484570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.515597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:54.517209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:54.626968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1840/3705] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:54.629592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.629743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.630026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.651047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:54.652264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:54.661030 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1866/3706] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:54.665434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.675927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7efe4-b31f-436e-b024-0d79d30088aa None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.681662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.682477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.682771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.683052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.683780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:54.684094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:54.685753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:54.698609 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1841/3707] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:54.703042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.712441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4e6ad-bd84-49a4-b251-8ac46ee895b3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.717267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.717991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.718340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.718703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.720263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:54.722738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:54.761628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1867/3708] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:54 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:58:54.767422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.783964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fe09d-97d5-46f5-ab3a-2fc68658b99f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.871094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.871798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.872087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.872540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.873235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:54.875614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:54.914671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1842/3709] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:54 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:54.915567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.930868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe018-9a32-432d-95f7-9d986229ca55 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.936151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.937307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.937796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.938267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.939253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:54.942263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:54.966358 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1868/3710] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:58:54.968951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:54.983119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116eb9-43a2-4907-85ef-754ee57113cd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:54.996234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:54.997452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:54.997867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:54.998865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:54.999572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.002578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f6d2-f6cd-4bb6-9af6-bd84ed64cdc4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.023703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1843/3711] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:55.028496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.056289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918fd30-d5d5-488e-a714-03d07542d136 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.061112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.062009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.062668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.062951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c/users/fd55b213e5f34c66bc9f05467f9f9ae1/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.086782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f97674b4e954fd084f6a1286ca2960c, user_id=fd55b213e5f34c66bc9f05467f9f9ae1, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.089471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.124621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1869/3712] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:55 2022] PUT /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c/users/fd55b213e5f34c66bc9f05467f9f9ae1/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:55.135226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958a5e-71e7-4fab-b6d6-72969a688bb9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.135820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958a5e-71e7-4fab-b6d6-72969a688bb9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.136278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f958a5e-71e7-4fab-b6d6-72969a688bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.181888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1f958a5e-71e7-4fab-b6d6-72969a688bb9 None None] MFA Rules not processed for user `fd55b213e5f34c66bc9f05467f9f9ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:55.186818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1f958a5e-71e7-4fab-b6d6-72969a688bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:55.276099 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1844/3713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:55.282326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.285057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:55.375893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566591cc-8883-4c48-a3f1-832a24eebd53 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.382736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.383497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.384000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.384357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.394553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.396831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.412897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1870/3714] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:55.423237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f4ece-7965-426f-ab7f-e4d19572dda8 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.423565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f4ece-7965-426f-ab7f-e4d19572dda8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.423851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f4ece-7965-426f-ab7f-e4d19572dda8 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.426565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1845/3715] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:55.436634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:58:55.457228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.471741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273a74d-448e-4a01-828b-d59b5fac11f7 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.478987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd55b213e5f34c66bc9f05467f9f9ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f97674b4e954fd084f6a1286ca2960c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.480200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.480624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.480999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.482963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorizing `identity:get_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.485140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.488584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1871/3716] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 365 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:55.521499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b2a5-4bd2-44ba-96c3-08bc6f0316c3 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.522212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b2a5-4bd2-44ba-96c3-08bc6f0316c3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.522491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b2a5-4bd2-44ba-96c3-08bc6f0316c3 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.525697 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1846/3717] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:55.532088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:58:55.547031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.556061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e782d-cf71-4369-9578-b09fe2b0eb84 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.560324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd55b213e5f34c66bc9f05467f9f9ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f97674b4e954fd084f6a1286ca2960c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.561213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.561494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.561766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.562934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorizing `identity:get_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.565031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.566787 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1872/3718] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 365 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:55.611746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559f02-9595-49d8-9348-01577ffe210e None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.612032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559f02-9595-49d8-9348-01577ffe210e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.613101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5559f02-9595-49d8-9348-01577ffe210e None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.615030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1847/3719] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:55.620235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:58:55.622119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:55.640089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.649918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017b01-f017-43eb-80d7-ac56d854456e tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.654164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd55b213e5f34c66bc9f05467f9f9ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f97674b4e954fd084f6a1286ca2960c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.655093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.655383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.655899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.657336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorizing `identity:get_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.659788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.661813 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1873/3720] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 365 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:55.846414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4807-ef77-4b62-8592-aedcfae418fa None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.846838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4807-ef77-4b62-8592-aedcfae418fa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.847188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4807-ef77-4b62-8592-aedcfae418fa None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.849305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1848/3721] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:55.855879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:58:55.871365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.880092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97710aa-09e6-4f06-80c2-ad180b775397 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.884312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd55b213e5f34c66bc9f05467f9f9ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f97674b4e954fd084f6a1286ca2960c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.885421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.885937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.886413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.887837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorizing `identity:get_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.889882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.891816 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1874/3722] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 365 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:55.926442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d203-a15a-4a97-89a3-d0bf2bf1db47 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.926948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d203-a15a-4a97-89a3-d0bf2bf1db47 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.927075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d203-a15a-4a97-89a3-d0bf2bf1db47 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.928836 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1849/3723] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 20:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:58:55.933538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 20:58:55.949562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:55.958812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05117-1b87-43b5-b587-60a1f2866df9 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:55.964817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd55b213e5f34c66bc9f05467f9f9ae1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f97674b4e954fd084f6a1286ca2960c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:55.966032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:55.966384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:55.966729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:55.968004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorizing `identity:get_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:55.969890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53f73d-eb68-4697-8c22-75242ca4e88f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:55.971948 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1875/3724] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 20:58:55 2022] GET /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 365 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:56.001392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d203-a15a-4a97-89a3-d0bf2bf1db47 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:56.080421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d203-a15a-4a97-89a3-d0bf2bf1db47 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:56.086120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:56.087929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.088849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.088849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] PATH_INFO: `/v3/users/fd55b213e5f34c66bc9f05467f9f9ae1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.090166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd55b213e5f34c66bc9f05467f9f9ae1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:56.092203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:56.153997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd55b213e5f34c66bc9f05467f9f9ae1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.169541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd55b213e5f34c66bc9f05467f9f9ae1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.170482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd55b213e5f34c66bc9f05467f9f9ae1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.179965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd55b213e5f34c66bc9f05467f9f9ae1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.189017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd55b213e5f34c66bc9f05467f9f9ae1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.196795 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1850/3725] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:56 2022] DELETE /identity/v3/users/fd55b213e5f34c66bc9f05467f9f9ae1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:56.201190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.201485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.201892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.221584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:56.222494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:56.301609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1876/3726] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:56.311787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:56.313903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:56.379597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824fd9-3d85-43d9-a0be-1bf9fbebd979 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:56.383396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:56.384015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.384305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.384623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.395255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:56.397044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b1b24-6a3f-4acb-bbbf-152b6932cada service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:56.410164 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1851/3727] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:56.742750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:56.744307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:56.759336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757d311-1f4a-42c3-bb31-4bf7c8d72b5b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:56.765306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:56.766490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.766764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.769196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] PATH_INFO: `/v3/projects/7f97674b4e954fd084f6a1286ca2960c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.771388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f97674b4e954fd084f6a1286ca2960c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:56.773714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:56.834841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f97674b4e954fd084f6a1286ca2960c', 'request_id': 'req-9ca6f381-b7a2-4b14-aff3-b8d25c453322'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.840934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f97674b4e954fd084f6a1286ca2960c', 'request_id': 'req-9ca6f381-b7a2-4b14-aff3-b8d25c453322'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.849387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f97674b4e954fd084f6a1286ca2960c', 'request_id': 'req-9ca6f381-b7a2-4b14-aff3-b8d25c453322'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.860635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] The token cache is being invalidate because project 7f97674b4e954fd084f6a1286ca2960c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:56.860933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.861559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ca6f381-b7a2-4b14-aff3-b8d25c453322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:56.863469 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1877/3728] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:56 2022] DELETE /identity/v3/projects/7f97674b4e954fd084f6a1286ca2960c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:56.869855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.870223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.870589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.890997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:56.892195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:56.955124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1852/3729] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:56.963938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:56.964377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:56.964925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:56.984736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:56.986195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:56.994986 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1878/3730] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:56.999285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.011377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e372-6fe5-4889-9952-b2a11bc7ff6b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.028658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.031106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.031606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.033610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.035355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:57.039508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.039508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.053985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1853/3731] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:58:57.058091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.069142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec322c-8efb-4188-bd3a-8150a237208a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.074613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.075439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.075794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.076172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.076953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.078919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.106427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1879/3732] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:57 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:58:57.110347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.120297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab2aa2-8f13-4607-99b3-ac86ad366929 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.179808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.180506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.180790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.181065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.181767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.183686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.209074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1854/3733] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:58:57 2022] POST /identity/v3/users => generated 280 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:58:57.222187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.243597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8938bb-4cc9-405e-b968-73f49653261a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.254273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.256178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.256486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.258033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.258782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.262308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.282112 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1880/3734] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:57.288904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.301785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4354b3-46e2-4cb6-9a16-3b0d3989ef62 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.308193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.309049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.309452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.309829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.310645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.312371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe9225-e49f-444a-8c6d-7ef50eca3cf0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.325527 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1855/3735] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:58:57.329506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:57.341902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96511-2fb7-4fd0-818f-46420bff54d3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:57.348317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:57.349867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.350376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.350882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] PATH_INFO: `/v3/projects/602405f7635540478e3ab12108811d61/users/3f7aaf2b3a29419e8d2227333f2673a6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.367112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=602405f7635540478e3ab12108811d61, user_id=3f7aaf2b3a29419e8d2227333f2673a6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:57.370483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:57.391475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1881/3736] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:58:57 2022] PUT /identity/v3/projects/602405f7635540478e3ab12108811d61/users/3f7aaf2b3a29419e8d2227333f2673a6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:57.403607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05102-6394-439a-a099-1522d16f1516 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:57.404038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05102-6394-439a-a099-1522d16f1516 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:57.404447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05102-6394-439a-a099-1522d16f1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:57.470641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-91a05102-6394-439a-a099-1522d16f1516 None None] MFA Rules not processed for user `3f7aaf2b3a29419e8d2227333f2673a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:57.472045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-91a05102-6394-439a-a099-1522d16f1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:57.598059 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1856/3737] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:58.048951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:58.140094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7a77-1722-4909-8601-89b6bde1f74b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:58.146292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:58.146900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:58.147180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:58.147451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] PATH_INFO: `/v3/users/3f7aaf2b3a29419e8d2227333f2673a6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:58.149171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7aaf2b3a29419e8d2227333f2673a6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:58.151443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:58.225175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7aaf2b3a29419e8d2227333f2673a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:58.234511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7aaf2b3a29419e8d2227333f2673a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:58.235283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7aaf2b3a29419e8d2227333f2673a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:58.235954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7aaf2b3a29419e8d2227333f2673a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:58.247276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7aaf2b3a29419e8d2227333f2673a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:58.267829 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1882/3738] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:58:58 2022] DELETE /identity/v3/users/3f7aaf2b3a29419e8d2227333f2673a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:58.272164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:58.272707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:58.272823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:58.290616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:58.291752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:58.353785 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1857/3739] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:58.365329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:58.366816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:58.427584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec40797-c171-41b4-9bfb-7c1191795fe9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:58.431574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:58.432233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:58.432950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:58.432950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:58.444026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:58.445783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7e53-ac06-4813-b9a7-0bdc8b1fb825 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:58.456232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1883/3740] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:58:59.512432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:59.514594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:59.535822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6277fa-1d77-4668-a9c1-d7387bc6697e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:59.553431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:59.554814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:59.555204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:59.555642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] PATH_INFO: `/v3/projects/602405f7635540478e3ab12108811d61` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:59.557795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=602405f7635540478e3ab12108811d61)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:59.559840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:59.660016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602405f7635540478e3ab12108811d61', 'request_id': 'req-420182ec-c83c-45fa-8e71-dd6735ace1de'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:59.667682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602405f7635540478e3ab12108811d61', 'request_id': 'req-420182ec-c83c-45fa-8e71-dd6735ace1de'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:59.676186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602405f7635540478e3ab12108811d61', 'request_id': 'req-420182ec-c83c-45fa-8e71-dd6735ace1de'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:59.699430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] The token cache is being invalidate because project 602405f7635540478e3ab12108811d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:58:59.700348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:59.701421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-420182ec-c83c-45fa-8e71-dd6735ace1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:58:59.709119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:59.709753 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1858/3741] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:59 2022] DELETE /identity/v3/projects/602405f7635540478e3ab12108811d61 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:58:59.710020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:59.710299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:59.750633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:59.752719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:59.860873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:59.861712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:59.862631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:59.867600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1884/3742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:58:59.890576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:58:59.892302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:58:59.913264 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1859/3743] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:58:59.917202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:58:59.932380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacc365-ad66-47bf-931b-596823a4de64 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:58:59.938560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:58:59.942150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:58:59.942662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:58:59.943187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:58:59.947443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:58:59.949222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:58:59.952895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:58:59.981176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1885/3744] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:58:59.988660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.006270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7981510-f346-4661-992c-8282b49cc2f5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.008758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.011912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:00.014198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.014935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.015578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.015866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.017378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.020630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.089284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1860/3745] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:58:59 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:00.092905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.103844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253f6f-cffb-42de-90ea-4ba25bc98389 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.171975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.176062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.176694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.177248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.182447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:00.224823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4042676-dab8-4540-b453-dcb3142a69df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.231732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.232663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.233122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.233500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.234414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.236664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.282622 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1861/3746] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:00 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:00.286902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.306243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e18c-a2ec-4819-b172-67f00b34c64c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.310201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.312154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.322524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.323227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.323571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.323794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.324561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.326171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.329880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1886/3747] 10.222.0.18 () {60 vars in 1396 bytes} [Sat Apr 2 20:59:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:00.348501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1862/3748] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:00.350277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.367538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f654c-d6ad-4ff7-a625-a13ee890e762 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.381278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.384315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.384626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.385883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.386618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.388591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435af9c-4db2-45e8-9f3e-158cfe0d5636 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.428420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1887/3749] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:00.429846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.450064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ccdee-5307-4738-91d4-ea691a801257 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.460317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.461514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.461800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.462085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] PATH_INFO: `/v3/projects/2a4f1507b69e40c8ace9eac029f1ced2/users/eaa8ffe0235f4759bdb071a51ad51410/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.485078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4f1507b69e40c8ace9eac029f1ced2, user_id=eaa8ffe0235f4759bdb071a51ad51410, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.488441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.513938 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1863/3750] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:00 2022] PUT /identity/v3/projects/2a4f1507b69e40c8ace9eac029f1ced2/users/eaa8ffe0235f4759bdb071a51ad51410/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:59:00.519769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.521393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.522040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.551633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:00.552568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:00.638364 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1888/3751] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:00.656625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:00.736806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f37e2-7f33-45a3-b710-ea05d08cb381 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:00.749853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:00.750939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:00.751448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:00.752496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:00.774396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:00.775885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65adc1-0040-4c3d-892c-2907a6c3566b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:00.820830 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1864/3752] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:01.219839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:01.222074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:01.236538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a2134-3f43-40e6-a4e1-6432ca5653fa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:01.242707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:01.243815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:01.244167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:01.244545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] PATH_INFO: `/v3/users/feb6004edca04f8196301828a4967803` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:01.245933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb6004edca04f8196301828a4967803)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:01.248317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:01.301048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb6004edca04f8196301828a4967803'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:01.312037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb6004edca04f8196301828a4967803'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:01.313200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb6004edca04f8196301828a4967803'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:01.314399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb6004edca04f8196301828a4967803'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:01.324932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb6004edca04f8196301828a4967803'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:01.351704 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1889/3753] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:01 2022] DELETE /identity/v3/users/feb6004edca04f8196301828a4967803 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:01.356200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:01.356525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:01.357110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:01.381156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:01.382588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:01.510392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1865/3754] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:01.521644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:01.523197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:01.632991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb524-f6cb-4ada-afbf-7abef1f610f8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:01.638817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:01.639723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:01.640166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:01.640636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:01.651900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:01.653599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:01.664634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1890/3755] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:02.593322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:02.595989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:02.636701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7284daf-9092-4899-90aa-9af0bf551f76 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:02.658348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:02.659351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:02.677689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:02.678309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] PATH_INFO: `/v3/projects/94de7d95b2594f7f9ca0182d57ae454a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:02.682858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94de7d95b2594f7f9ca0182d57ae454a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:02.688960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:02.798188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94de7d95b2594f7f9ca0182d57ae454a', 'request_id': 'req-d948f8b6-8e23-471c-b87c-32e57b92d827'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:02.816889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94de7d95b2594f7f9ca0182d57ae454a', 'request_id': 'req-d948f8b6-8e23-471c-b87c-32e57b92d827'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:02.833653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94de7d95b2594f7f9ca0182d57ae454a', 'request_id': 'req-d948f8b6-8e23-471c-b87c-32e57b92d827'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:02.865301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] The token cache is being invalidate because project 94de7d95b2594f7f9ca0182d57ae454a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:02.865618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:02.866586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:02.874044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1866/3756] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:02 2022] DELETE /identity/v3/projects/94de7d95b2594f7f9ca0182d57ae454a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:02.876087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:02.890481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e27ef-f38a-4f96-8b58-d61f4805cf13 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:02.966447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:02.967552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:02.968087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:02.968640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] PATH_INFO: `/v3/users/61eb80f157934e1d962a9cc24f5c1af1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:02.970502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=61eb80f157934e1d962a9cc24f5c1af1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:02.973246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:03.045424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61eb80f157934e1d962a9cc24f5c1af1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:03.067955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61eb80f157934e1d962a9cc24f5c1af1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:03.068801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61eb80f157934e1d962a9cc24f5c1af1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:03.069686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61eb80f157934e1d962a9cc24f5c1af1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:03.087874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d59d2a6c-1457-4d4f-8738-23097e3d0eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61eb80f157934e1d962a9cc24f5c1af1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:03.139019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1891/3757] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:02 2022] DELETE /identity/v3/users/61eb80f157934e1d962a9cc24f5c1af1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:04.261228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:04.262860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:04.295613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f8b6-8e23-471c-b87c-32e57b92d827 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:04.467119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:04.469783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:04.474424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:04.474731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] PATH_INFO: `/v3/projects/63dee14720e449859a21030c16100cf4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:04.477163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dee14720e449859a21030c16100cf4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:04.484800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:04.686928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dee14720e449859a21030c16100cf4', 'request_id': 'req-b3b04128-b4b8-4c86-a4b5-942cd74045a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:04.703569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dee14720e449859a21030c16100cf4', 'request_id': 'req-b3b04128-b4b8-4c86-a4b5-942cd74045a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:04.717346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dee14720e449859a21030c16100cf4', 'request_id': 'req-b3b04128-b4b8-4c86-a4b5-942cd74045a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:04.744839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] The token cache is being invalidate because project 63dee14720e449859a21030c16100cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:04.745144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:04.747557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3b04128-b4b8-4c86-a4b5-942cd74045a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:04.751542 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1867/3758] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:04 2022] DELETE /identity/v3/projects/63dee14720e449859a21030c16100cf4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:04.756893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:04.757397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:04.757504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:04.786320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:04.788907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:04.957426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1892/3759] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:04.965789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b234b-9c7f-4679-bf53-d7b135b8941c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:04.966141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b234b-9c7f-4679-bf53-d7b135b8941c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:04.966436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b234b-9c7f-4679-bf53-d7b135b8941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.008858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0d8b234b-9c7f-4679-bf53-d7b135b8941c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:05.014772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d8b234b-9c7f-4679-bf53-d7b135b8941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:05.045175 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1868/3760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:05.049913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.067407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bb58-fa83-454c-9b8c-e7ce1ff48380 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.083341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.083899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.084397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.098278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.099065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.099244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.099719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.100679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:05.101157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.109983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.148705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:05.150343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:05.166702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1893/3761] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:05.170674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.191379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647c53-103e-41f9-b6d7-bfa356368ebe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.203299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.203986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.204276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.204598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.205482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.207946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.270141 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1894/3762] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:05 2022] POST /identity/v3/projects => generated 361 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:05.274243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.365605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1869/3763] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:05.416307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.418374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:05.452365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ffc4-a5e3-4958-9b28-fba338fb81e0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.469275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.469993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.470283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.470647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.474942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.478854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.559699 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1895/3764] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:05 2022] POST /identity/v3/users => generated 281 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:05.564121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.605211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef619e-c6b6-4907-be83-fec7380966d7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.618142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.619870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.621851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.622683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.624211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.626103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.660909 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1896/3765] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:05.662067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.686064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c074-1eda-40d1-8781-ec8128f25758 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.689091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79247fb-991a-46e2-a650-01761dab6d90 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.694911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.695988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.696520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.696917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.697788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.699744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.720110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1897/3766] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:05.725477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.749507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51700-c97f-4107-a059-450c0c16c33c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:05.761221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.762236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.762801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.763107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] PATH_INFO: `/v3/projects/65d6450dfb8b4c7aac283ce010a7fd78/users/a0954fc98c324ff88834fc40e35a5d41/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.784357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d6450dfb8b4c7aac283ce010a7fd78, user_id=a0954fc98c324ff88834fc40e35a5d41, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.787652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00de20-658a-450a-852a-a594f06e7a68 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.807213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1898/3767] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:05 2022] PUT /identity/v3/projects/65d6450dfb8b4c7aac283ce010a7fd78/users/a0954fc98c324ff88834fc40e35a5d41/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:05.818307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.818673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.819025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.846297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:05.847228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:05.847578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:05.847936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:05.864236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] MFA Rules not processed for user `a0954fc98c324ff88834fc40e35a5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:05.865734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:05.951924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1899/3768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:05.960641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:05.969199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:05.970827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:05.991837 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1870/3769] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 20:59:06.093134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac8498-21c5-40c9-acab-12dfef66f1da None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:06.105391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:06.107987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:06.108280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:06.109662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:06.110543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:06.118123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:06.222346 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1900/3770] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:05 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:06.224043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:06.241264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2a21-bae2-4fc1-9c80-e60d18123f1b service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:06.360535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:06.361211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:06.361497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:06.361774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:06.363747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:06.366199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:06.397061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1871/3771] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:06 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:06.401922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:06.426665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f4a0-5f31-4b6f-8779-eb5474527744 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:06.454774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:06.455505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:06.455771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:06.456625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:06.457371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:06.458991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:06.529649 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1901/3772] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:06.531194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:06.550835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784c275-4c37-4a89-9e7b-849f49fc3747 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:06.574044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:06.575105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:06.577707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:06.589632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] PATH_INFO: `/v3/projects/24cd9057da0b47f9a81cd690c803128b/users/bef5a718f5d544c787682b8d976f315b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:06.636667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cd9057da0b47f9a81cd690c803128b, user_id=bef5a718f5d544c787682b8d976f315b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:06.644528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:06.676881 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1872/3773] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:06 2022] PUT /identity/v3/projects/24cd9057da0b47f9a81cd690c803128b/users/bef5a718f5d544c787682b8d976f315b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:06.678080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:06.696002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc386be-e06b-40dc-9e7b-324a71c10850 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:06.926132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:06.928242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:06.931343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:06.933508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:06.936038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:06.941209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226da812-4c79-4e86-94a4-fa16385022cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:06.980748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:06.983475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1902/3774] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:59:06.995100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3310df-6836-47f0-9d0f-406db208a2c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:07.020322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:07.021275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:07.021565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:07.021849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] PATH_INFO: `/v3/projects/24cd9057da0b47f9a81cd690c803128b/users/bef5a718f5d544c787682b8d976f315b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:07.049748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cd9057da0b47f9a81cd690c803128b, user_id=bef5a718f5d544c787682b8d976f315b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:07.055135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:07.099436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1873/3775] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:06 2022] PUT /identity/v3/projects/24cd9057da0b47f9a81cd690c803128b/users/bef5a718f5d544c787682b8d976f315b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:59:07.101851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:07.102159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:07.102466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:07.196639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] MFA Rules not processed for user `bef5a718f5d544c787682b8d976f315b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:07.197990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:07.397415 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1903/3776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:07.408805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:07.411660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:07.559533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c90ea-56b8-4970-99c3-55bebefaa466 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:07.570651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:07.571415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:07.571770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:07.572124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:07.596309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:07.598453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d9846-7d23-4ac6-979d-91876fbca1d9 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:07.621402 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1874/3777] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:08.593322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:08.718857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f7374-cdd0-4d78-85b9-4612332caff8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:08.731350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:08.732269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:08.732589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:08.734154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] PATH_INFO: `/v3/users/a0954fc98c324ff88834fc40e35a5d41` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:08.737179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0954fc98c324ff88834fc40e35a5d41)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:08.742506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:08.881589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0954fc98c324ff88834fc40e35a5d41'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:08.900595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0954fc98c324ff88834fc40e35a5d41'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:08.901394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0954fc98c324ff88834fc40e35a5d41'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:08.902180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0954fc98c324ff88834fc40e35a5d41'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:08.921590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0954fc98c324ff88834fc40e35a5d41'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:08.951567 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1904/3778] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:08 2022] DELETE /identity/v3/users/a0954fc98c324ff88834fc40e35a5d41 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:08.956412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:08.957374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:08.957600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:08.993760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:08.995154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:09.148597 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1875/3779] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:09.172755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:09.174754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:09.371540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3c49-32dc-4b0b-b8d6-4eb55359a019 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:09.383625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:09.384305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:09.384738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:09.390745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:09.410755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:09.421144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:09.483585 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1905/3780] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:10.091917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:10.094280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:10.116642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfd76e-8cd6-4b0e-bed9-9624da3830f6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:10.135119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:10.136659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:10.137056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:10.137463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] PATH_INFO: `/v3/projects/65d6450dfb8b4c7aac283ce010a7fd78` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:10.141286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d6450dfb8b4c7aac283ce010a7fd78)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:10.143921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:10.279082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d6450dfb8b4c7aac283ce010a7fd78', 'request_id': 'req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.309338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d6450dfb8b4c7aac283ce010a7fd78', 'request_id': 'req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.338613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d6450dfb8b4c7aac283ce010a7fd78', 'request_id': 'req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.382135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] The token cache is being invalidate because project 65d6450dfb8b4c7aac283ce010a7fd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:10.385105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.388291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.390814 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1876/3781] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:10 2022] DELETE /identity/v3/projects/65d6450dfb8b4c7aac283ce010a7fd78 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:10.395033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:10.414322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243ae1c-dc2f-4061-adf2-651297cf7204 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:10.569804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:10.571085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:10.571841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:10.574870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] PATH_INFO: `/v3/users/bef5a718f5d544c787682b8d976f315b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:10.579610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef5a718f5d544c787682b8d976f315b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:10.586993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:10.694108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef5a718f5d544c787682b8d976f315b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.708708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef5a718f5d544c787682b8d976f315b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.709510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef5a718f5d544c787682b8d976f315b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.710784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef5a718f5d544c787682b8d976f315b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.721920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c370876a-ed8a-4ad2-970a-a6516671c665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef5a718f5d544c787682b8d976f315b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:10.756281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1906/3782] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:10 2022] DELETE /identity/v3/users/bef5a718f5d544c787682b8d976f315b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:11.480184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:11.482639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:11.517874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afb0a0-e6a5-4d3a-82a6-a8a57f45a5d4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:11.707921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:11.721650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:11.722308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:11.722794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] PATH_INFO: `/v3/projects/24cd9057da0b47f9a81cd690c803128b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:11.724383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cd9057da0b47f9a81cd690c803128b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:11.726698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:11.829816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cd9057da0b47f9a81cd690c803128b', 'request_id': 'req-3c84bf0a-d583-4756-868f-1aceadc3596c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:11.845497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cd9057da0b47f9a81cd690c803128b', 'request_id': 'req-3c84bf0a-d583-4756-868f-1aceadc3596c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:11.860716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cd9057da0b47f9a81cd690c803128b', 'request_id': 'req-3c84bf0a-d583-4756-868f-1aceadc3596c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:11.865861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6799e9-8e4b-492e-870b-270faf182932 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:11.866996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6799e9-8e4b-492e-870b-270faf182932 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:11.868012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6799e9-8e4b-492e-870b-270faf182932 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:11.875422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1907/3783] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 20:59:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 20:59:11.887700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:11.887985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] The token cache is being invalidate because project 24cd9057da0b47f9a81cd690c803128b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:11.888386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:11.889500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:11.889967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:11.893459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3c84bf0a-d583-4756-868f-1aceadc3596c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:11.903536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1877/3784] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:11 2022] DELETE /identity/v3/projects/24cd9057da0b47f9a81cd690c803128b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:11.915079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ed93-c0f0-43d3-9bbb-a0e8abfaa215 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:11.916698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ed93-c0f0-43d3-9bbb-a0e8abfaa215 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:11.917166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ed93-c0f0-43d3-9bbb-a0e8abfaa215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:11.968855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:11.970211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0894ed93-c0f0-43d3-9bbb-a0e8abfaa215 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:11.970343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:11.974154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0894ed93-c0f0-43d3-9bbb-a0e8abfaa215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:12.106313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1908/3785] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:12.135645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.137436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:12.141657 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1878/3786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:12.151430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.152012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.152558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.165432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b6c9-4cba-4bba-9cee-d96800b05bc8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.187735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.188657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.191028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.191492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.191743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:12.196073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:12.210251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.212193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.215771 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1879/3787] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:12.218131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.236910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1909/3788] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:59:12.242247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766601a2-4188-4595-bdf8-498a279d06dc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.254755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.255708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.256603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.257049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.257935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:12.258424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.261330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.274943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1880/3789] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:12.278858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.321207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d62db-2efc-4fd7-8951-54d68764a314 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.333074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.334007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.334297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.334575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.335263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.337562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.428209 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1910/3790] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:12 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:12.430429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.447194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd68e4-ca67-4711-98d6-8b9b805eff98 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.615354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.617915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.619457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.620084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.621666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.624742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.670366 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1881/3791] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:12 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:12.674790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.688946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977147-0645-41c3-9f15-d566a50cbfa6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.720227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.720910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.721186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.722019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.722778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.724420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.750129 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1911/3792] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:12.750310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.760941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c870f-3b70-40a6-bb8e-1045eeac0425 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.787794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.788745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.789035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.789315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.790225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.791968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa963669-8152-4f26-93f1-0690f21bb8a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:12.838071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1882/3793] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:12.843961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:12.863447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bce9-02d2-477a-9381-69ca76a83438 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:12.889437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:12.890893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:12.892091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:12.892647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] PATH_INFO: `/v3/projects/233e3f51218646e7a0367c7aafe69ced/users/4b345f30a4a241cf92dade0e761057fc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:12.984693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=233e3f51218646e7a0367c7aafe69ced, user_id=4b345f30a4a241cf92dade0e761057fc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:12.987433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:13.027274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1912/3794] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:12 2022] PUT /identity/v3/projects/233e3f51218646e7a0367c7aafe69ced/users/4b345f30a4a241cf92dade0e761057fc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:13.037873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:13.038305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:13.038640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:13.098856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] MFA Rules not processed for user `4b345f30a4a241cf92dade0e761057fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:13.100372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:13.351878 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1883/3795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:13.356381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:13.531010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950637-90fb-4e1b-a3f3-c38e24138bfa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:13.537852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:13.540665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:13.540665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:13.541070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:13.542475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:13.545001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:13.617283 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1913/3796] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:13 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:13.621172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:13.637407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688753-2932-49a2-9d68-239bb6e5eae1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:13.765000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:13.765705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:13.765991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:13.766269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:13.766966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:13.777515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:13.829568 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1884/3797] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:13 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:13.833781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:13.848228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300ad7-7371-4cdf-b8f3-3c7d68701c8e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:13.863473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:13.864275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:13.864877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:13.865230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:13.866035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:13.867722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:13.905075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1914/3798] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:13.905861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:13.919723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7a4b7-148b-411d-88b3-26391eb5ad96 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:13.925639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:13.926855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:13.927392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:13.928109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] PATH_INFO: `/v3/projects/3a1e819ba8de4824a3294355bf522b00/users/9daecbf22c7a4b55b8657ce29f43db20/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:13.948254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1e819ba8de4824a3294355bf522b00, user_id=9daecbf22c7a4b55b8657ce29f43db20, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:13.951246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:13.982475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1885/3799] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:13 2022] PUT /identity/v3/projects/3a1e819ba8de4824a3294355bf522b00/users/9daecbf22c7a4b55b8657ce29f43db20/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:13.984090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:13.998714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a616c1-e602-400d-bb00-fe2eb5cdf348 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:14.142348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:14.143715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:14.144261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:14.144799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:14.145630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:14.147783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55ba69-a912-482e-8043-20ac7c0a943e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:14.175358 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1915/3800] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:14.176752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:14.218413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c09a-2a52-49cb-935a-4cf6667a7649 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:14.239205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:14.240529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:14.241014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:14.241489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] PATH_INFO: `/v3/projects/3a1e819ba8de4824a3294355bf522b00/users/9daecbf22c7a4b55b8657ce29f43db20/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:14.243948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1e819ba8de4824a3294355bf522b00, user_id=9daecbf22c7a4b55b8657ce29f43db20, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:14.253271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:14.288134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:14.288913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:14.289462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:14.294990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1886/3801] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:14 2022] PUT /identity/v3/projects/3a1e819ba8de4824a3294355bf522b00/users/9daecbf22c7a4b55b8657ce29f43db20/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:14.331435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] MFA Rules not processed for user `9daecbf22c7a4b55b8657ce29f43db20`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:14.334071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:14.419938 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1916/3802] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:14.430832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:14.432985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:14.585289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1945d-d431-4f04-be46-208a8949dd20 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:14.590153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:14.590854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:14.591108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:14.591406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:14.613905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:14.616897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a2ee-4cc6-4e11-ac8e-02952cf7c509 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:14.646136 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1887/3803] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:14.801587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:14.816062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5bae7-07b8-4126-9a7b-462e6097caa4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:14.832994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:14.833993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:14.834288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:14.834654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:14.957683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:14.959159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:14.975368 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1917/3804] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:15.698260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b020-abfd-4c78-8ad6-a6e435a03b8a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:15.699223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b020-abfd-4c78-8ad6-a6e435a03b8a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:15.699731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387b020-abfd-4c78-8ad6-a6e435a03b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:15.770276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e387b020-abfd-4c78-8ad6-a6e435a03b8a None None] MFA Rules not processed for user `eaa8ffe0235f4759bdb071a51ad51410`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:15.771561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e387b020-abfd-4c78-8ad6-a6e435a03b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:15.961350 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1888/3805] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:16.208127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:16.209637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:16.319477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d20bca-9825-4e18-bc8d-bcb91b27ed9d service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:16.329785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:16.331248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:16.331730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:16.332178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:16.342084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:16.343967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:16.356663 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1918/3806] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:23.542831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad75c1-53e1-4638-96a5-5434c41e0f15 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:23.543391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad75c1-53e1-4638-96a5-5434c41e0f15 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:23.543391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad75c1-53e1-4638-96a5-5434c41e0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:23.592669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-44ad75c1-53e1-4638-96a5-5434c41e0f15 None None] MFA Rules not processed for user `eaa8ffe0235f4759bdb071a51ad51410`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:23.594235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44ad75c1-53e1-4638-96a5-5434c41e0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:23.621558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1889/3807] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:26.151593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:26.284490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446034-9a7e-432e-90c7-791308829a88 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:26.304871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:26.305509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:26.305945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:26.306230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] PATH_INFO: `/v3/users/4b345f30a4a241cf92dade0e761057fc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:26.311595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b345f30a4a241cf92dade0e761057fc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:26.315405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:26.435772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b345f30a4a241cf92dade0e761057fc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:26.475278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b345f30a4a241cf92dade0e761057fc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:26.475931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b345f30a4a241cf92dade0e761057fc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:26.477192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b345f30a4a241cf92dade0e761057fc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:26.488744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b345f30a4a241cf92dade0e761057fc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:26.541073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1919/3808] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:26 2022] DELETE /identity/v3/users/4b345f30a4a241cf92dade0e761057fc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:26.543427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:26.543954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:26.544046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:26.600621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:26.603572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:26.741378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1890/3809] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:26.763415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:26.768256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:26.908177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd6476-7e71-4f80-9215-c32faa2e6e2e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:26.917654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:26.918515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:26.918909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:26.919283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:26.941399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:26.943151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:26.966249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1920/3810] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:27.177132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:27.178883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:27.333399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafce19-46de-489c-aba5-c3952307ffb9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:27.340868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:27.341539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:27.341830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:27.342109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:27.351198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:27.378894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:27.380633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:27.422424 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1891/3811] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:59:28.121978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:28.124329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:28.145425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4572ee-6ffa-4b3f-ad69-7e668490064a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:28.164303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:28.165734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:28.166236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:28.166706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] PATH_INFO: `/v3/projects/233e3f51218646e7a0367c7aafe69ced` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:28.168345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233e3f51218646e7a0367c7aafe69ced)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:28.170473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:28.278561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233e3f51218646e7a0367c7aafe69ced', 'request_id': 'req-b893de56-e61a-48f2-8625-68f4691b6f68'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.302689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233e3f51218646e7a0367c7aafe69ced', 'request_id': 'req-b893de56-e61a-48f2-8625-68f4691b6f68'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.326024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233e3f51218646e7a0367c7aafe69ced', 'request_id': 'req-b893de56-e61a-48f2-8625-68f4691b6f68'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.341648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] The token cache is being invalidate because project 233e3f51218646e7a0367c7aafe69ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:28.342691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.345045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.352134 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1921/3812] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:28 2022] DELETE /identity/v3/projects/233e3f51218646e7a0367c7aafe69ced => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:59:28.353227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:28.367176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf665f0-a58e-48d7-b3fa-23d050683af2 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:28.490711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:28.492419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:28.492959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:28.493496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] PATH_INFO: `/v3/users/9daecbf22c7a4b55b8657ce29f43db20` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:28.495430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daecbf22c7a4b55b8657ce29f43db20)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:28.498609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:28.616680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daecbf22c7a4b55b8657ce29f43db20'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.633988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daecbf22c7a4b55b8657ce29f43db20'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.635844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daecbf22c7a4b55b8657ce29f43db20'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.653200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daecbf22c7a4b55b8657ce29f43db20'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.709054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2dad8125-644f-40fb-b500-6b64aaf7ca6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daecbf22c7a4b55b8657ce29f43db20'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:28.737168 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1892/3813] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:28 2022] DELETE /identity/v3/users/9daecbf22c7a4b55b8657ce29f43db20 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:30.627749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:30.629890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:30.674461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de56-e61a-48f2-8625-68f4691b6f68 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:30.766174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:30.767057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:30.767342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:30.767834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] PATH_INFO: `/v3/projects/3a1e819ba8de4824a3294355bf522b00` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:30.769885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1e819ba8de4824a3294355bf522b00)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:30.772291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:30.834506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1e819ba8de4824a3294355bf522b00', 'request_id': 'req-ce654b3d-7355-4f81-a20e-aab96ddf9a19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:30.849569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1e819ba8de4824a3294355bf522b00', 'request_id': 'req-ce654b3d-7355-4f81-a20e-aab96ddf9a19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:30.863128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1e819ba8de4824a3294355bf522b00', 'request_id': 'req-ce654b3d-7355-4f81-a20e-aab96ddf9a19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:30.878941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] The token cache is being invalidate because project 3a1e819ba8de4824a3294355bf522b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:30.879240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:30.879928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ce654b3d-7355-4f81-a20e-aab96ddf9a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:30.882566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1922/3814] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:30 2022] DELETE /identity/v3/projects/3a1e819ba8de4824a3294355bf522b00 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:30.889608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:30.890266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:30.890682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:30.915131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:30.916380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:30.996695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1893/3815] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:31.084608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.084923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.085230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.111214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:31.113925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:31.137812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1923/3816] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:31.138168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.147234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b28c7-4b0d-4482-8f9d-e4af19cbaa37 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.152679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.153368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.153658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.154286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.154841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:31.155217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.157512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.185585 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1894/3817] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:31.193820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.205670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a74d-4aa9-4415-87c3-3b579ac58528 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.210581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.211255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.211564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.211847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.212577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.214814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.257626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1924/3818] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:31.258462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.270111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b327-9ce0-466d-a73a-ca7d2ab564fe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.393754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.394517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.394878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.395236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.396796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.404781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.453147 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1895/3819] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:31.456371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.469777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0af1c-c1aa-4d7d-a80c-2f42042673d2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.474936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.475622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.475908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.476188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.476950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.481143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07b66b-a24b-4345-b073-69f1a40ff889 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.502396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.510395 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1925/3820] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:31.515458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4f72-5479-4655-8aa6-93045306fd6b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.521395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.522465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.523021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.523565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.526272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.526746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.527177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.537704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.541006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.563907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:31.565219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:31.570597 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1896/3821] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:31.576173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.587737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65974107-4c9d-4daa-b71e-4a25849ce37d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:31.593786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:31.597235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.597525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.597808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] PATH_INFO: `/v3/projects/db5a48a47b9c4d5ba65674a8888209d4/users/83249aafde8044a18d94b4a6f1a7f376/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.624367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5a48a47b9c4d5ba65674a8888209d4, user_id=83249aafde8044a18d94b4a6f1a7f376, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:31.628849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605a925-b04d-4d2c-8b4b-ab456342106c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:31.651673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1897/3822] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:31 2022] PUT /identity/v3/projects/db5a48a47b9c4d5ba65674a8888209d4/users/83249aafde8044a18d94b4a6f1a7f376/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:31.662751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:31.663040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:31.664497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:31.700736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] MFA Rules not processed for user `83249aafde8044a18d94b4a6f1a7f376`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:31.701972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:31.707253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1926/3823] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:31.716890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.719636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:31.860202 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1898/3824] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:31.865885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:31.875837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2fc7-f5b7-4c85-9a3a-6a3d04103f8f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.000539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.001202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.002664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.002664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.007843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c0b3-b622-48e4-8ed3-c4508dfd3de3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.022516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.023186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.023473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.023891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.024980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.026943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.060409 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1899/3825] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:31 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:32.064118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.118539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.120183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.136643 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1927/3826] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 20:59:32.179969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020bd3-424c-4757-a084-387a053ff736 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.187955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.188697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.188889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.189133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.189871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.191836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.231014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1900/3827] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:32 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:32.235276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.248656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd93897-d249-43c9-a0c3-5aa8291a69aa service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.255648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.257144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.261860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.261860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.261860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.261860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.285840 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1928/3828] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:32.289548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.340319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8b69-5965-48cb-9a68-de51a566c2d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.354965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.360291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.361189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.365402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] PATH_INFO: `/v3/projects/13395c52821f431d88d08796cd57d500/users/d9ae0e063b69413d8e6d74186c66679d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.435339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13395c52821f431d88d08796cd57d500, user_id=d9ae0e063b69413d8e6d74186c66679d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.459609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.486209 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1901/3829] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:32 2022] PUT /identity/v3/projects/13395c52821f431d88d08796cd57d500/users/d9ae0e063b69413d8e6d74186c66679d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:32.486916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.487448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.490386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:32.618456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afd40-fe75-4439-8805-d1214b69bbf5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.618759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596c10-af3c-4587-81a6-5cd9b6228cd3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.637986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.639180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.640723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.641252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.644642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.649354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.678876 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1902/3830] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:32.680380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.699912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bbebd-9044-446c-80c9-09d186ce44e7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:32.705192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.706207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.706502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.706671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:32.706812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] PATH_INFO: `/v3/projects/13395c52821f431d88d08796cd57d500/users/d9ae0e063b69413d8e6d74186c66679d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.707339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.709031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13395c52821f431d88d08796cd57d500, user_id=d9ae0e063b69413d8e6d74186c66679d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.711116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.711441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.711700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498fef6-c26c-4375-b428-00148e198f14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.716394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:32.729385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1903/3831] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:32 2022] PUT /identity/v3/projects/13395c52821f431d88d08796cd57d500/users/d9ae0e063b69413d8e6d74186c66679d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:32.741679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e3be-ff2b-42bb-8758-9083c4af579d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:32.741964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e3be-ff2b-42bb-8758-9083c4af579d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:32.742254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705e3be-ff2b-42bb-8758-9083c4af579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:32.744496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:32.746496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:32.761535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1929/3832] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:32.792569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1705e3be-ff2b-42bb-8758-9083c4af579d None None] MFA Rules not processed for user `d9ae0e063b69413d8e6d74186c66679d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:32.794617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1705e3be-ff2b-42bb-8758-9083c4af579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:32.888774 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1904/3833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:32.899401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:32.900988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:32.992558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95a2a-edad-4b3c-892c-c8ff32cff1a6 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:33.068794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:33.069461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:33.069801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:33.070125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:33.085564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:33.087031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3adc16-8389-4ac9-b060-7da9654bf83f service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:33.108930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1930/3834] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:33.155413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e15-bd42-4235-b887-f6a8a6434fec None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:33.156378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e15-bd42-4235-b887-f6a8a6434fec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:33.157017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41248e15-bd42-4235-b887-f6a8a6434fec None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:33.160919 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1905/3835] 10.222.0.18 () {54 vars in 962 bytes} [Sat Apr 2 20:59:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 20:59:33.167376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153b241-46db-445e-9811-419787429586 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:33.167810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153b241-46db-445e-9811-419787429586 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:33.168154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153b241-46db-445e-9811-419787429586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:33.278150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e153b241-46db-445e-9811-419787429586 None None] MFA Rules not processed for user `64e876b0e0844090aa652c98af67ab8b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:33.279514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e153b241-46db-445e-9811-419787429586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:33.291326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1931/3836] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Apr 2 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:33.301738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e15-bd42-4235-b887-f6a8a6434fec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:33.333338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41248e15-bd42-4235-b887-f6a8a6434fec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:33.342849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:33.347376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:33.347938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:33.348430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:33.475966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:33.478743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:33.492621 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1906/3837] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:34.006011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:34.006522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:34.006655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:34.036777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] MFA Rules not processed for user `2e7bca7cae174c2c9b83217ea73a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:34.039607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:34.131592 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1932/3838] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:35.719793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:35.721965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:35.899005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260284f-e596-4325-9fcf-b3ccc45973c0 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:35.916853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:35.918428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:35.920192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:35.920700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:35.927202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:36.069138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:36.075160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315eb48-e19a-4e7c-b81b-d33460b7756c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:36.098545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1907/3839] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:37.690709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:37.778109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859815c6-7ea0-4635-977b-ebb0e44ea95a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:37.783070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:37.797327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:37.798829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:37.799872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] PATH_INFO: `/v3/users/83249aafde8044a18d94b4a6f1a7f376` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:37.801721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] RBAC: Authorizing `identity:delete_user(user_id=83249aafde8044a18d94b4a6f1a7f376)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:37.804302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:37.932334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83249aafde8044a18d94b4a6f1a7f376'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:37.947734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83249aafde8044a18d94b4a6f1a7f376'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:37.948870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83249aafde8044a18d94b4a6f1a7f376'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:37.950358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83249aafde8044a18d94b4a6f1a7f376'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:37.964234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83249aafde8044a18d94b4a6f1a7f376'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.038605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1933/3840] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:37 2022] DELETE /identity/v3/users/83249aafde8044a18d94b4a6f1a7f376 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:38.040603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:38.040997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:38.041176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:38.066877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:38.068608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:38.181184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1908/3841] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:38.182803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:38.184670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:38.291871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba58626-cfad-4763-81c5-fd9e1662324e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:38.297672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:38.299706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:38.300167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:38.300688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:38.313825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:38.327585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:38.364798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1934/3842] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:38.774661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:38.776572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:38.809144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb759e6-2767-4bc0-921c-f0bc09e410de None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:38.817514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:38.819687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:38.821592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:38.822112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] PATH_INFO: `/v3/projects/db5a48a47b9c4d5ba65674a8888209d4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:38.826398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5a48a47b9c4d5ba65674a8888209d4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:38.829255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:38.910745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5a48a47b9c4d5ba65674a8888209d4', 'request_id': 'req-c5267b4b-0437-4310-bff0-05e33feacb60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.918592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5a48a47b9c4d5ba65674a8888209d4', 'request_id': 'req-c5267b4b-0437-4310-bff0-05e33feacb60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.923612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5a48a47b9c4d5ba65674a8888209d4', 'request_id': 'req-c5267b4b-0437-4310-bff0-05e33feacb60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.942089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] The token cache is being invalidate because project db5a48a47b9c4d5ba65674a8888209d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:38.942923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.943851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:38.946027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1909/3843] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:38 2022] DELETE /identity/v3/projects/db5a48a47b9c4d5ba65674a8888209d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:59:38.950052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:38.961277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2f918-f108-489d-a12c-84ec6eaa2939 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:39.201997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:39.203254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:39.203403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:39.203705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] PATH_INFO: `/v3/users/d9ae0e063b69413d8e6d74186c66679d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:39.205257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ae0e063b69413d8e6d74186c66679d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:39.207718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:39.258248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ae0e063b69413d8e6d74186c66679d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:39.267382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ae0e063b69413d8e6d74186c66679d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:39.268851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ae0e063b69413d8e6d74186c66679d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:39.269501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ae0e063b69413d8e6d74186c66679d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:39.277257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-742e994d-880e-4925-84ef-552737ce8c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ae0e063b69413d8e6d74186c66679d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:39.300154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1935/3844] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:38 2022] DELETE /identity/v3/users/d9ae0e063b69413d8e6d74186c66679d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 20:59:40.429767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:40.432054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:40.469925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5267b4b-0437-4310-bff0-05e33feacb60 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:40.558437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:40.568948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:40.574666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:40.577185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] PATH_INFO: `/v3/projects/13395c52821f431d88d08796cd57d500` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:40.579952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13395c52821f431d88d08796cd57d500)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:40.591964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:40.673659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13395c52821f431d88d08796cd57d500', 'request_id': 'req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:40.680796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13395c52821f431d88d08796cd57d500', 'request_id': 'req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:40.688690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13395c52821f431d88d08796cd57d500', 'request_id': 'req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:40.704943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] The token cache is being invalidate because project 13395c52821f431d88d08796cd57d500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:40.705333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:40.706103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1f5ae1e1-9e48-49c3-8e94-5e49c172e58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:40.712741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1910/3845] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:40 2022] DELETE /identity/v3/projects/13395c52821f431d88d08796cd57d500 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:40.713868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:40.714348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:40.714443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:40.733881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:40.735102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:40.807659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1936/3846] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:40.815444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:40.815742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:40.816026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:40.837323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:40.838962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:40.849455 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1911/3847] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:40.853465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:40.867042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53cc2d-003a-410f-86b9-9a1f21f3bc9f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:40.874019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:40.874798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:40.875164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:40.875500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:40.876778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:40.877133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:40.878803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:40.891697 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1937/3848] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 20:59:40.897158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:40.907340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e9846-12d9-405d-8c65-8865c161ed80 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:40.919399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:40.920088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:40.920724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:40.920724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:40.921605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:40.931643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:40.979887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1912/3849] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:40 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:40.981083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:40.993512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c8a7-452c-425d-8065-54d72849b4e0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.067887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.069005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.069005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.069250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.070808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.074673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.106543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1938/3850] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:40 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:41.111119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.128723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4b378-fe59-47d1-b769-e36b029e4905 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.134463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.135383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.135744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.136153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.136938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.139804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.157488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1913/3851] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:41.160443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.173394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a92ac-b46c-410a-a526-61dfb6b6a73d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.181218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.181925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.182214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.182526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.183695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.185000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771d6c-a3bc-43a8-88ec-301091e2530d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.201689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1939/3852] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:41.202720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.214261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb10cf-c5de-4cf0-8f05-3b08b5c4d046 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.221609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.222512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.222801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.223075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] PATH_INFO: `/v3/projects/10cec1e5693648f6b96f72515bd942f5/users/94ff45120326438cbd21f8620a1983e2/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.245368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cec1e5693648f6b96f72515bd942f5, user_id=94ff45120326438cbd21f8620a1983e2, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.249087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.272206 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1914/3853] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:41 2022] PUT /identity/v3/projects/10cec1e5693648f6b96f72515bd942f5/users/94ff45120326438cbd21f8620a1983e2/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:41.286923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.287297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.287519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.316801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] MFA Rules not processed for user `94ff45120326438cbd21f8620a1983e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:41.318204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:41.396956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1940/3854] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:41.401126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.477821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1964-515e-42a4-9489-351c4dab93c6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.483899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.484619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.484908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.485193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.485889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.487852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.536407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1915/3855] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:41 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:41.540151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.555770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdd5ae-1728-4d3a-846e-74c58d415b8d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.631245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.634748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.634952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.635240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.636085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.640954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.677763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.688965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1941/3856] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:41 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:41.694782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f6d5-6ec6-46f3-8af0-69eaa4a3f636 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.701668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.702610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.703950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.704587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.706073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.709416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.732432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.741617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1916/3857] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:41.744814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928d17-ff2d-45c1-8417-8babf4a966a9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.751645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.752911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.753834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.754124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] PATH_INFO: `/v3/projects/7b69d94829e34cbb8148ef11c137975e/users/8944825873fa42c1aff549e43ed8e048/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.777207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b69d94829e34cbb8148ef11c137975e, user_id=8944825873fa42c1aff549e43ed8e048, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.780238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.801841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1942/3858] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:41 2022] PUT /identity/v3/projects/7b69d94829e34cbb8148ef11c137975e/users/8944825873fa42c1aff549e43ed8e048/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:41.805470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.821081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6a922-54c5-453c-a82b-6e9987e87a8b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.918887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.919588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.920159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.920344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.921309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.922942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ccbc9-8505-4f15-8757-d07d8e214d56 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.939089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1917/3859] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:41.940373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:41.952022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adf5f4-50c4-4f90-a9aa-b56a9d23b988 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:41.957903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:41.958973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.959347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.959723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] PATH_INFO: `/v3/projects/7b69d94829e34cbb8148ef11c137975e/users/8944825873fa42c1aff549e43ed8e048/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:41.961891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b69d94829e34cbb8148ef11c137975e, user_id=8944825873fa42c1aff549e43ed8e048, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:41.964777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:41.984520 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1943/3860] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:41 2022] PUT /identity/v3/projects/7b69d94829e34cbb8148ef11c137975e/users/8944825873fa42c1aff549e43ed8e048/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:41.988128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:41.988432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:41.988724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:42.016663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] MFA Rules not processed for user `8944825873fa42c1aff549e43ed8e048`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:42.018617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:42.093591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1918/3861] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:42.104830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:42.107037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:42.175162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56c94c-0f29-472a-b1ef-2c02d35d90d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:42.208249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:42.208249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:42.208249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:42.208249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:42.229737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:42.232068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018967-75a9-4560-80e9-45d8b0753c54 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:42.254329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1944/3862] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:42.768338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:42.835427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28cb1-0f0a-4a29-b918-0df871a15b60 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:42.840394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:42.841314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:42.841669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:42.841916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] PATH_INFO: `/v3/users/94ff45120326438cbd21f8620a1983e2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:42.843248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ff45120326438cbd21f8620a1983e2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:42.845245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:42.899056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ff45120326438cbd21f8620a1983e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:42.912059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ff45120326438cbd21f8620a1983e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:42.912975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ff45120326438cbd21f8620a1983e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:42.926780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ff45120326438cbd21f8620a1983e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:42.936106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ff45120326438cbd21f8620a1983e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:42.944728 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1919/3863] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:42 2022] DELETE /identity/v3/users/94ff45120326438cbd21f8620a1983e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:42.949266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:42.949951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:42.949951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:42.979753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:42.981621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:43.060824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1945/3864] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:43.078548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:43.080180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:43.186872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031148-97f5-4c22-896b-54cade1fdf41 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:43.198227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:43.198906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:43.199193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:43.199467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:43.217857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:43.219304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:43.235665 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1920/3865] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:44.354074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:44.355816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:44.369370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40c7b0-17ad-4ab8-b976-7853aa44de32 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:44.375848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:44.376823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:44.377238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:44.377502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] PATH_INFO: `/v3/users/821ac6c697bc4706ad36b8be4e9276a5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:44.378887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821ac6c697bc4706ad36b8be4e9276a5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:44.381028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:44.400688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:44.402612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:44.424982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bd1b-21a1-43b4-919e-96116250e51b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:44.431928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:44.432888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:44.433215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:44.433620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] PATH_INFO: `/v3/projects/10cec1e5693648f6b96f72515bd942f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:44.434696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cec1e5693648f6b96f72515bd942f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:44.436780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:44.457056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821ac6c697bc4706ad36b8be4e9276a5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.468537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821ac6c697bc4706ad36b8be4e9276a5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.469555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821ac6c697bc4706ad36b8be4e9276a5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.471735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821ac6c697bc4706ad36b8be4e9276a5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.480659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821ac6c697bc4706ad36b8be4e9276a5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.497906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cec1e5693648f6b96f72515bd942f5', 'request_id': 'req-7893a8e5-6dae-4057-b69f-662a20782280'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.501674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1946/3866] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:44 2022] DELETE /identity/v3/users/821ac6c697bc4706ad36b8be4e9276a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:44.505445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cec1e5693648f6b96f72515bd942f5', 'request_id': 'req-7893a8e5-6dae-4057-b69f-662a20782280'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.511914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cec1e5693648f6b96f72515bd942f5', 'request_id': 'req-7893a8e5-6dae-4057-b69f-662a20782280'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.526774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] The token cache is being invalidate because project 10cec1e5693648f6b96f72515bd942f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:44.527226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.527897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.530077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1921/3867] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:44 2022] DELETE /identity/v3/projects/10cec1e5693648f6b96f72515bd942f5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:44.535155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:44.536770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:44.606199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf0561-bbae-4a6c-bf45-9b0962a444c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:44.611420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:44.613001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:44.613286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:44.613561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] PATH_INFO: `/v3/users/8944825873fa42c1aff549e43ed8e048` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:44.614974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8944825873fa42c1aff549e43ed8e048)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:44.617114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:44.675950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8944825873fa42c1aff549e43ed8e048'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.686883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8944825873fa42c1aff549e43ed8e048'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.688300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8944825873fa42c1aff549e43ed8e048'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.689098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8944825873fa42c1aff549e43ed8e048'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.698551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ba118605-518e-4227-a2e3-0f02773c24e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8944825873fa42c1aff549e43ed8e048'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:44.721621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1947/3868] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:44 2022] DELETE /identity/v3/users/8944825873fa42c1aff549e43ed8e048 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:44.878274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:44.879699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:44.945798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a8e5-6dae-4057-b69f-662a20782280 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.042115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.043427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.043736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.044017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] PATH_INFO: `/v3/projects/d0e22715a8e849e0871b68d772ed29fd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.045340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e22715a8e849e0871b68d772ed29fd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.047447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.148958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e22715a8e849e0871b68d772ed29fd', 'request_id': 'req-9741847f-b64e-4a08-b1cc-e669d286c119'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.163902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e22715a8e849e0871b68d772ed29fd', 'request_id': 'req-9741847f-b64e-4a08-b1cc-e669d286c119'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.172283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e22715a8e849e0871b68d772ed29fd', 'request_id': 'req-9741847f-b64e-4a08-b1cc-e669d286c119'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.189869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] The token cache is being invalidate because project d0e22715a8e849e0871b68d772ed29fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:45.190181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.190824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.192387 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1922/3869] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:44 2022] DELETE /identity/v3/projects/d0e22715a8e849e0871b68d772ed29fd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:45.197893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46ce5-e9f0-481e-ac3b-5bfe5cb10bad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.198181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46ce5-e9f0-481e-ac3b-5bfe5cb10bad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.198662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af46ce5-e9f0-481e-ac3b-5bfe5cb10bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.219292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2af46ce5-e9f0-481e-ac3b-5bfe5cb10bad None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:45.221376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2af46ce5-e9f0-481e-ac3b-5bfe5cb10bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.328093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.329670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.334692 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1948/3870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:45.340186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.340186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.340186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.349920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741847f-b64e-4a08-b1cc-e669d286c119 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.365857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.366882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.367283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.368174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] PATH_INFO: `/v3/projects/7b69d94829e34cbb8148ef11c137975e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.371308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b69d94829e34cbb8148ef11c137975e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.373491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.377663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:45.380720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.393574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1949/3871] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:45.399305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.433622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad5db-2dcd-416f-a26f-a3cab95b1db7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.447116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.448507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.450051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.451013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.452239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:45.453319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.455711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.467071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b69d94829e34cbb8148ef11c137975e', 'request_id': 'req-6c21dc8d-3693-4130-ab9c-eac04654c064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.484230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b69d94829e34cbb8148ef11c137975e', 'request_id': 'req-6c21dc8d-3693-4130-ab9c-eac04654c064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.491435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b69d94829e34cbb8148ef11c137975e', 'request_id': 'req-6c21dc8d-3693-4130-ab9c-eac04654c064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.492575 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1950/3872] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:45.494683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.506290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f67bf-f313-4f36-aa08-d040cf6e643e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.526695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] The token cache is being invalidate because project 7b69d94829e34cbb8148ef11c137975e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:45.527716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.529046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c21dc8d-3693-4130-ab9c-eac04654c064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:45.532389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1923/3873] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:45 2022] DELETE /identity/v3/projects/7b69d94829e34cbb8148ef11c137975e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:45.538814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb7fc-93fa-4cc2-9bb7-d12023f570e3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.539675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb7fc-93fa-4cc2-9bb7-d12023f570e3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.539952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb7fc-93fa-4cc2-9bb7-d12023f570e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.577800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-60cfb7fc-93fa-4cc2-9bb7-d12023f570e3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:45.579405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60cfb7fc-93fa-4cc2-9bb7-d12023f570e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.616746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.617428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.617712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.618007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.618967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.620944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.675131 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1951/3874] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/projects => generated 411 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:45.680642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.682875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.702613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1924/3875] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:45.704433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.704937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.706203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.728847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:45.730532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:45.753441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247339d2-534c-4d36-b280-6cabcc5f3185 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.758471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.759266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.759727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.760057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.760876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.763068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.823213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1952/3876] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/users => generated 306 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:45.824369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.834105 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1925/3877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:45.835322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.843183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded47d1-d1c6-4ea8-bb99-b660f559ce3d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.859191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7d59c-45a5-43f7-9e71-496779a5389b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.859375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.859919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.860209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.860539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.861276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.863069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.873252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.876513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1953/3878] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:45.878594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.878877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.879306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.880102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:45.880288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.880589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.882537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.893956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabda1fd-fa27-473f-b1d4-25234403abf8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.897172 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1926/3879] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:45.902029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.909610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.910474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.910767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.911049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.911778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.913750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.913916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503e35-739e-498f-9c4c-dc793247b2ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.919148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.920093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.920491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.921155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.921909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.924043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:45.929112 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1954/3880] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:45.932909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.944677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146394-59a1-40bd-a49d-6be933a094e9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:45.951407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:45.952639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:45.953001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:45.953381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] PATH_INFO: `/v3/projects/56ca6952e8fb440c9a06d487b045cbc0/users/599136c98fd4400898e3468875543781/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:45.965071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1927/3881] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:45.966494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:45.975310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ca6952e8fb440c9a06d487b045cbc0, user_id=599136c98fd4400898e3468875543781, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:45.978975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3b716-b7ce-451b-a657-c52ce15818e9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.004115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1955/3882] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:45 2022] PUT /identity/v3/projects/56ca6952e8fb440c9a06d487b045cbc0/users/599136c98fd4400898e3468875543781/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:46.011856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.013097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.013572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.050997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74401d51-5c64-448c-ba6b-8070ea110420 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.056046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:46.057286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:46.159618 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1956/3883] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:46.167221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.169002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.169232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:46.169982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.170366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.170738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.171533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.173589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.198654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1928/3884] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:45 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:46.202669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.212337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f54563-f7e2-48a1-86f5-d4ff012f4770 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.222207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.222882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.223173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.223511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.224239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.225878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.235116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99babab8-29c6-47e0-9844-7d2ece3beced None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.236225 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1929/3885] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:46.239396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.240009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.240291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.240591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.240736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.249867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.250302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8589b-0f78-444f-9f4b-ede2df2b3ec6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.251326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.255982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.256793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.257173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.257486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.258199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.259895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ac54-eb37-4bb1-8a03-2559db733a11 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.262052 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1957/3886] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:59:46.273521 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1930/3887] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:59:46.277566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.290626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca369e-31e3-488f-bccf-acc7e8c36400 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.298511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.300007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.300402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.300769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] PATH_INFO: `/v3/projects/435fbe2a7f31430dbc15cbea4e1af786/users/6bdb3a21a65d467187e162bfa7eb0d3f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.321094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435fbe2a7f31430dbc15cbea4e1af786, user_id=6bdb3a21a65d467187e162bfa7eb0d3f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.324778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.346256 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1958/3888] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:46 2022] PUT /identity/v3/projects/435fbe2a7f31430dbc15cbea4e1af786/users/6bdb3a21a65d467187e162bfa7eb0d3f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:46.358373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.358726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.358961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.392485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] MFA Rules not processed for user `6bdb3a21a65d467187e162bfa7eb0d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:46.393767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:46.488485 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1931/3889] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:46.499698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.501657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:46.568137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be1e4-847b-4343-af6e-bda67f63b4b1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.574428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.575304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.575761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.576203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.585959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.588230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5794e-a429-44e7-af3a-8dc4054f345f service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.633361 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1959/3890] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:46.645451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.731962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628c90-b33b-494d-9700-b5c707e247ab None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:46.737812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:46.738702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.738986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.739264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] PATH_INFO: `/v3/users/6bdb3a21a65d467187e162bfa7eb0d3f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.740626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdb3a21a65d467187e162bfa7eb0d3f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:46.742632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:46.802158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdb3a21a65d467187e162bfa7eb0d3f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:46.816345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdb3a21a65d467187e162bfa7eb0d3f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:46.817259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdb3a21a65d467187e162bfa7eb0d3f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:46.827632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdb3a21a65d467187e162bfa7eb0d3f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:46.835619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdb3a21a65d467187e162bfa7eb0d3f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:46.852608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:46.852901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:46.853230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:46.854577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1932/3891] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:46 2022] DELETE /identity/v3/users/6bdb3a21a65d467187e162bfa7eb0d3f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:46.871654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:46.872939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:46.943045 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1960/3892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:46.956671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:46.959250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:47.018189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb82b3-a6d0-45e6-a9a2-8144142106a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:47.021825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:47.022483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.022759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.023030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.032714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:47.034732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b666007-05d2-469c-8bb7-212d760b44fa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:47.045053 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1933/3893] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:47.443756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:47.445755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:47.460083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c080c-7c08-414e-b9f0-39ea532039f3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:47.465298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:47.466429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.466901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.467357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] PATH_INFO: `/v3/projects/435fbe2a7f31430dbc15cbea4e1af786` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.468792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=435fbe2a7f31430dbc15cbea4e1af786)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:47.471178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:47.533260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435fbe2a7f31430dbc15cbea4e1af786', 'request_id': 'req-d8672e69-14c1-4eee-bc17-2dbad815b2bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:47.540774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435fbe2a7f31430dbc15cbea4e1af786', 'request_id': 'req-d8672e69-14c1-4eee-bc17-2dbad815b2bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:47.549836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435fbe2a7f31430dbc15cbea4e1af786', 'request_id': 'req-d8672e69-14c1-4eee-bc17-2dbad815b2bf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:47.563267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] The token cache is being invalidate because project 435fbe2a7f31430dbc15cbea4e1af786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:47.563561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:47.564240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8672e69-14c1-4eee-bc17-2dbad815b2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:47.566475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1961/3894] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:47 2022] DELETE /identity/v3/projects/435fbe2a7f31430dbc15cbea4e1af786 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:47.573110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.573637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.573953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.593038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:47.594380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:47.667424 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1934/3895] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:47.675949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.676239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.676545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.701062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:47.702671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:47.717373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1962/3896] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:47.721731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:47.732796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161250a-0dc0-4286-b431-d7ab28dfbf44 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:47.741360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:47.742846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.743496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.743952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.746576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:47.747633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:47.749511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:47.764934 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1935/3897] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:47.769340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:47.781033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017219d2-abbf-4b4f-85f6-a737ebcfc097 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:47.787078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:47.787756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.788041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.788319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.789358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:47.791268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:47.836194 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1963/3898] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:47 2022] POST /identity/v3/projects => generated 359 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:47.840534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:47.853667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370861c-5352-4fde-8f47-b741293985f2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:47.946618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:47.947440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:47.947730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:47.948009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:47.948733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:47.950662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:47.986218 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1936/3899] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:47 2022] POST /identity/v3/users => generated 280 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 20:59:47.986924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.002831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f712b4-0f7b-4d70-9587-b23cc095975c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.008165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.009024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.009410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.009788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.010614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.012316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.024508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1964/3900] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 20:59:48.027985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.040132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8952e79-94ed-4e3d-a927-1b4d0bdf2452 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.046407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.046674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.046896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.047435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.048586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.050805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316f45-8d1d-4e03-9a0e-6cba7926b91f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.061249 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1937/3901] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:48.065437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.080738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a3d-b2cf-430e-b923-68a401775aa2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.087012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.088191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.090346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.090346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] PATH_INFO: `/v3/projects/b6f61e1ac09246f1973b90a2fd027ab8/users/ce0a6276127f460dbdb6ff1aa17d3936/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.107741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f61e1ac09246f1973b90a2fd027ab8, user_id=ce0a6276127f460dbdb6ff1aa17d3936, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.111001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.151140 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1965/3902] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:48 2022] PUT /identity/v3/projects/b6f61e1ac09246f1973b90a2fd027ab8/users/ce0a6276127f460dbdb6ff1aa17d3936/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:48.153697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.154813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.155367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.197113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] MFA Rules not processed for user `ce0a6276127f460dbdb6ff1aa17d3936`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:48.199451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:48.281646 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1938/3903] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:48.333569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.338625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:48.418241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc558bf-fac9-4791-a2f3-c6f173a7618a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.425966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.427476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.428154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.428683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.448368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.452667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc66f9-f949-476b-931e-c4a8ba8cbb89 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.467614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1966/3904] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:48.489778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.595499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f2038-dd1e-4e02-bd3c-a91014416548 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.601042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.602073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.602470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.602975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] PATH_INFO: `/v3/users/ce0a6276127f460dbdb6ff1aa17d3936` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.604255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0a6276127f460dbdb6ff1aa17d3936)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.606274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.661900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0a6276127f460dbdb6ff1aa17d3936'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:48.678901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0a6276127f460dbdb6ff1aa17d3936'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:48.680609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0a6276127f460dbdb6ff1aa17d3936'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:48.690560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0a6276127f460dbdb6ff1aa17d3936'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:48.700156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0a6276127f460dbdb6ff1aa17d3936'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:48.717665 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1939/3905] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:48 2022] DELETE /identity/v3/users/ce0a6276127f460dbdb6ff1aa17d3936 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:48.722694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.723222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.723332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.744032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:48.745306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:48.815049 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1967/3906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:48.825227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:48.826638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:48.900924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7863-fad6-4ba1-a9ca-c88c307cfd50 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:48.904961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:48.905749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:48.906142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:48.906525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:48.918692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:48.920079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77880a-5b7c-4ef5-964e-3f1f55d06551 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:48.930753 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1940/3907] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:49.382987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:49.384447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:49.401667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28795-fc57-4fe9-8eee-ac6ea807f06a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:49.406968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:49.407907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:49.408310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:49.409179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] PATH_INFO: `/v3/projects/b6f61e1ac09246f1973b90a2fd027ab8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:49.410622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f61e1ac09246f1973b90a2fd027ab8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:49.412674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:49.494425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f61e1ac09246f1973b90a2fd027ab8', 'request_id': 'req-709d7d5d-4a35-4b58-9430-cb1963065e3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:49.506505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f61e1ac09246f1973b90a2fd027ab8', 'request_id': 'req-709d7d5d-4a35-4b58-9430-cb1963065e3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:49.532063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f61e1ac09246f1973b90a2fd027ab8', 'request_id': 'req-709d7d5d-4a35-4b58-9430-cb1963065e3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:49.556927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] The token cache is being invalidate because project b6f61e1ac09246f1973b90a2fd027ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:49.557507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:49.558724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-709d7d5d-4a35-4b58-9430-cb1963065e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:49.560791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1968/3908] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:49 2022] DELETE /identity/v3/projects/b6f61e1ac09246f1973b90a2fd027ab8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:49.566765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:49.566985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:49.567276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:49.596879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:49.599013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:49.748780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1941/3909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:49.759185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:49.760270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:49.760821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:49.808438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:49.811872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:49.826154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1969/3910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:49.830941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:49.841609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf888746-6864-4413-ad44-dac69be44ff6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:49.862731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:49.863426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:49.863714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:49.863989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:49.864854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 20:59:49.865196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:49.870092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:49.892360 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1942/3911] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 20:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 20:59:49.897966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:49.921717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd634c-4c08-48f4-a77e-9299193b1790 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:49.933209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:49.934121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:49.934585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:49.935029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:49.935885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:49.938120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:49.974039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1970/3912] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 20:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:49.975131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:49.985533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525042f-3567-4e71-bdb1-5b4ceface54f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:50.053225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:50.054072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.054363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.054642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.055466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:50.057493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:50.081984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1943/3913] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 20:59:49 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 20:59:50.085867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:50.102731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0064-966a-45b8-b956-b5491d48a76e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:50.140006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:50.141013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.141567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.144431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.145459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:50.148329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:50.184827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:50.192553 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1971/3914] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:50.207290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e710-7a62-4729-a124-5a2d391a8ab4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:50.223136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:50.223832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.224168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.224387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.228103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:50.232769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8228-687b-4414-864d-acc30866abe9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:50.255633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1944/3915] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 20:59:50.256608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:50.272440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828bb5f-1b1b-43e6-814f-f83db741a6b3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:50.285080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:50.285999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.286269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.286576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] PATH_INFO: `/v3/projects/90f10744c26b4dbb9b125e1867ed60a8/users/3c1b11db62434348a0cdc4cf20feaf29/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.325539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f10744c26b4dbb9b125e1867ed60a8, user_id=3c1b11db62434348a0cdc4cf20feaf29, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:50.328550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:50.356154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1972/3916] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 20:59:50 2022] PUT /identity/v3/projects/90f10744c26b4dbb9b125e1867ed60a8/users/3c1b11db62434348a0cdc4cf20feaf29/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:50.367863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066bf6-6f02-46eb-b0cf-e92bcbc2804c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.368039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066bf6-6f02-46eb-b0cf-e92bcbc2804c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.368240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066bf6-6f02-46eb-b0cf-e92bcbc2804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.499269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f5066bf6-6f02-46eb-b0cf-e92bcbc2804c None None] MFA Rules not processed for user `3c1b11db62434348a0cdc4cf20feaf29`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:50.499661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f5066bf6-6f02-46eb-b0cf-e92bcbc2804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:50.678526 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1945/3917] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:50.692577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:50.695750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:50.791857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697a15b-b99e-4aa1-881a-dd4dc36e86d8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:50.796005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:50.797011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:50.797464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:50.797921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:50.810447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:50.812631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db5451-9743-4c72-98db-3f4213bad492 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:50.824806 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1973/3918] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:51.831752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:51.832328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:51.832587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:51.871346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] MFA Rules not processed for user `599136c98fd4400898e3468875543781`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:51.872758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:51.968011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1946/3919] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:51.978134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:51.978634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:51.978744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:52.005593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] MFA Rules not processed for user `599136c98fd4400898e3468875543781`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:52.008132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:52.037713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1974/3920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 20:59:52.046656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:52.048316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:52.135919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0dc801-985c-407a-90e7-75d59ce190a8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:52.142003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:52.143244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:52.143550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:52.143814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:52.152493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:52.154101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe4320-cf51-4d44-a790-f2a8116af3db service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:52.165451 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1947/3921] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 20:59:53.539281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:53.604090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c636580-1d19-4cc2-9282-7de1c2c75e21 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:53.608604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:53.609509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:53.609791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:53.610067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] PATH_INFO: `/v3/users/3c1b11db62434348a0cdc4cf20feaf29` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:53.611280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1b11db62434348a0cdc4cf20feaf29)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:53.613213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:53.659520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1b11db62434348a0cdc4cf20feaf29'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:53.666685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1b11db62434348a0cdc4cf20feaf29'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:53.667533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1b11db62434348a0cdc4cf20feaf29'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:53.668230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1b11db62434348a0cdc4cf20feaf29'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:53.676086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1b11db62434348a0cdc4cf20feaf29'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:53.693577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1975/3922] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:59:53 2022] DELETE /identity/v3/users/3c1b11db62434348a0cdc4cf20feaf29 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:53.698729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:53.699186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:53.699404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:53.716165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:53.717414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:53.790770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1948/3923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:53.797393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:53.799630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:53.864470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf1c43-e53f-4eab-8859-8c967a137fbf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:53.869094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:53.869746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:53.870029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:53.870306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:53.883480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:53.884965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034c511-5618-4879-bce6-7d1d87a76f4a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:53.896021 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1976/3924] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 20:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 20:59:54.402112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:54.403703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:54.422590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f44d3d-8018-4a65-9f43-ba400aedf32f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:54.430896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:54.432575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:54.432875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:54.433291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] PATH_INFO: `/v3/projects/90f10744c26b4dbb9b125e1867ed60a8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:54.434967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f10744c26b4dbb9b125e1867ed60a8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:54.445957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:54.452125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:54.452659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:54.453137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:54.475535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 20:59:54.476828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:54.508142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f10744c26b4dbb9b125e1867ed60a8', 'request_id': 'req-6c195420-bb3f-4f31-88a5-d4bebacbeda8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:54.517729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f10744c26b4dbb9b125e1867ed60a8', 'request_id': 'req-6c195420-bb3f-4f31-88a5-d4bebacbeda8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:54.525263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f10744c26b4dbb9b125e1867ed60a8', 'request_id': 'req-6c195420-bb3f-4f31-88a5-d4bebacbeda8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:54.558949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1977/3925] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 20:59:54.559611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] The token cache is being invalidate because project 90f10744c26b4dbb9b125e1867ed60a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 20:59:54.559611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:54.560599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6c195420-bb3f-4f31-88a5-d4bebacbeda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 20:59:54.562688 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1949/3926] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:54 2022] DELETE /identity/v3/projects/90f10744c26b4dbb9b125e1867ed60a8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 20:59:54.582829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 20:59:54.594575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:54.756196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1372f-790c-4a74-b37a-732e66d4ecf3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 20:59:54.890639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 20:59:54.891420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 20:59:54.891781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 20:59:54.892134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 20:59:54.897808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 20:59:54.963106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 20:59:54.965646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 20:59:54.975893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1978/3927] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 20:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:05.150274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa314-3ebe-49fe-9732-1db5b179a694 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:05.150767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa314-3ebe-49fe-9732-1db5b179a694 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:05.150881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa314-3ebe-49fe-9732-1db5b179a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:05.169827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f17fa314-3ebe-49fe-9732-1db5b179a694 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:05.171116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f17fa314-3ebe-49fe-9732-1db5b179a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:05.178380 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1950/3928] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:05.201094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:05.204534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:05.219433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e2ffb-55d9-4605-bfb1-d7a0941495a6 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:05.225757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:05.226398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:05.226694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:05.226936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:05.235468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:05.237131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c88ad-c343-4685-acd9-99f844c97b81 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:05.245100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1979/3929] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:05.830623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:05.831000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:05.831339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:05.849116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] MFA Rules not processed for user `2e7bca7cae174c2c9b83217ea73a973e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:05.850310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:05.920935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1951/3930] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:06.698733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c109-e916-41f3-9a0e-740fc62ebcd2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:06.699282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c109-e916-41f3-9a0e-740fc62ebcd2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:06.700139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400c109-e916-41f3-9a0e-740fc62ebcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:06.717325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e400c109-e916-41f3-9a0e-740fc62ebcd2 None None] MFA Rules not processed for user `4eaee1ddad0041828fb2e65677e2da25`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:06.718799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e400c109-e916-41f3-9a0e-740fc62ebcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:06.796327 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1980/3931] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:16.557841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:16.559426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:16.643167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef20cc-a306-4e2a-8a2b-4f67bde0cb9d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:16.647995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:16.649011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:16.649373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:16.649726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] PATH_INFO: `/v3/users/c1d982c5db7e47a6ae521f2137af3204` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:16.650996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d982c5db7e47a6ae521f2137af3204)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:16.653037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:16.700324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d982c5db7e47a6ae521f2137af3204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:16.713296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d982c5db7e47a6ae521f2137af3204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:16.714004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d982c5db7e47a6ae521f2137af3204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:16.724953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d982c5db7e47a6ae521f2137af3204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:16.733004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d982c5db7e47a6ae521f2137af3204'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:16.749747 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1952/3932] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:16 2022] DELETE /identity/v3/users/c1d982c5db7e47a6ae521f2137af3204 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:16.749907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:16.749907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:16.749907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:16.764566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:16.766044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:16.829254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1981/3933] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:16.839650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:16.841166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:16.912096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0b60b-a088-426e-b789-0c2a63b58f8d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:16.915885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:16.916569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:16.916850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:16.917132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:16.926177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:16.927605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:16.936918 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1953/3934] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:17.111808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:17.113638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:17.127492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0dc88-966e-4565-8c62-14ab3f8b687a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:17.134318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:17.135328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.135636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.136062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] PATH_INFO: `/v3/projects/bf81401733804432b781dd367ab7bd82` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.137391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf81401733804432b781dd367ab7bd82)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:17.139673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:17.191030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf81401733804432b781dd367ab7bd82', 'request_id': 'req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.197268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf81401733804432b781dd367ab7bd82', 'request_id': 'req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.203984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf81401733804432b781dd367ab7bd82', 'request_id': 'req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.214315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] The token cache is being invalidate because project bf81401733804432b781dd367ab7bd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:17.214598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.215223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.216758 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1982/3935] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:17 2022] DELETE /identity/v3/projects/bf81401733804432b781dd367ab7bd82 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:17.221378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:17.232068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef163a6-7bc3-4a2d-8043-9a73b7230756 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:17.285371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:17.286267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.286553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.286829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] PATH_INFO: `/v3/users/730601c0fd034bc481ccef6fc607dac1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.287996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730601c0fd034bc481ccef6fc607dac1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:17.289943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:17.339310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730601c0fd034bc481ccef6fc607dac1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.351363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730601c0fd034bc481ccef6fc607dac1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.352061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730601c0fd034bc481ccef6fc607dac1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.359543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730601c0fd034bc481ccef6fc607dac1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.368307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b50b45e-7a4f-4c91-9981-8e3aa587c667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730601c0fd034bc481ccef6fc607dac1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.378047 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1954/3936] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:17 2022] DELETE /identity/v3/users/730601c0fd034bc481ccef6fc607dac1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:17.571736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:17.573603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:17.601899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9681c-2d9c-4ceb-9cce-abb4cb513ec5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:17.666850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:17.667750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.668081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.668659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] PATH_INFO: `/v3/projects/de86ae49fbdc45948aabfd4a403e326c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.670208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de86ae49fbdc45948aabfd4a403e326c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:17.671837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:17.729925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de86ae49fbdc45948aabfd4a403e326c', 'request_id': 'req-97c3acdc-10ce-49ff-91c1-eb1e75967940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.737248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de86ae49fbdc45948aabfd4a403e326c', 'request_id': 'req-97c3acdc-10ce-49ff-91c1-eb1e75967940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.746825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de86ae49fbdc45948aabfd4a403e326c', 'request_id': 'req-97c3acdc-10ce-49ff-91c1-eb1e75967940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.765695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] The token cache is being invalidate because project de86ae49fbdc45948aabfd4a403e326c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:17.766653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.767562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-97c3acdc-10ce-49ff-91c1-eb1e75967940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:17.769503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1983/3937] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:17 2022] DELETE /identity/v3/projects/de86ae49fbdc45948aabfd4a403e326c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:17.774885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.775397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.775651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.795496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:17.797539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:17.875632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1955/3938] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:17.884012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.884433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.884836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.906130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:17.907419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:17.919696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1984/3939] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:17.924280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:17.938307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d48e-4ab6-43ce-a106-aee9efc7aea5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:17.945999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:17.946885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.947367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.947841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:17.949611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:17.950098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:17.952033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:17.967964 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1956/3940] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:17.973478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:17.991081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fefbf-7302-49a5-9c94-95bb8b736192 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:17.997699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:17.998515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:17.998969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:17.999626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.001432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.004501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.039356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1985/3941] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:17 2022] POST /identity/v3/projects => generated 359 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:18.042884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.062373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d99f5-5a8e-4a89-bd1e-2da0c6469f40 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.162354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.165134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.165630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.165918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.166955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.169172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.192397 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1957/3942] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:18 2022] POST /identity/v3/users => generated 280 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:18.196887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.209778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98affaf2-d387-4085-9f9f-d74c0598e2d9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.221875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.222658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.223009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.223488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.224491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.226195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.238731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1986/3943] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:18.242630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.253312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe47326-c1a0-4c72-8b84-6c6150e363e4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.258661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.259481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.260831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.261135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.261908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.263540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb360291-f6d8-45e7-9be6-8677768cc464 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.283577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1958/3944] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:18.287589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.298181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f6bb-495d-4466-b29d-f94c69a60e4e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.306416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.307751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.308205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.308681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] PATH_INFO: `/v3/projects/b19ddfc5fddd4b628571bb8c8d0407d2/users/b5d93d05441d4de197b3884907bdebde/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.328369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19ddfc5fddd4b628571bb8c8d0407d2, user_id=b5d93d05441d4de197b3884907bdebde, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.331308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.346001 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1987/3945] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:18 2022] PUT /identity/v3/projects/b19ddfc5fddd4b628571bb8c8d0407d2/users/b5d93d05441d4de197b3884907bdebde/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:18.412831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.413149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.413455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.449926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] MFA Rules not processed for user `b5d93d05441d4de197b3884907bdebde`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:18.451488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:18.537709 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1959/3946] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:18.542300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.619892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d6309-9e57-401e-bafe-0726d038f1a1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.625667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.626432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.626718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.626994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.627721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.630823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.665130 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1988/3947] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:18 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:18.669509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.681243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683cc9-a99d-4fc2-a50b-0df3e3c87f2e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.745979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.746813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.747212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.747515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.748496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.750419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.779269 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1960/3948] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:18 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:18.782341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.794137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67597ec7-a223-4819-a262-3cc1cd94c508 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.798919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.799594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.799880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.800162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.800924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.802521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.814800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1989/3949] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:18.818916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.831478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975393b0-b80a-44f3-a6b6-8f5e9ea1e6ff admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.837316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.838256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.838501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.838780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] PATH_INFO: `/v3/projects/756ee9117e924351b14c649e969adaea/users/3e19be78e4f2423bb1cdc73d420105c2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.857866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756ee9117e924351b14c649e969adaea, user_id=3e19be78e4f2423bb1cdc73d420105c2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.860649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.877892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1961/3950] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:18 2022] PUT /identity/v3/projects/756ee9117e924351b14c649e969adaea/users/3e19be78e4f2423bb1cdc73d420105c2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:18.881979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.893990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843368af-6c37-4a12-9a6a-800124b58bd0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.955941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.956801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.957190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.957571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.958384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.960212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b9f74-2ffe-4c26-a9a3-19d33a95780c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:18.971278 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1990/3951] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:18.975003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:18.986684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21a77a-1138-4690-bbd3-3a6522f7ed87 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:18.992087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:18.993228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:18.994062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:18.994062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] PATH_INFO: `/v3/projects/756ee9117e924351b14c649e969adaea/users/3e19be78e4f2423bb1cdc73d420105c2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:18.996054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756ee9117e924351b14c649e969adaea, user_id=3e19be78e4f2423bb1cdc73d420105c2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:18.998945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:19.017615 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1962/3952] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:18 2022] PUT /identity/v3/projects/756ee9117e924351b14c649e969adaea/users/3e19be78e4f2423bb1cdc73d420105c2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:19.021387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:19.021797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:19.022215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:19.051874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] MFA Rules not processed for user `3e19be78e4f2423bb1cdc73d420105c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:19.053369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:19.154228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1991/3953] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:19.618280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:19.620880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:19.707511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64ebc2-f6f4-446d-9dcf-18b704744504 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:19.713486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:19.714022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:19.714328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:19.714604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:19.723711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:19.725359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44243cb-8f48-4510-81a1-8dd2543a65f0 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:19.739016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1963/3954] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:20.512018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:20.594682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515fe5e-34de-466e-9cdd-3fb3e142e7a2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:20.599557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:20.600689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:20.601381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:20.601728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] PATH_INFO: `/v3/users/b5d93d05441d4de197b3884907bdebde` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:20.603014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d93d05441d4de197b3884907bdebde)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:20.605103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:20.658759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d93d05441d4de197b3884907bdebde'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:20.667769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d93d05441d4de197b3884907bdebde'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:20.668447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d93d05441d4de197b3884907bdebde'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:20.669227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d93d05441d4de197b3884907bdebde'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:20.677784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d93d05441d4de197b3884907bdebde'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:20.697462 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1992/3955] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:20 2022] DELETE /identity/v3/users/b5d93d05441d4de197b3884907bdebde => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:20.702135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:20.702631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:20.702744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:20.721638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:20.722937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:20.799061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1964/3956] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:20.845224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:20.846710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:20.909853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f924ed-a6cd-471d-97e0-88e0e3d34431 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:20.914256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:20.914256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:20.914534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:20.914866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:20.924788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:20.926431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:20.941401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1993/3957] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:21.583572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:21.585604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:21.606574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65208fe-d1a8-44a1-8aa5-71d816cb9953 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:21.625445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:21.627470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:21.628134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:21.628950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] PATH_INFO: `/v3/projects/b19ddfc5fddd4b628571bb8c8d0407d2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:21.632074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19ddfc5fddd4b628571bb8c8d0407d2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:21.635673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:21.764653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19ddfc5fddd4b628571bb8c8d0407d2', 'request_id': 'req-d60558d8-528a-4516-8998-e746e513d68b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:21.783223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19ddfc5fddd4b628571bb8c8d0407d2', 'request_id': 'req-d60558d8-528a-4516-8998-e746e513d68b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:21.799079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19ddfc5fddd4b628571bb8c8d0407d2', 'request_id': 'req-d60558d8-528a-4516-8998-e746e513d68b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:21.832519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] The token cache is being invalidate because project b19ddfc5fddd4b628571bb8c8d0407d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:21.841881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:21.844157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:21.849221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1965/3958] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:21 2022] DELETE /identity/v3/projects/b19ddfc5fddd4b628571bb8c8d0407d2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:21.853325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:21.867467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d76f6-73e6-4556-a716-a1f278d3a6e0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:21.994890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:21.996507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:21.997045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:21.997593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] PATH_INFO: `/v3/users/3e19be78e4f2423bb1cdc73d420105c2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:21.999662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e19be78e4f2423bb1cdc73d420105c2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:22.003309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:22.085143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e19be78e4f2423bb1cdc73d420105c2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:22.101430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e19be78e4f2423bb1cdc73d420105c2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:22.102690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e19be78e4f2423bb1cdc73d420105c2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:22.103396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e19be78e4f2423bb1cdc73d420105c2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:22.133718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c552032-cfaa-4e85-af45-3df3c064b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e19be78e4f2423bb1cdc73d420105c2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:22.176613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1994/3959] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:21 2022] DELETE /identity/v3/users/3e19be78e4f2423bb1cdc73d420105c2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:23.029155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.031292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:23.049972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60558d8-528a-4516-8998-e746e513d68b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.177437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.178366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.179751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.180310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] PATH_INFO: `/v3/projects/756ee9117e924351b14c649e969adaea` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.181813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756ee9117e924351b14c649e969adaea)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.185638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:23.344482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756ee9117e924351b14c649e969adaea', 'request_id': 'req-47b14604-0aa1-4a8b-bb50-07d76dd6a887'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:23.351884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756ee9117e924351b14c649e969adaea', 'request_id': 'req-47b14604-0aa1-4a8b-bb50-07d76dd6a887'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:23.359743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756ee9117e924351b14c649e969adaea', 'request_id': 'req-47b14604-0aa1-4a8b-bb50-07d76dd6a887'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:23.380530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] The token cache is being invalidate because project 756ee9117e924351b14c649e969adaea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:23.381269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:23.383840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-47b14604-0aa1-4a8b-bb50-07d76dd6a887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:23.387066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1966/3960] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:23 2022] DELETE /identity/v3/projects/756ee9117e924351b14c649e969adaea => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:23.391080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.391613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.391613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.418370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:23.419676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:23.535995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.536132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1995/3961] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:23.536263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.536263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.571359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:23.574695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:23.594600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1967/3962] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:23.598757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.615174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455967da-ac62-4c24-8741-5ce095efa4d0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.620889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.621626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.621914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.622400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.623344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:23.624198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.626856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:23.640844 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1996/3963] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:23.645512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.664494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded09ff-5ceb-41f2-84ab-9182d57c80b5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.686505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.687197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.687489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.687771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.688683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.693155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:23.759403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.760047 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1968/3964] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:23 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:23.771757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa4567-183d-43f0-ad21-e12bc5d390d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.853599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.854980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.855883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.856176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.857235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.861150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:23.895423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1997/3965] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:23 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:23.901935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.915735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee43bc-f141-4879-86c1-7d1bf125da37 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.923784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.924008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.924447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.925008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.926822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.929630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:23.948921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1969/3966] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:23.950103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:23.962888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64bc4d-354c-4b2a-94c4-57d59576cd44 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:23.979050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:23.979753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:23.980041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:23.980401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:23.981925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:23.982717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08abc7b-87b0-4a6b-b613-2cde17555a09 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.006790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1998/3967] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:24.010364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.022434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac701e1-5940-4e39-8f32-59a16174c479 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.027505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.028777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.029132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.029646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b/users/72e02d8d269e4b079504c6759fd57a4c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.047049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa687e6fcec34214b7558572a2832f9b, user_id=72e02d8d269e4b079504c6759fd57a4c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.050515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.082405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1970/3968] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:24 2022] PUT /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b/users/72e02d8d269e4b079504c6759fd57a4c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:24.083683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.084049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.084412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.121841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] MFA Rules not processed for user `72e02d8d269e4b079504c6759fd57a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:24.123266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:24.245584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 1999/3969] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:24.250404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.331616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ef65-4f91-41d4-b9f7-8fb280011206 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.338379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.339124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.339605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.340047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.341122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.343478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.395945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1971/3970] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:24 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:24.399986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.411212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e8762-bc52-4873-9b9e-40f703ee4b09 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.472519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.473341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.473634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.473913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.474611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.476588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.498041 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2000/3971] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:24 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:24.502110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.512679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad246ee-cdec-4953-86dc-d3fb05210e94 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.518246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.519002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.519364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.519718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.520544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.522228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.533965 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1972/3972] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:24.538450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.549401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162ab72-7b84-41c2-a62b-f434bd49cedd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.554237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.555159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.555446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.555728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] PATH_INFO: `/v3/projects/a8939971113d4a02afb54b2c59fcff4f/users/437e92c3bc95446d95b90ff62029f51d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.571951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8939971113d4a02afb54b2c59fcff4f, user_id=437e92c3bc95446d95b90ff62029f51d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.574714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.591885 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2001/3973] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:24 2022] PUT /identity/v3/projects/a8939971113d4a02afb54b2c59fcff4f/users/437e92c3bc95446d95b90ff62029f51d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:24.596430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.606951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340481-31f4-4984-8e9c-b65f46a78326 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.670738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.671720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.672181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.672696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.673636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.675649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcc00f-a0bc-4f6b-8497-e85058f9f67f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.687937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1973/3974] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:24.691931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.702875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02019050-b5ee-4c92-9fa5-23cb6d5a0d35 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.708305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.709258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.709537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.709819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] PATH_INFO: `/v3/projects/a8939971113d4a02afb54b2c59fcff4f/users/437e92c3bc95446d95b90ff62029f51d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.711863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8939971113d4a02afb54b2c59fcff4f, user_id=437e92c3bc95446d95b90ff62029f51d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.714573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.726306 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2002/3975] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:24 2022] PUT /identity/v3/projects/a8939971113d4a02afb54b2c59fcff4f/users/437e92c3bc95446d95b90ff62029f51d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:24.736944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.737475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.737761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.767922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] MFA Rules not processed for user `437e92c3bc95446d95b90ff62029f51d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:24.769509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:24.844593 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1974/3976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:24.851206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.864705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1850d-1a6a-42bc-9139-280a83ef7a37 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.869433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.870103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.870392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.870675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.871399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:24.871708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.873352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.894693 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2003/3977] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:24.895957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.906413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5007d40-4cc7-418d-97dc-7b6ef6339fb0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:24.911858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:24.912671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:24.913020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:24.915070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:24.915070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:24.916749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:24.953960 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1975/3978] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:24 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:24.959033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:24.970469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1e85b-420c-4db5-96d0-4e0f86b672e9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:25.032992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:25.033666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.033954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.034237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.035159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:25.035406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:25.037038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef98882-9730-4106-b4e8-97d1f78ec9c1 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:25.049739 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2004/3979] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:25.107966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:25.109772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:25.219987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5648d-2e0a-45ca-8894-a6eebcd47bcd tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:25.227753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:25.228877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.229385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.229857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.241119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:25.248689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:25.258351 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1976/3980] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:25.277145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1d103-adb5-4140-982f-8b3a275fee4a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.277488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1d103-adb5-4140-982f-8b3a275fee4a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.277727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1d103-adb5-4140-982f-8b3a275fee4a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.279710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2005/3981] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:25.284550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:25.296666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:25.306305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c505ff-bbad-42e9-851b-8fac6cbcd416 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:25.313433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:25.314853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.315134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.315459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.316720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee4e66850cb74ee4b218624f3b4dba7b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:25.318766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:25.321181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1977/3982] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:25 2022] GET /identity/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b => generated 371 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:25.551231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9ae9-eae3-4628-a82f-22b9cbd5bad1 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.552182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9ae9-eae3-4628-a82f-22b9cbd5bad1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.552488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9ae9-eae3-4628-a82f-22b9cbd5bad1 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.554420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2006/3983] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:25.560973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:25.563052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:25.588501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:25.599667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c6a2-dd53-431e-b6e5-7725e6fd09ea tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:25.604737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:25.605841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:25.606426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:25.606867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:25.608445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee4e66850cb74ee4b218624f3b4dba7b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:25.611319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:25.613102 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1978/3984] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:25 2022] GET /identity/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b => generated 371 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:26.730268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baed9-55d9-490f-83f9-faee85ab805e None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:26.730766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baed9-55d9-490f-83f9-faee85ab805e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:26.731146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41baed9-55d9-490f-83f9-faee85ab805e None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:26.733206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2007/3985] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:26.739577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:26.755908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:26.764979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e21fb-1f1f-4205-ac4d-45fd99506aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:26.770019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:26.770882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:26.771398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:26.771678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:26.772932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=ee4e66850cb74ee4b218624f3b4dba7b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:26.774991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4a77-c8cd-42e3-8bac-8446f3ab1540 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:26.776879 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1979/3986] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:26 2022] GET /identity/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:26.799002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41baed9-55d9-490f-83f9-faee85ab805e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:26.818830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41baed9-55d9-490f-83f9-faee85ab805e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:26.827141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:26.828298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:26.828663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:26.828945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:26.830204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee4e66850cb74ee4b218624f3b4dba7b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:26.832185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:26.882767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4e66850cb74ee4b218624f3b4dba7b', 'request_id': 'req-e47a8141-c911-4a9f-b153-5017b384cc39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:26.890356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4e66850cb74ee4b218624f3b4dba7b', 'request_id': 'req-e47a8141-c911-4a9f-b153-5017b384cc39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:26.900211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4e66850cb74ee4b218624f3b4dba7b', 'request_id': 'req-e47a8141-c911-4a9f-b153-5017b384cc39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:26.910271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] The token cache is being invalidate because project ee4e66850cb74ee4b218624f3b4dba7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:26.910561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:26.911231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:26.924859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2008/3987] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:26 2022] DELETE /identity/v3/projects/ee4e66850cb74ee4b218624f3b4dba7b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:27.217213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1f73-484f-4231-a9e9-53332469fbb2 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.217506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1f73-484f-4231-a9e9-53332469fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.217982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1f73-484f-4231-a9e9-53332469fbb2 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.220934 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1980/3988] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:27.226250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:27.227877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:27.315525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:27.317109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:27.398634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a8141-c911-4a9f-b153-5017b384cc39 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:27.403961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:27.404890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.405576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.405992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.408032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa687e6fcec34214b7558572a2832f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:27.413497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:27.416191 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2009/3989] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:27 2022] GET /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b => generated 373 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:27.435747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1f73-484f-4231-a9e9-53332469fbb2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:27.458970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1f73-484f-4231-a9e9-53332469fbb2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:27.478620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:27.479651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.480269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.480634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.481283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:27.482471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:27.487379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:27.512502 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1981/3990] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:27.517851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:27.535673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356528-15d2-49c2-8507-ba0b2c9244b9 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:27.544818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:27.545592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.546019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.546380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.547214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:27.550679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4bb0-553c-4b0f-aba4-db946de4f80d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:27.605249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2010/3991] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:27 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:27.611069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:27.623849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac250e-a2b7-471e-8f23-f86ffb457ed2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:27.697059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:27.698092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.698385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.699032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.699987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:27.699987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:27.701730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffba8b5-be80-4e30-9cb0-5bc074e295a3 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:27.724390 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1982/3992] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:27.997036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:27.997608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:27.997608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:27.999368 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2011/3993] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:28.006055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d0b-7e43-4be5-b969-e6ec2a10a57e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:28.006666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d0b-7e43-4be5-b969-e6ec2a10a57e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:28.006936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44d0b-7e43-4be5-b969-e6ec2a10a57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:28.035050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-31b44d0b-7e43-4be5-b969-e6ec2a10a57e None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:28.036329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31b44d0b-7e43-4be5-b969-e6ec2a10a57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:28.105973 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1983/3994] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:28.129446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:28.131371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:28.150722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ac719-fbe4-48e6-b574-5490fa1a7d22 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:28.155839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:28.156641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:28.156991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:28.157334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:28.166906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:28.168670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:28.180364 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2012/3995] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:00:29.455990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b372cd-1004-427d-9ab6-bbb4cd956f4b None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:29.456644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b372cd-1004-427d-9ab6-bbb4cd956f4b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:29.456761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b372cd-1004-427d-9ab6-bbb4cd956f4b None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:29.458743 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1984/3996] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:29.466871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:29.470538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:29.650595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:29.668138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2f2ad-2ff4-4a18-bd34-f24d3cb9fc32 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:29.680993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:29.682565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:29.685161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:29.685676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:29.690761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7f0ec86b93c4dd189c56134bd05e47d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:29.702308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:29.706134 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2013/3997] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:29 2022] GET /identity/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d => generated 371 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:30.468759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762537-3173-4d29-8abf-e53c3cc6a6b2 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:30.469289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762537-3173-4d29-8abf-e53c3cc6a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:30.469289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16762537-3173-4d29-8abf-e53c3cc6a6b2 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:30.471086 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1985/3998] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:30.476918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:30.499575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:30.514594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0293a6-0eb8-4721-bbe6-a4f16ffbfb33 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:30.520672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:30.521893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:30.522464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:30.523146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:30.525097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7f0ec86b93c4dd189c56134bd05e47d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:30.528515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:30.531776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2014/3999] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:30 2022] GET /identity/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d => generated 371 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:30.582656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16762537-3173-4d29-8abf-e53c3cc6a6b2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:30.611217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16762537-3173-4d29-8abf-e53c3cc6a6b2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:30.620301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:30.620301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:30.620669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:30.620896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:30.622083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:30.626833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:30.630205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:30.703703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1986/4000] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:30.707866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:30.721082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381f7e2-4fdb-42af-80b5-c29924b228cf tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:30.733409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:30.734500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:30.736642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:30.737162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:30.738090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:30.742639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d6b1-2c3e-4bde-9089-5b85d2e0eb6d tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:30.788399 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2015/4001] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:30 2022] POST /identity/v3/users => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:30.791816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:30.816572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3643e0-63a6-411d-bce9-7e89dd880a3e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:30.823549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:30.825124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:30.827690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:30.828139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:30.828908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:30.829252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:30.831145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:30.847448 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1987/4002] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:31.086584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.086584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.086584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.088269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2016/4003] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:31.093809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:31.119281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:31.135274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398998ee-cb52-4793-a788-014dc2b480b4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:31.145829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:31.149536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.150024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.150472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.151943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7f0ec86b93c4dd189c56134bd05e47d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:31.154436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0a4f4-9f6d-4b20-a0b7-d5c320c30e10 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:31.156679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1988/4004] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:31 2022] GET /identity/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:31.523411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:31.525292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:31.532076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.533541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.534010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.535784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1989/4005] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 21:00:31.541780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:31.563245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:31.594292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a9bdb-d80e-4fa7-b96d-1d16fde1b73a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:31.611585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:31.612482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.612770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.613160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.614553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7f0ec86b93c4dd189c56134bd05e47d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:31.616715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:31.622819 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1990/4006] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:31 2022] GET /identity/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:31.650493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d393ba-9463-43ce-a57c-53e835ca5ff2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:31.662234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:31.663354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.663810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.664253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] PATH_INFO: `/v3/users/a9953e57681446849124a494fa1cdf44` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.668083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:31.669819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9953e57681446849124a494fa1cdf44)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:31.672086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:31.678794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f650f97-849e-4ca4-9eb3-d2201b94044b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:31.696331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:31.697399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.697687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.698264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/users/1075b4ad158f4193a4b58a003d74942a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.719695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1075b4ad158f4193a4b58a003d74942a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:31.722126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:31.775610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9953e57681446849124a494fa1cdf44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.802579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9953e57681446849124a494fa1cdf44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.803831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9953e57681446849124a494fa1cdf44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.804637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9953e57681446849124a494fa1cdf44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.804849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1075b4ad158f4193a4b58a003d74942a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.817011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-529ba8e0-8d25-4d5f-8255-90ccd6c11cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9953e57681446849124a494fa1cdf44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.827635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1075b4ad158f4193a4b58a003d74942a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.828387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1075b4ad158f4193a4b58a003d74942a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.837803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1075b4ad158f4193a4b58a003d74942a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.847682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1075b4ad158f4193a4b58a003d74942a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:31.853473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2017/4007] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:31 2022] DELETE /identity/v3/users/a9953e57681446849124a494fa1cdf44 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:31.854067 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1991/4008] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:31 2022] DELETE /identity/v3/users/1075b4ad158f4193a4b58a003d74942a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:31.857957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:31.858385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.858682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.858968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.859539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:31.906464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:31.907951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:31.955121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8d73-7c4c-4479-b318-509f85de2002 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:31.961252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:31.962134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:31.962419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:31.962697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:31.964084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7f0ec86b93c4dd189c56134bd05e47d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:31.966230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.019582 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2018/4009] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:32.037839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.042106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.059993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f0ec86b93c4dd189c56134bd05e47d', 'request_id': 'req-64676b9f-62cc-4fe5-bed2-6fae2672b746'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.072343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f0ec86b93c4dd189c56134bd05e47d', 'request_id': 'req-64676b9f-62cc-4fe5-bed2-6fae2672b746'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.087756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f0ec86b93c4dd189c56134bd05e47d', 'request_id': 'req-64676b9f-62cc-4fe5-bed2-6fae2672b746'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.103242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] The token cache is being invalidate because project f7f0ec86b93c4dd189c56134bd05e47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:32.103557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.104296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-64676b9f-62cc-4fe5-bed2-6fae2672b746 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.112055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1992/4010] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:31 2022] DELETE /identity/v3/projects/f7f0ec86b93c4dd189c56134bd05e47d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:32.136684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3fa35-3fdc-4d6e-aab1-a46fd57042eb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:32.192831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:32.193623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.193976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.194442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.196624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.241919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.242215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.242597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.244584 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1993/4011] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 21:00:32.249297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:32.251765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.273560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:32.275029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.287154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2019/4012] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:32.357942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.359801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.433621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8812d6f-8d67-468e-983d-7cc27692462d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:32.445782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:32.446760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.447111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.447454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.448763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa687e6fcec34214b7558572a2832f9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:32.454914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41ecb-c4b5-4c46-ac5c-7e88cd533aa2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.458915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1994/4013] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:32 2022] GET /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b => generated 373 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:32.481062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.482847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.496569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.496973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.497639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.499873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1995/4014] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:00:32.506663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbea743-4e49-4bc7-9e24-898f2e5d4f6a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:32.513797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] Authenticating service token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:32.516150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:32.516664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.517172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.517460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.517739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] PATH_INFO: `/v3/projects/d84de315abb1452fa5187770db66041e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.519115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84de315abb1452fa5187770db66041e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:32.522490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.536629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.549422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394beea6-13c5-4c1c-b27d-fe3396a622e2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:32.557221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:32.558235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.558842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.559149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.560734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa687e6fcec34214b7558572a2832f9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:32.563007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.565441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1996/4015] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:32 2022] GET /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b => generated 373 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:32.581743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84de315abb1452fa5187770db66041e', 'request_id': 'req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.588411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84de315abb1452fa5187770db66041e', 'request_id': 'req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.600228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84de315abb1452fa5187770db66041e', 'request_id': 'req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.616847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] The token cache is being invalidate because project d84de315abb1452fa5187770db66041e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:32.617291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.617971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f809ded-0fd7-4ae4-9b96-8fbdff2f91f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.619870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2020/4016] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:32 2022] DELETE /identity/v3/projects/d84de315abb1452fa5187770db66041e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:32.625466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.629369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.657291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d30d0-08fc-439e-8d1d-f891c618a126 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:32.732548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:32.734476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.735129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.735624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] PATH_INFO: `/v3/users/b4291ca807d24faf81284d3951525d0f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.737579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4291ca807d24faf81284d3951525d0f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:32.739916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:32.800694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4291ca807d24faf81284d3951525d0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.821412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4291ca807d24faf81284d3951525d0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.823015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4291ca807d24faf81284d3951525d0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.832644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4291ca807d24faf81284d3951525d0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.845769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4291ca807d24faf81284d3951525d0f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:32.850566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:32.850899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:32.851200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:32.853487 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2021/4017] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 21:00:32.853999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1997/4018] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:32 2022] DELETE /identity/v3/users/b4291ca807d24faf81284d3951525d0f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:32.863748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:00:32.866045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:32.995992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:32.997988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.072225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.074442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.098490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379378-ded1-47c9-905f-168a5ec6bc5f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.104833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437e92c3bc95446d95b90ff62029f51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8939971113d4a02afb54b2c59fcff4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.105642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.105928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.106212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.107444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa687e6fcec34214b7558572a2832f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.109581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.111572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2022/4019] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:00:32 2022] GET /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b => generated 373 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:33.336082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8d06-bb4c-40f7-af7b-67b771b4a60c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.341272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.342134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.342414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.342740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] PATH_INFO: `/v3/projects/8ea0483355034dd9a9fadf514384a916` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.344262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea0483355034dd9a9fadf514384a916)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.346704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.406318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea0483355034dd9a9fadf514384a916', 'request_id': 'req-a141b0be-c775-49f8-9ea5-4fdedd723b14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.415190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.416933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea0483355034dd9a9fadf514384a916', 'request_id': 'req-a141b0be-c775-49f8-9ea5-4fdedd723b14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.417540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.424422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea0483355034dd9a9fadf514384a916', 'request_id': 'req-a141b0be-c775-49f8-9ea5-4fdedd723b14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.437230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fdee-ebfc-4506-8bcb-92c489f32f6b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.443130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] The token cache is being invalidate because project 8ea0483355034dd9a9fadf514384a916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:33.443616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.444421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a141b0be-c775-49f8-9ea5-4fdedd723b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.452539 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1998/4020] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:33 2022] DELETE /identity/v3/projects/8ea0483355034dd9a9fadf514384a916 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:33.454401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.454768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.454961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.484066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:33.485316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.527705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.528736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.529010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.529304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] PATH_INFO: `/v3/users/2e7bca7cae174c2c9b83217ea73a973e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.530603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7bca7cae174c2c9b83217ea73a973e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.532833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.563238 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 1999/4021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:33.565620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.567026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.579878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e277-5377-4c44-8db7-a57ed5d1e1f6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.584948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.585808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.586092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.586360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] PATH_INFO: `/v3/users/72e02d8d269e4b079504c6759fd57a4c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.587933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e02d8d269e4b079504c6759fd57a4c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.589905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.591875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7bca7cae174c2c9b83217ea73a973e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.600808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7bca7cae174c2c9b83217ea73a973e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.601662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7bca7cae174c2c9b83217ea73a973e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.602874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7bca7cae174c2c9b83217ea73a973e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.613915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e9b02982-c58f-4854-baea-82953814891c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7bca7cae174c2c9b83217ea73a973e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.634953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2023/4022] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:33 2022] DELETE /identity/v3/users/2e7bca7cae174c2c9b83217ea73a973e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:33.638142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.638393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.638833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.649020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e02d8d269e4b079504c6759fd57a4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.659305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:33.660564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.665641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e02d8d269e4b079504c6759fd57a4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.666534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e02d8d269e4b079504c6759fd57a4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.679985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e02d8d269e4b079504c6759fd57a4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.694398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-82f3aee8-e316-40d8-8460-ab0022976484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e02d8d269e4b079504c6759fd57a4c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:33.701314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2000/4023] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:33 2022] DELETE /identity/v3/users/72e02d8d269e4b079504c6759fd57a4c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:33.705950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.706321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.706675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.727045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:33.728429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.757705 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2024/4024] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:33.762277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.771152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f612e4-fdea-43fe-a5b0-cd9fe06087a4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.794208 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2001/4025] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:33.810178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.812165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.831262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.832072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.832424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.832815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.833697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:33.834103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.835811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.852836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2025/4026] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:33.857827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.872907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e92d-a9e0-4b61-aebc-6d7796a15af2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.879291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.880516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.881087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.881368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.882065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.884291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d194e-0a8e-47b3-a1a1-d41653b4c5a5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:33.884515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.889392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:33.890054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:33.890683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:33.890968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:33.901256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:33.903793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:33.912782 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2026/4027] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:33 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:33.914122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.915004 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2002/4028] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:00:33.916595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:33.916856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:33.927202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fd01-1198-4544-94b8-ad77ec00d45b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.002662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a755e-95af-4693-b5dc-61f858f419c4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.002897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.003352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.003635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.003910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.006319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.009426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.010938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.012344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.012840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.013309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] PATH_INFO: `/v3/projects/784e9ed7207a4d9e970e3d496574e6d1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.014848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784e9ed7207a4d9e970e3d496574e6d1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.017247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.035169 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2003/4029] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:33 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:34.036050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.046540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e69e9-6467-4dd1-b8f5-8b3f6919e9ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.052695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.053375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.053803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.053932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.054782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.056753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.071388 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2004/4030] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:34.073332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.075045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784e9ed7207a4d9e970e3d496574e6d1', 'request_id': 'req-c9ab4269-af2b-433d-ad5e-7391e0c404b3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.082180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784e9ed7207a4d9e970e3d496574e6d1', 'request_id': 'req-c9ab4269-af2b-433d-ad5e-7391e0c404b3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.084925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74de4f1-1a68-402e-a340-d1193d1b49f3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.089208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784e9ed7207a4d9e970e3d496574e6d1', 'request_id': 'req-c9ab4269-af2b-433d-ad5e-7391e0c404b3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.103542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] The token cache is being invalidate because project 784e9ed7207a4d9e970e3d496574e6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:34.104193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.105939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c9ab4269-af2b-433d-ad5e-7391e0c404b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.108447 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2027/4031] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:33 2022] DELETE /identity/v3/projects/784e9ed7207a4d9e970e3d496574e6d1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:34.113783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cd0b3-f954-4f51-8767-204f5084a39b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.114382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cd0b3-f954-4f51-8767-204f5084a39b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.115334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cd0b3-f954-4f51-8767-204f5084a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.150843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-761cd0b3-f954-4f51-8767-204f5084a39b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:34.152923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-761cd0b3-f954-4f51-8767-204f5084a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.180761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.182314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.182804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.183311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.185019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.187620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.204031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2005/4032] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:34.208517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.210326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.225181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd43d-5af0-41b9-848d-12a5186c9ef5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.231372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.232666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.232956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.233238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] PATH_INFO: `/v3/projects/b271883cfeac443e8f5d5f2e555835d7/users/7a9228e1bd8248bba26145bdbf7e2378/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.237272 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2028/4033] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:34.244737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.245411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.245925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.255310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b271883cfeac443e8f5d5f2e555835d7, user_id=7a9228e1bd8248bba26145bdbf7e2378, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.258398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a6fe-29b1-4e88-83f2-764e722122ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.276255 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2006/4034] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:34 2022] PUT /identity/v3/projects/b271883cfeac443e8f5d5f2e555835d7/users/7a9228e1bd8248bba26145bdbf7e2378/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:34.289211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.289623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.289901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.290289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:34.291578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.345879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] MFA Rules not processed for user `7a9228e1bd8248bba26145bdbf7e2378`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:34.348613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.385771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2029/4035] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:34.385771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.385771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.399315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01405bee-3f5a-4fc0-9dbf-ae625ea93a5f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.404976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.405890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.406196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.406474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] PATH_INFO: `/v3/projects/aa687e6fcec34214b7558572a2832f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.408294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa687e6fcec34214b7558572a2832f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.410721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.429064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2007/4036] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:34.430225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.473922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5a97-a6f4-4217-a66d-7e2dda1c54ac None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.486282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa687e6fcec34214b7558572a2832f9b', 'request_id': 'req-8bb0f627-d48f-4cac-848a-a9c21d4fddef'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.497393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa687e6fcec34214b7558572a2832f9b', 'request_id': 'req-8bb0f627-d48f-4cac-848a-a9c21d4fddef'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.509206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa687e6fcec34214b7558572a2832f9b', 'request_id': 'req-8bb0f627-d48f-4cac-848a-a9c21d4fddef'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.534123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] The token cache is being invalidate because project aa687e6fcec34214b7558572a2832f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:34.534416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.535265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8bb0f627-d48f-4cac-848a-a9c21d4fddef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.540086 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2030/4037] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:34 2022] DELETE /identity/v3/projects/aa687e6fcec34214b7558572a2832f9b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:34.541636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.542936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.543860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.579047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.580436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.580769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.580919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.581622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:34.581931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.583694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.585360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] MFA Rules not processed for user `7a9228e1bd8248bba26145bdbf7e2378`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:34.586628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.599422 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2008/4038] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:34.600365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.602135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.618195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09395da-95ae-4a56-9b7d-a16ef7739e22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.624696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.626558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.626558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.626941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] PATH_INFO: `/v3/users/437e92c3bc95446d95b90ff62029f51d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.628249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437e92c3bc95446d95b90ff62029f51d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.631168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.661677 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2031/4039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:34.663472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.665326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.681673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04ddd-f00f-43a1-93f0-f6c1f6772460 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.687304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.688282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.689310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.689793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.690291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437e92c3bc95446d95b90ff62029f51d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.690502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.692400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.703512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437e92c3bc95446d95b90ff62029f51d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.705127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437e92c3bc95446d95b90ff62029f51d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.715264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437e92c3bc95446d95b90ff62029f51d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.724493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2032/4040] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:34.724493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.724832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.734540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437e92c3bc95446d95b90ff62029f51d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:34.744978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2009/4041] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:34 2022] DELETE /identity/v3/users/437e92c3bc95446d95b90ff62029f51d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:34.746119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.748564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.816966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742b769-bb40-4224-ab00-fe8b237e76f2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.834474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f52f3-27a8-47cc-9a67-72f1dc92fc03 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.841000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.842052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.842564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.843174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.844611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.849683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.887434 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2010/4042] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:34 2022] POST /identity/v3/users => generated 280 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:34.888779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.902845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b154-3bfb-49db-91c9-f7dca1d5b155 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.904301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.906868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.911778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.911778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.913492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:34.913749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.914935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.915705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.916445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.917460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.919407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.931717 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2011/4043] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:34.936076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.950420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f202ad-33b4-4f71-be49-6f5133711d03 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:34.956475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:34.957498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:34.957868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:34.958226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:34.959023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.960799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:34.982629 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2012/4044] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:34.984609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:34.990289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:34.992220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3edb5-aa59-4590-9744-9844f5993004 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:35.008412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d4c0-1267-4d69-b4e6-6b1c93c2a97a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:35.018394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2033/4045] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:35.022157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:35.023078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.023364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.023647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] PATH_INFO: `/v3/projects/ae6e4cd4782444e9917cb654292a66d6/users/01b23f37948449f6bb7f755c7d238141/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.062437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6e4cd4782444e9917cb654292a66d6, user_id=01b23f37948449f6bb7f755c7d238141, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:35.064964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:35.089361 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2013/4046] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:34 2022] PUT /identity/v3/projects/ae6e4cd4782444e9917cb654292a66d6/users/01b23f37948449f6bb7f755c7d238141/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:35.101493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.101708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.102182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.155110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] MFA Rules not processed for user `01b23f37948449f6bb7f755c7d238141`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:35.156605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:35.300137 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2034/4047] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:35.312404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:35.314658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:35.474494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e97fc-2a76-4534-8b4b-461c1e630b4b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:35.483558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:35.484372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.484845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.485119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.494298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:35.495886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:35.507596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2014/4048] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:35.562859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:35.686196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:35.689205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:35.698438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4ad66-fdb9-4229-a60c-f8941d9d425c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:35.719654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:35.722327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.722627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.722924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] PATH_INFO: `/v3/users/01b23f37948449f6bb7f755c7d238141` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.726480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b23f37948449f6bb7f755c7d238141)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:35.727881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fb19-2c9c-4180-9eb7-f154e104477d service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:35.732728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:35.742103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:35.743868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.744735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.745576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] PATH_INFO: `/v3/projects/a8939971113d4a02afb54b2c59fcff4f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.748413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8939971113d4a02afb54b2c59fcff4f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:35.754439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:35.841086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b23f37948449f6bb7f755c7d238141'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.858117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b23f37948449f6bb7f755c7d238141'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.859090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b23f37948449f6bb7f755c7d238141'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.861683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b23f37948449f6bb7f755c7d238141'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.879765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa51f651-291b-425b-9edc-806023014f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b23f37948449f6bb7f755c7d238141'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.926506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2035/4049] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:35 2022] DELETE /identity/v3/users/01b23f37948449f6bb7f755c7d238141 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:35.929673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:35.930968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:35.931143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:35.937753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8939971113d4a02afb54b2c59fcff4f', 'request_id': 'req-108b1b48-d46b-4e88-87ba-033bb715fe24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.958944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8939971113d4a02afb54b2c59fcff4f', 'request_id': 'req-108b1b48-d46b-4e88-87ba-033bb715fe24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.970951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8939971113d4a02afb54b2c59fcff4f', 'request_id': 'req-108b1b48-d46b-4e88-87ba-033bb715fe24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.974017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:35.975282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:35.993341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] The token cache is being invalidate because project a8939971113d4a02afb54b2c59fcff4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:35.994092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.994863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-108b1b48-d46b-4e88-87ba-033bb715fe24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:35.999462 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2015/4050] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:35 2022] DELETE /identity/v3/projects/a8939971113d4a02afb54b2c59fcff4f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:36.007243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545499ec-57eb-4aa9-820a-16456c945752 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.007243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545499ec-57eb-4aa9-820a-16456c945752 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.007649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545499ec-57eb-4aa9-820a-16456c945752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.055377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-545499ec-57eb-4aa9-820a-16456c945752 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:36.056607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-545499ec-57eb-4aa9-820a-16456c945752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:36.100617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2036/4051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:36.109060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.112241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:36.163484 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2016/4052] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:36.171453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.171900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.172416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.212801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:36.215448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:36.229300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0f3c-2fb9-444e-80aa-459391212c7a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.233950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2017/4053] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:36.239357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.240288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.242304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.242709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.243110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.255505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de21079-738b-4aff-a081-88d0f989b092 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.266248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.268491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.269139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.269603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.271133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:36.271618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.272199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.274187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.274489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.291261 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2037/4054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:36.295106 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2018/4055] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:36.300635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.322484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38b18-51c3-4863-b2ca-13da328b0b80 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.330666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.331640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.333250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.333938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.334982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.338339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.388505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2038/4056] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:36.392537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.404579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d214f22-5127-41ab-9b35-a403c46f1754 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.492485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.493187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.493475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.493752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.494592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.497101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.527898 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2019/4057] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:36.528963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.543138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d88e0-30ef-4595-b92d-f16c92b8e46e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.548991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.549685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.549968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.550229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.550959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.553386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.569617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2039/4058] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:36.573961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.597433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32502d1e-3da0-4e9b-8da9-988e8965cc59 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.607579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.608372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.609132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.609486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.610331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.612305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1493d2-6d81-44b8-90b3-6cda72dfdf64 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.625198 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2020/4059] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:36.629284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.642724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30013f-0f1d-4010-acc9-772f6595340b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.648037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.648959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.649245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.649523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] PATH_INFO: `/v3/projects/0e9312a463f0419ca125b1155492d2c5/users/41359fff35654f228021d168daf5f8d3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.665945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9312a463f0419ca125b1155492d2c5, user_id=41359fff35654f228021d168daf5f8d3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.669168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.684310 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2040/4060] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:36 2022] PUT /identity/v3/projects/0e9312a463f0419ca125b1155492d2c5/users/41359fff35654f228021d168daf5f8d3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:36.697372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.697891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.698284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.729428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] MFA Rules not processed for user `41359fff35654f228021d168daf5f8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:36.731050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:36.801332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2021/4061] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:36.805470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.888888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860a388-db40-404f-97d4-01087c818ec7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:36.894411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:36.895171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:36.895461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:36.895780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:36.896517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:36.898561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:36.926247 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2041/4062] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:36.930265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:36.941667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb35ed-f6bc-4f88-a5b3-5b4cd5cce44a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.033299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.034007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.034284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.034522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.035217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.037160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.067493 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2022/4063] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:36 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:37.071708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.087943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa53a-e5d3-4246-9a40-b8532d1a3fde admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.093588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.094427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.095355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.095713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.096549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.098655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.117738 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2042/4064] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:37.122548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.144637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0f29-f1de-4af5-a2f5-11f0d5cd134e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.160846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.161423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.162505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.162653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.164638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.166311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] PATH_INFO: `/v3/projects/e82913a6c5214b0d87081cbf003fecf1/users/fc36955174db4ee3b411ab3d3c97b743/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.176845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fa1f-3127-4e74-a04a-3f1f86a525c6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.182051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.184531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.184836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.185268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] PATH_INFO: `/v3/projects/ae6e4cd4782444e9917cb654292a66d6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.186617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6e4cd4782444e9917cb654292a66d6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.188985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.203915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82913a6c5214b0d87081cbf003fecf1, user_id=fc36955174db4ee3b411ab3d3c97b743, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.207377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.247489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2023/4065] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:37 2022] PUT /identity/v3/projects/e82913a6c5214b0d87081cbf003fecf1/users/fc36955174db4ee3b411ab3d3c97b743/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:37.252562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.291205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6e4cd4782444e9917cb654292a66d6', 'request_id': 'req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:37.298433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6e4cd4782444e9917cb654292a66d6', 'request_id': 'req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:37.310442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6e4cd4782444e9917cb654292a66d6', 'request_id': 'req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:37.335382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] The token cache is being invalidate because project ae6e4cd4782444e9917cb654292a66d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:37.335754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:37.338502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c90cb9b9-9659-44b0-ae95-9dcf532c8bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:37.341736 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2043/4066] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:37 2022] DELETE /identity/v3/projects/ae6e4cd4782444e9917cb654292a66d6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:37.347490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.347793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.348081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.379237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd102cea-f892-4325-b2d0-023ea9570b0f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.385229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:37.386435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.509465 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2044/4067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:37.511505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.512355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.512581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.512892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.513694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.515351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ec40f-5c22-4ce1-aabe-7ab6ce16a713 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.531194 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2024/4068] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:37.533327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.534916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.553774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913ad1d-4de2-4952-9792-e3be1d6fb16f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.560165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.561570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.562062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.562589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] PATH_INFO: `/v3/projects/e82913a6c5214b0d87081cbf003fecf1/users/fc36955174db4ee3b411ab3d3c97b743/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.566036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82913a6c5214b0d87081cbf003fecf1, user_id=fc36955174db4ee3b411ab3d3c97b743, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.570527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a2587-e988-4328-bb97-ec0aaaff8431 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.582150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.582827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.583656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.586199 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2045/4069] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:37 2022] PUT /identity/v3/projects/e82913a6c5214b0d87081cbf003fecf1/users/fc36955174db4ee3b411ab3d3c97b743/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:37.598024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435738-7dc3-4186-aa83-b72c4d56c58b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.598447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435738-7dc3-4186-aa83-b72c4d56c58b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.599170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40435738-7dc3-4186-aa83-b72c4d56c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.609272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:37.610548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.629501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-40435738-7dc3-4186-aa83-b72c4d56c58b None None] MFA Rules not processed for user `fc36955174db4ee3b411ab3d3c97b743`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:37.630723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-40435738-7dc3-4186-aa83-b72c4d56c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.710897 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2025/4070] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:37.711479 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2046/4071] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:37.712159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.721675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7901069-8949-4110-87c5-71c03727b1ca None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.723568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.723841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.724130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.727645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.728346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.728670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.728944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.729658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:37.729959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.734692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.743001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] MFA Rules not processed for user `41359fff35654f228021d168daf5f8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:37.744303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.748005 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2026/4072] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:37.752902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.764693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294bc9c-e13f-48fa-86c4-8d50c250a3a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.772939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.773696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.774039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.774381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.775293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.777908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.823242 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2027/4073] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:37.826339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.832802 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2047/4074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:37.837366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.839307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:37.899419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735599-e0c3-46c7-9b42-5b227da33ff4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.905722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.906536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.906793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.907072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.907802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.909746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.927758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d9a6-1b06-43dc-b19b-01a5d56cb70c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.940789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2028/4075] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:37 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:37.941440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.953397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989d68-ca49-41c4-bf18-032653e662f2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.960626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.961367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.961653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.961939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.962650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:37.964245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:37.975685 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2029/4076] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:37.980229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:37.991579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f472d40-cb9c-4533-9295-cac61d3ff3ed admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:37.997077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:37.997816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:37.998085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:37.998368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:37.999254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:38.000944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:38.016843 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2030/4077] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:38.020443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:38.029784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:38.030729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:38.031184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:38.031544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:38.033978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:38.036943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09dd42-7a81-4ca4-b440-06478d08d629 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:38.043048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:38.044171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:38.044374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:38.044642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] PATH_INFO: `/v3/projects/67592663633d4cd89aed8f728fd7ca86/users/3dfe516204634bdd902f2e1236d7a6ec/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:38.079372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67592663633d4cd89aed8f728fd7ca86, user_id=3dfe516204634bdd902f2e1236d7a6ec, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:38.083324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ea278-c9bf-4808-8bbb-2a91741fffe4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:38.100098 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2031/4078] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:38 2022] PUT /identity/v3/projects/67592663633d4cd89aed8f728fd7ca86/users/3dfe516204634bdd902f2e1236d7a6ec/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:38.105021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56188-4f7b-4d9e-bea3-80efe87e8b9e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:38.105402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56188-4f7b-4d9e-bea3-80efe87e8b9e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:38.105749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56188-4f7b-4d9e-bea3-80efe87e8b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:38.117691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:38.119414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:38.127139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-84b56188-4f7b-4d9e-bea3-80efe87e8b9e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:38.128877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-84b56188-4f7b-4d9e-bea3-80efe87e8b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:38.144880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2048/4079] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:00:38.232035 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2032/4080] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:38.288193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:38.289783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:38.419372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdd464-5dff-4f01-80bd-45a1542f322d service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:38.545996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:38.546438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:38.546723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:38.547059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:38.580528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:38.582302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:38.599166 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2049/4081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:39.380396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71555c-7756-4fe8-8179-5859f78963eb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:39.380984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71555c-7756-4fe8-8179-5859f78963eb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:39.381177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71555c-7756-4fe8-8179-5859f78963eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:39.404736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2f71555c-7756-4fe8-8179-5859f78963eb None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:39.406237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f71555c-7756-4fe8-8179-5859f78963eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:39.527821 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2033/4082] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:39.547674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:39.554847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:39.829755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f5a9-a483-4c1c-9ea9-98a211cffc32 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:39.858762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:39.859880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:39.861630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:39.862867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:39.880315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:39.884037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf41aa-c045-4030-8922-e7b3842c8e9e service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:39.922122 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2050/4083] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:40.593836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:40.593836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:40.593836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:40.665375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:40.670803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:40.830374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2034/4084] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:40.841564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:40.842839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:40.843344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:40.875877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:40.878571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:40.900060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2051/4085] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:40.935232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:40.939416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:41.081475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f902f-78ed-44ec-a197-c84833f8366b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:41.089302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:41.093123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:41.093506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:41.093964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:41.124797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:41.127144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:41.141262 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2035/4086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:46.247350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:46.249476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:46.270191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d8213-f1a2-4048-95ef-2653ebdf6b5d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:46.276364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:46.277657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:46.278449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:46.278983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] PATH_INFO: `/v3/users/599136c98fd4400898e3468875543781` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:46.281190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599136c98fd4400898e3468875543781)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:46.284482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:46.385630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599136c98fd4400898e3468875543781'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:46.405144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599136c98fd4400898e3468875543781'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:46.406211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599136c98fd4400898e3468875543781'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:46.407741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599136c98fd4400898e3468875543781'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:46.423938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-57981a43-95fc-4f6f-9a72-06dd9afd36e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599136c98fd4400898e3468875543781'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:46.502514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2052/4087] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:46 2022] DELETE /identity/v3/users/599136c98fd4400898e3468875543781 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:47.045938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:47.060821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4997bb-345e-4b2a-a6d2-4d97314797bd service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:47.200067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:47.201292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.201578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.201856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] PATH_INFO: `/v3/projects/56ca6952e8fb440c9a06d487b045cbc0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.203708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ca6952e8fb440c9a06d487b045cbc0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:47.206690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:47.294227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ca6952e8fb440c9a06d487b045cbc0', 'request_id': 'req-c2803dca-fd24-48f5-b2cd-35aaf1994d87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:47.305630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ca6952e8fb440c9a06d487b045cbc0', 'request_id': 'req-c2803dca-fd24-48f5-b2cd-35aaf1994d87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:47.311827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ca6952e8fb440c9a06d487b045cbc0', 'request_id': 'req-c2803dca-fd24-48f5-b2cd-35aaf1994d87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:47.339442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] The token cache is being invalidate because project 56ca6952e8fb440c9a06d487b045cbc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:47.339748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:47.342713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2803dca-fd24-48f5-b2cd-35aaf1994d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:47.352842 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2036/4088] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:47 2022] DELETE /identity/v3/projects/56ca6952e8fb440c9a06d487b045cbc0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:47.358137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.358634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.358877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.386848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:47.389407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:47.498910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2053/4089] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:47.502247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.502549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.502831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.533202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:47.534734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:47.547334 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2037/4090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:47.548608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:47.572492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26745344-55a6-4ed2-af8d-b7d08143b141 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:47.597228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:47.598290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.600129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.601521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.604984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:47.606214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:47.609978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:47.644350 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2054/4091] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:47.645591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:47.658030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3f3a3-570f-4c9e-8510-997517d177d6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:47.670161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:47.670847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.671142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.671422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.676470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:47.681628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:47.738679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2038/4092] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:47 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:47.741621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:47.752879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b32c4-a670-420b-a192-c3d633bf3395 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:47.877391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:47.878438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.878993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.879277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.880037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:47.882295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:47.947795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2055/4093] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:47 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:47.951656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:47.966101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45c32-cf2f-420f-aa2d-d19a313bfbd7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:47.974382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:47.975405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:47.975994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:47.976584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:47.977548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:47.979352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:48.004939 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2039/4094] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:48.009018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:48.026605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c33e6-8500-4396-a3ee-f06d7e8a1646 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:48.042114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:48.043177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:48.043639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:48.044089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:48.045020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:48.047023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e18f-f3e0-4a45-b88d-5cfff67e1990 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:48.077953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2056/4095] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:48.082477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:48.100124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b07d22-a75c-4433-8ce0-6bbffc031ffb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:48.105356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:48.106405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:48.106697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:48.106976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] PATH_INFO: `/v3/projects/3eb50f24a3f64b759a99b9b20c150caf/users/c9a56ed7266f40e18f6a3aaacdd064f6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:48.127644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb50f24a3f64b759a99b9b20c150caf, user_id=c9a56ed7266f40e18f6a3aaacdd064f6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:48.133278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:48.155504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2040/4096] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:48 2022] PUT /identity/v3/projects/3eb50f24a3f64b759a99b9b20c150caf/users/c9a56ed7266f40e18f6a3aaacdd064f6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:48.169025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615075dc-b2ac-4564-85a6-86c963b0b9f4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:48.169309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615075dc-b2ac-4564-85a6-86c963b0b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:48.169905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615075dc-b2ac-4564-85a6-86c963b0b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:48.200426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-615075dc-b2ac-4564-85a6-86c963b0b9f4 None None] MFA Rules not processed for user `c9a56ed7266f40e18f6a3aaacdd064f6`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:48.201738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-615075dc-b2ac-4564-85a6-86c963b0b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:48.361369 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2057/4097] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:48.378950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:48.380962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:48.547277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7608c-9aac-4867-93bc-570fbdf8def2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:48.558433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:48.560168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:48.560474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:48.561941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:48.577531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:48.582663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:48.592061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2041/4098] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:48.826160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fff05-dc87-41ac-8b16-d8801b6ee1e3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:48.826842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fff05-dc87-41ac-8b16-d8801b6ee1e3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:48.827442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fff05-dc87-41ac-8b16-d8801b6ee1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:48.872763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b35fff05-dc87-41ac-8b16-d8801b6ee1e3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:48.874811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b35fff05-dc87-41ac-8b16-d8801b6ee1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:49.041883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2058/4099] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:49.073953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:49.075739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:49.210700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77bff0-dc57-4cf0-9693-7777324f5543 service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:49.217904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:49.218709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:49.219121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:49.219513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:49.231518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:49.234124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:49.252548 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2042/4100] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.282276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.282775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.282887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.310836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:56.312325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:56.330478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2059/4101] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:56.350204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:56.369523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b581-4cf5-453a-b696-7b56e2a45ad3 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:56.378286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:56.379567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.379956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.380345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.397784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:56.401930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:56.426838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2043/4102] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.599039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:56.600733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:56.669954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:56.737463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b50ff-ecb2-4b3e-ac16-266a23348fef None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:56.745207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:56.746629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.747495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.748036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] PATH_INFO: `/v3/users/7a9228e1bd8248bba26145bdbf7e2378` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.750391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9228e1bd8248bba26145bdbf7e2378)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:56.753585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:56.785537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d55b7-e92b-4b49-9168-829ea329dcc7 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:56.792600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:56.794000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.794745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.795195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] PATH_INFO: `/v3/users/c9a56ed7266f40e18f6a3aaacdd064f6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.797051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a56ed7266f40e18f6a3aaacdd064f6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:56.799875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:56.863690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a56ed7266f40e18f6a3aaacdd064f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.864006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9228e1bd8248bba26145bdbf7e2378'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.874429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9228e1bd8248bba26145bdbf7e2378'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.876355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9228e1bd8248bba26145bdbf7e2378'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.877221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9228e1bd8248bba26145bdbf7e2378'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.879234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a56ed7266f40e18f6a3aaacdd064f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.880154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a56ed7266f40e18f6a3aaacdd064f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.886499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a745f1ce-68f0-4578-8cea-df5b0ef10f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9228e1bd8248bba26145bdbf7e2378'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.890324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a56ed7266f40e18f6a3aaacdd064f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.905375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2060/4103] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:56 2022] DELETE /identity/v3/users/7a9228e1bd8248bba26145bdbf7e2378 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:56.912549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.912847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.913130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.914314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c461899c-781b-4bc2-b094-7ec783b661db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a56ed7266f40e18f6a3aaacdd064f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:56.922942 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2044/4104] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:00:56 2022] DELETE /identity/v3/users/c9a56ed7266f40e18f6a3aaacdd064f6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:56.929041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:56.929649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:56.930368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:56.935854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:56.937670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:56.955618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:56.957727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.031455 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2045/4105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:57.035945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2061/4106] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:57.045933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.046176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.047674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.048856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.127191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80439e59-77b5-41cf-a7df-b7fe6910ebd9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.135267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.150710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.152608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.152770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.152870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52c5d-d6be-4153-9e9d-2ba1b6558bb3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.161566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.162234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.162522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.162805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.171267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.173164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.176432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.178077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e4b57-b5a1-4a57-99fb-9b14e18fe74c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.183969 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2062/4107] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:00:57.189708 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2046/4108] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:57.386301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.389010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.402856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce090-dbfd-4644-99ba-2ed389b8722f service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.411379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.412892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.413337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.413625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] PATH_INFO: `/v3/projects/b271883cfeac443e8f5d5f2e555835d7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.414871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b271883cfeac443e8f5d5f2e555835d7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.416830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.468235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b271883cfeac443e8f5d5f2e555835d7', 'request_id': 'req-c21b5033-a5b7-400f-a360-0b8f27c43436'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.474327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b271883cfeac443e8f5d5f2e555835d7', 'request_id': 'req-c21b5033-a5b7-400f-a360-0b8f27c43436'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.481965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b271883cfeac443e8f5d5f2e555835d7', 'request_id': 'req-c21b5033-a5b7-400f-a360-0b8f27c43436'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.498600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] The token cache is being invalidate because project b271883cfeac443e8f5d5f2e555835d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:57.499224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.499974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.503252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2063/4109] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:57 2022] DELETE /identity/v3/projects/b271883cfeac443e8f5d5f2e555835d7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:57.508089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330f4f-439d-40a5-a959-c155ec95431a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.508683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330f4f-439d-40a5-a959-c155ec95431a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.508683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca330f4f-439d-40a5-a959-c155ec95431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.515327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.516991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.530897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca330f4f-439d-40a5-a959-c155ec95431a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:57.532211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca330f4f-439d-40a5-a959-c155ec95431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.611679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2047/4110] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:57.620987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.621653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.622185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.650833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:57.652697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.663324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b5033-a5b7-400f-a360-0b8f27c43436 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.663920 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2048/4111] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:57.668655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.668932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.669830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.670315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.670650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] PATH_INFO: `/v3/projects/3eb50f24a3f64b759a99b9b20c150caf` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.671837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb50f24a3f64b759a99b9b20c150caf)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.675051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.693840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90984c-2ece-4b9d-b6c5-8a7eede3b2aa None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.700898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.701919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.702589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.702865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.703913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:57.704598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.707155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.724989 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2049/4112] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:00:57.729099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.738904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb50f24a3f64b759a99b9b20c150caf', 'request_id': 'req-d8fa780b-b8b6-4be1-b996-accf106320e3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.746267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cdef5c-b9c6-4cee-a5e6-d23fff127d39 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:57.754460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb50f24a3f64b759a99b9b20c150caf', 'request_id': 'req-d8fa780b-b8b6-4be1-b996-accf106320e3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.769930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb50f24a3f64b759a99b9b20c150caf', 'request_id': 'req-d8fa780b-b8b6-4be1-b996-accf106320e3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.788302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] The token cache is being invalidate because project 3eb50f24a3f64b759a99b9b20c150caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:00:57.788638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.789333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d8fa780b-b8b6-4be1-b996-accf106320e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:00:57.791713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2064/4113] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:57 2022] DELETE /identity/v3/projects/3eb50f24a3f64b759a99b9b20c150caf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:57.796852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b52a4-ec15-4811-ae97-af1131efd077 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.797160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b52a4-ec15-4811-ae97-af1131efd077 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.798703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b52a4-ec15-4811-ae97-af1131efd077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.823241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ac9b52a4-ec15-4811-ae97-af1131efd077 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:57.824819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ac9b52a4-ec15-4811-ae97-af1131efd077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.839261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:57.839931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.840270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.840875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.841749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:57.843819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:57.886246 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2050/4114] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:57.894274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:57.898455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:57.913991 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2065/4115] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:57.921924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:57.923301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:57.923854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:57.950695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:57.954296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:58.007138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393b76-c72a-4cca-a60c-c372ad605ac2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.013741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.014876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.015259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.015803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.017065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.020239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.032326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2066/4116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:58.036694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.049234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dc98-2e6a-4d86-994d-a9ab5d124264 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.055611 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2051/4117] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:57 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:58.060508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.061539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.062331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.062713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.063164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.064667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:00:58.065089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.066807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.076616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb85da-6ae0-454c-9545-cf9c1b5f5fa2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.082480 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2067/4118] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:00:58.082874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.083554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.083843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.084125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.084896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.086605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.086814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.099910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed2b06-4303-4b6d-a39c-0aad375cd763 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.106723 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2052/4119] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:58.108991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.109169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.110484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.111040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.111414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.112212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.114373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.128855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62835d76-2dd8-4135-94a5-46e5933bc1a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.150194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.151522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.151996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.152703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.153709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.155934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.161108 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2068/4120] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:00:58 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:00:58.163366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.188496 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2053/4121] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:58.192594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.207978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae825-6e51-4361-9bb6-2aa30b52aa03 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.274944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e630c-93e0-48d6-b9ff-3b993ef7f3b7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.281379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.282884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.283278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.283796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.284951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.286016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.286957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.287204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.287334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.287495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] PATH_INFO: `/v3/projects/46605b214f8144ebbbd2aab432bb7633/users/de9e0b13df3b487cb16732fcf86746b3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.304702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=46605b214f8144ebbbd2aab432bb7633, user_id=de9e0b13df3b487cb16732fcf86746b3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.307934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed066a-60b7-4c10-af67-f63da63a06ec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.320538 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2069/4122] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:00:58 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:00:58.324069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2054/4123] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:58 2022] PUT /identity/v3/projects/46605b214f8144ebbbd2aab432bb7633/users/de9e0b13df3b487cb16732fcf86746b3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:00:58.327913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.329981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.330285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.330556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.340708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc26a5-8dbe-40e2-afc8-e5095425f1aa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.365943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:58.367658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:58.409558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.410256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.410541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.410814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.411541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.413380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.430578 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2070/4124] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:00:58.435966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.455658 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2055/4125] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:58.462102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13249a3a-1712-46b5-86c4-1fab63aa06d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.467513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.468194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.468556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.468806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.470162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.471811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.483879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.485911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:58.486044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2071/4126] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:00:58.486472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.497739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ee6e8-e0e5-4718-be2c-5be44d0e5e6e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.505049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.505635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.505925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.506209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] PATH_INFO: `/v3/projects/110cfdc19f714eaaae221aacca056c08/users/d1c5ac48a61849fc90c23809370b28a7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.524643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110cfdc19f714eaaae221aacca056c08, user_id=d1c5ac48a61849fc90c23809370b28a7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.530938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb874b7-4935-468b-a955-b0230cf5f186 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.555518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2072/4127] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:00:58 2022] PUT /identity/v3/projects/110cfdc19f714eaaae221aacca056c08/users/d1c5ac48a61849fc90c23809370b28a7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:00:58.568755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.569044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.569322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.573753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5009-4293-4c56-a96b-9bf4ca98da2a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.611367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] MFA Rules not processed for user `d1c5ac48a61849fc90c23809370b28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:58.619474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:58.655673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.656581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.656754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.656951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.724725 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2073/4128] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:00:58.731483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:58.735929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.736488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:58.737398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb24f15-a49e-489e-8373-0b266bb99a5c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.748766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2056/4129] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:00:58.834933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469217-5194-4e64-940b-001ce15f2755 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:58.840844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:58.841517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:58.841940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:58.842237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:58.851215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:58.853218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f306170-723e-4c92-aee7-4b0a7afe06fd service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:58.863140 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2074/4130] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:00:59.772841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:59.773377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:59.773544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:59.806575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] MFA Rules not processed for user `de9e0b13df3b487cb16732fcf86746b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:59.808228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:59.880280 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2057/4131] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:59.890915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48995-02b1-40e1-856a-a9be3fa888d0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:59.891528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48995-02b1-40e1-856a-a9be3fa888d0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:59.891528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b48995-02b1-40e1-856a-a9be3fa888d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:59.908754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-56b48995-02b1-40e1-856a-a9be3fa888d0 None None] MFA Rules not processed for user `de9e0b13df3b487cb16732fcf86746b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:00:59.910089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56b48995-02b1-40e1-856a-a9be3fa888d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:00:59.917051 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2075/4132] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:00:59.928053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:00:59.942475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee61ee-63b5-45a5-b206-3d077728df40 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:00:59.950070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:00:59.950721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:00:59.951005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:00:59.951283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:00:59.959208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:00:59.960794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:00:59.970044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2058/4133] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:00.535833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:00.536392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:00.536880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:00.577766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:00.584662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:00.702602 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2076/4134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:02.165717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:02.167686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:02.191185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310fff3-4c06-4349-b824-a6e90dc580f4 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:02.201110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:02.202771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:02.202771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:02.202771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] PATH_INFO: `/v3/users/4eaee1ddad0041828fb2e65677e2da25` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:02.209056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaee1ddad0041828fb2e65677e2da25)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:02.211025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:02.290557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaee1ddad0041828fb2e65677e2da25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.314497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaee1ddad0041828fb2e65677e2da25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.316306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaee1ddad0041828fb2e65677e2da25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.327773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaee1ddad0041828fb2e65677e2da25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.344426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaee1ddad0041828fb2e65677e2da25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.352962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2059/4135] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:02 2022] DELETE /identity/v3/users/4eaee1ddad0041828fb2e65677e2da25 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:02.651109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:02.671418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288a3f3-93ee-4454-945b-9e194957f162 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:02.752536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:02.753822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:02.754354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:02.754888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] PATH_INFO: `/v3/projects/a1a3f8d3d3e94b31ab9aa73d8905b12a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:02.756390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a3f8d3d3e94b31ab9aa73d8905b12a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:02.759628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:02.839900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'request_id': 'req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.849025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'request_id': 'req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.859833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'request_id': 'req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.873609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] The token cache is being invalidate because project a1a3f8d3d3e94b31ab9aa73d8905b12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:02.874194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.874870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:02.877114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2077/4136] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:02 2022] DELETE /identity/v3/projects/a1a3f8d3d3e94b31ab9aa73d8905b12a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:02.881689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:02.884110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:02.901607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a721-43bd-410a-a508-5b98e022b634 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:03.038188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:03.039441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.039838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.040124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] PATH_INFO: `/v3/users/88915c35925848a7b83e873c6ae399c5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.055978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88915c35925848a7b83e873c6ae399c5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:03.057940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:03.165736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88915c35925848a7b83e873c6ae399c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.180193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88915c35925848a7b83e873c6ae399c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.181218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88915c35925848a7b83e873c6ae399c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.191335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88915c35925848a7b83e873c6ae399c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.200819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88915c35925848a7b83e873c6ae399c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.208682 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2060/4137] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:02 2022] DELETE /identity/v3/users/88915c35925848a7b83e873c6ae399c5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:03.491595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:03.494077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:03.520891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5c0c3-0e48-41c4-add2-d3a4d39d3c08 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:03.591397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:03.593071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:03.654150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:03.655735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.656313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.656771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] PATH_INFO: `/v3/projects/09f4379a528841c1958b6ab4261cdc7c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.659333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f4379a528841c1958b6ab4261cdc7c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:03.662009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:03.703681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710179a-0bee-4f13-8623-53671cd4aefd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:03.715066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:03.716061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.716362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.716667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.724973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:03.727301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f4379a528841c1958b6ab4261cdc7c', 'request_id': 'req-f5c62876-e6db-43f1-a0b9-5e8a974428d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.735764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f4379a528841c1958b6ab4261cdc7c', 'request_id': 'req-f5c62876-e6db-43f1-a0b9-5e8a974428d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.745942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f4379a528841c1958b6ab4261cdc7c', 'request_id': 'req-f5c62876-e6db-43f1-a0b9-5e8a974428d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.746830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:03.748333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a5d82-4303-4dc3-8068-45f91c99f1d3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:03.760729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] The token cache is being invalidate because project 09f4379a528841c1958b6ab4261cdc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:03.761033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.761709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5c62876-e6db-43f1-a0b9-5e8a974428d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:03.763362 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2078/4138] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:03 2022] DELETE /identity/v3/projects/09f4379a528841c1958b6ab4261cdc7c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:03.765748 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2061/4139] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:01:03.768293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.768683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.769035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.795014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:03.796477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:03.861752 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2079/4140] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:03.869994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.870399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.870780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.890547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:03.891957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:03.900991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2062/4141] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:03.905306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:03.916405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847660f8-af99-439e-b5a1-7c2614135f75 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:03.921518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:03.922886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.923394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.923816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.924577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:01:03.924889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:03.926492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:03.940101 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2080/4142] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:01:03.944288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:03.954519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeba9d-fd6c-4049-a7d6-6249899cda93 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:03.959347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:03.960047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:03.960329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:03.960638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:03.961477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:03.963442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:03.995424 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2063/4143] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:03 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:04.000152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.010797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68775a-9295-41cb-967a-f88dfc03e235 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.070225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.071066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.071350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.071713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.072611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.074684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.101916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2081/4144] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:03 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:04.106218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.119180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c712b7-5779-4c4a-ad3f-cf821ad7539a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.127191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.128085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.128903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.129459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.130498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.132675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.148351 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2064/4145] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:04.152653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.165026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929608a-9c33-4a53-ae6a-8543aadaa5e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.172055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.173674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.174092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.174504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.175490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.177651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.195559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2082/4146] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:04.197282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.208498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828c989-2ea5-411b-889a-310f8ae8a9c2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.213830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.214908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.215198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.215472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] PATH_INFO: `/v3/projects/7c18de83398748dc98785c382519b209/users/1446a267c9814efea3bd59babeb7543d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.238042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c18de83398748dc98785c382519b209, user_id=1446a267c9814efea3bd59babeb7543d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.241047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77036dc-f01c-4ac6-a049-f74c4cca9236 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.276522 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2065/4147] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:04 2022] PUT /identity/v3/projects/7c18de83398748dc98785c382519b209/users/1446a267c9814efea3bd59babeb7543d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:04.328207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.330061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:04.348084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.348084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.348084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.425366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] MFA Rules not processed for user `1446a267c9814efea3bd59babeb7543d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:04.426611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:04.473586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4518-f383-4e96-816b-02fd16a2f49c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.561016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.561773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.562133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.562636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.564780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:04.575255 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2066/4148] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:04.576446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.578030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:04.667179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522d83-bb8e-4146-a281-a55e12f9acb2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.672993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.674026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.674466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.674876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] PATH_INFO: `/v3/users/d1c5ac48a61849fc90c23809370b28a7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.676208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c5ac48a61849fc90c23809370b28a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.678308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.684692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.686873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.707998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2083/4149] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:01:04.709395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.724147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a439d5b-e386-47e1-999b-a92df679a355 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.729512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:04.730462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.730878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.731170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.732295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:04.734541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:04.771031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c5ac48a61849fc90c23809370b28a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:04.772154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2084/4150] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:04.776611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:04.790539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c5ac48a61849fc90c23809370b28a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:04.791446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c5ac48a61849fc90c23809370b28a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:04.804858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c5ac48a61849fc90c23809370b28a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:04.816307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0eb4d10c-db6b-4306-a12e-54ed834a43ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c5ac48a61849fc90c23809370b28a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:04.825382 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2067/4151] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:04 2022] DELETE /identity/v3/users/d1c5ac48a61849fc90c23809370b28a7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:04.832407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:04.832748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:04.833034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:04.858350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:04.864754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:04.911723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262b97-4a2c-4267-ad3a-1a0bc519cabb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:04.983444 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2068/4152] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:04.996506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.001813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:05.025995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.026866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.027159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.027445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.028147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.030666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.064375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2085/4153] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:04 2022] POST /identity/v3/users => generated 300 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:05.069599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.071971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:05.085629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28031-dc14-40c7-b701-08c32c9bfbcb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.091759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e287b-0ec5-40fb-8f1f-97e11304abbb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.092091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.092944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.093235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.093528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.094298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.095915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.096009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.096689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.096978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.097484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.108830 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2086/4154] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:05.113198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.113408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.117758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.128035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef531-e886-45c6-b045-0faa6520ffbc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.134990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2069/4155] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:05.141906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.143985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.144398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.144958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] PATH_INFO: `/v3/projects/98d4360210764b099ee3776fafa507c8/users/47a4a2b22936427890be8265b6755f79/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.164961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d4360210764b099ee3776fafa507c8, user_id=47a4a2b22936427890be8265b6755f79, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.167642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.201656 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2087/4156] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:05 2022] PUT /identity/v3/projects/98d4360210764b099ee3776fafa507c8/users/47a4a2b22936427890be8265b6755f79/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:05.202262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.229669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43615d4-390e-4c6c-a18f-b16ce0dcd7bc service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.337808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.338848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.339227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.339403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.340126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.341750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91960e66-2aa4-47df-a8f8-91bbc90a7052 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.354663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2070/4157] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:01:05.358781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.372124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf49ea-e830-40f7-954c-9897d17f928b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.377261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.378199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.378545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.378762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] PATH_INFO: `/v3/projects/98d4360210764b099ee3776fafa507c8/users/47a4a2b22936427890be8265b6755f79/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.380838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d4360210764b099ee3776fafa507c8, user_id=47a4a2b22936427890be8265b6755f79, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.383532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.396231 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2088/4158] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:05 2022] PUT /identity/v3/projects/98d4360210764b099ee3776fafa507c8/users/47a4a2b22936427890be8265b6755f79/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:05.406192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.408798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.409274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.439414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] MFA Rules not processed for user `47a4a2b22936427890be8265b6755f79`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:05.440818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:05.515888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2071/4159] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:05.529442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.532385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:05.622626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efa72e-e81c-462a-98c5-116853a76667 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.628599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.629403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.629753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.630725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.640185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.642898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eda02-befa-4fc9-b921-da00124c1ad1 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:05.654869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2089/4160] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:05.883629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:05.885452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:05.976918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56aaf6d-8437-4eaa-b1d7-6eeca68d0a83 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:05.984585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:05.986285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:05.986702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:05.987234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] PATH_INFO: `/v3/projects/110cfdc19f714eaaae221aacca056c08` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:05.988809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=110cfdc19f714eaaae221aacca056c08)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:05.991356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.054676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110cfdc19f714eaaae221aacca056c08', 'request_id': 'req-18f072fb-916d-427c-a245-4a135cd97e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.064656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110cfdc19f714eaaae221aacca056c08', 'request_id': 'req-18f072fb-916d-427c-a245-4a135cd97e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.073173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110cfdc19f714eaaae221aacca056c08', 'request_id': 'req-18f072fb-916d-427c-a245-4a135cd97e7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.129787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] The token cache is being invalidate because project 110cfdc19f714eaaae221aacca056c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:06.130084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.131184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-18f072fb-916d-427c-a245-4a135cd97e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.136211 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2072/4161] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:05 2022] DELETE /identity/v3/projects/110cfdc19f714eaaae221aacca056c08 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:06.138161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009255-6934-493c-9eac-390cd470e55b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.139777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009255-6934-493c-9eac-390cd470e55b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.140064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009255-6934-493c-9eac-390cd470e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.163909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8c009255-6934-493c-9eac-390cd470e55b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:06.165174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c009255-6934-493c-9eac-390cd470e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.267891 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2090/4162] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:06.269551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.269993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.270130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.291981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:06.293877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.307855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2073/4163] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:06.314143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009255-6934-493c-9eac-390cd470e55b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.331578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009255-6934-493c-9eac-390cd470e55b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.337345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.338553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.340122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.340494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.341302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:01:06.341713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.343448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.360502 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2091/4164] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:01:06.363714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.376609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41bee3-21cb-4f5a-b470-9ef53cd7fa63 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.384355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.385849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.386360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.387506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.388737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.392567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.436084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.437729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.446418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2074/4165] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/projects => generated 403 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:06.454792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.465253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7914-a1b8-4232-b533-4fa6fb9ca697 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.544918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d641b-1b2e-4785-8528-b6991568952f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.549439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.550439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.550889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.551149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] PATH_INFO: `/v3/users/1446a267c9814efea3bd59babeb7543d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.552486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.552629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1446a267c9814efea3bd59babeb7543d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.554298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.554734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.554962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.555198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.555984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.560309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.601332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2075/4166] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:06.607427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.623208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6deff2-6a8c-4ce6-9fca-6009912a2f86 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.628113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1446a267c9814efea3bd59babeb7543d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.633675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.634664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.635200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.635484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.636316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.638342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.638720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1446a267c9814efea3bd59babeb7543d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.639542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1446a267c9814efea3bd59babeb7543d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.640404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1446a267c9814efea3bd59babeb7543d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.649054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1890cdea-ea75-45e1-9730-0fd1189e4fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1446a267c9814efea3bd59babeb7543d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:06.656191 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2076/4167] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:06.660267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.662300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.671870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2092/4168] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:06 2022] DELETE /identity/v3/users/1446a267c9814efea3bd59babeb7543d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:06.676695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.677057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.677431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.696661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:06.697410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb3213-f658-4e36-b741-d163e33e1139 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.697870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.801387 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2093/4169] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:06.809409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.812289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.813044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.813326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.813610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.814765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.815744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.816049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.846238 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2077/4170] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:06.847042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:06.857093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb800ff5-4f1d-47c7-bcb6-ef3e17e46835 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.863482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.864366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.864705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.864973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] PATH_INFO: `/v3/projects/e97fa5361ab649b3a0415bf0ea52bf33/users/9c3d6fafce814991931adc2486a929c0/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.892938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97fa5361ab649b3a0415bf0ea52bf33, user_id=9c3d6fafce814991931adc2486a929c0, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:06.895629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d938ed-1feb-416a-9e03-99e501fd8ef2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:06.914185 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2078/4171] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:06 2022] PUT /identity/v3/projects/e97fa5361ab649b3a0415bf0ea52bf33/users/9c3d6fafce814991931adc2486a929c0/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:06.919277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.919575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.919856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:06.932141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065e1e-7ef5-41fd-b6f5-998e74ea5934 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:06.939740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:06.941059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:06.994719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:06.995382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:06.995664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:06.995939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:07.013693 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2079/4172] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:01:07.035999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:07.052632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec114d-e07f-4d50-9f65-914df880a581 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:07.074437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:07.075775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:07.078684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:07.081966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:07.083975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:07.096038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2094/4173] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:07.096874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:07.110883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:07.112820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:07.131982 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2080/4174] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:07.999483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:08.002349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:08.026381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80c69-ea67-488c-9421-926460eaf3f9 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:08.033478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:08.034437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:08.034797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:08.035146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] PATH_INFO: `/v3/projects/7c18de83398748dc98785c382519b209` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:08.036566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c18de83398748dc98785c382519b209)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:08.038569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:08.113699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c18de83398748dc98785c382519b209', 'request_id': 'req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.124473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c18de83398748dc98785c382519b209', 'request_id': 'req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.139546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c18de83398748dc98785c382519b209', 'request_id': 'req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.162756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] The token cache is being invalidate because project 7c18de83398748dc98785c382519b209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:08.163346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.164403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2f7c2e24-4cb7-4dc7-8be1-3b4f6467a733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.170429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2095/4175] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:07 2022] DELETE /identity/v3/projects/7c18de83398748dc98785c382519b209 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:08.171618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:08.183416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044479-2fae-4ea0-8407-b881ab5adf32 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:08.247513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:08.248590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:08.248958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:08.249311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] PATH_INFO: `/v3/users/47a4a2b22936427890be8265b6755f79` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:08.251198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a4a2b22936427890be8265b6755f79)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:08.253254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:08.339080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a4a2b22936427890be8265b6755f79'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.362215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a4a2b22936427890be8265b6755f79'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.363594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a4a2b22936427890be8265b6755f79'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.375986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a4a2b22936427890be8265b6755f79'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.394749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a4a2b22936427890be8265b6755f79'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:08.405864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2081/4176] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:08 2022] DELETE /identity/v3/users/47a4a2b22936427890be8265b6755f79 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:01:08.840797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:08.841095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:08.841407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:08.879868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] MFA Rules not processed for user `9c3d6fafce814991931adc2486a929c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:08.882022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.041130 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2096/4177] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:09.051955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:09.053740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.172214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76399d17-2f42-4c8f-a887-33a8002d11df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:09.178969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:09.179736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.180234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.180714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.191337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:09.192990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff9dd9-9289-4d7f-8134-d6d816c5886c service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:09.205528 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2082/4178] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:09.354123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:09.355661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.482222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128c46a-86f1-4039-ad95-38fed589c5f0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:09.488361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:09.489623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.489947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.490283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] PATH_INFO: `/v3/projects/98d4360210764b099ee3776fafa507c8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.491609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d4360210764b099ee3776fafa507c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:09.493827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:09.565300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d4360210764b099ee3776fafa507c8', 'request_id': 'req-03823fbc-5b89-463a-87ce-81baa90af29d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:09.582214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d4360210764b099ee3776fafa507c8', 'request_id': 'req-03823fbc-5b89-463a-87ce-81baa90af29d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:09.591460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d4360210764b099ee3776fafa507c8', 'request_id': 'req-03823fbc-5b89-463a-87ce-81baa90af29d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:09.603691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] The token cache is being invalidate because project 98d4360210764b099ee3776fafa507c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:09.603987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:09.604680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03823fbc-5b89-463a-87ce-81baa90af29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:09.609495 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2097/4179] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:09 2022] DELETE /identity/v3/projects/98d4360210764b099ee3776fafa507c8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:09.612072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.612370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.612730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.636526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:09.637688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.718810 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2083/4180] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:01:09.721925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.722222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.723704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.768159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:09.769802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.779867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2098/4181] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:09.788657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:09.804243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c28694-ab6d-446f-beea-00b9a631a5db None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:09.810152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:09.810961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.811253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.811541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.813455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:01:09.813775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:09.817147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8458b04-ecfc-4b94-8157-f5866bc7c9e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:09.831490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2084/4182] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:01:09.835591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:09.856923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee84df-60ae-4d70-9a1e-18e0e27279ae None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:09.873023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:09.873884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.876679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.877382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.880743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:09.890690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:09.898282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:09.898608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:09.898894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:09.927945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:09.930243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:09.934766 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2099/4183] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:09 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:09.938533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.025719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da7776-f9b9-4ba9-b5cf-eec1ba065071 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.035886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.037157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.037447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.037721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.038424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.040374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.049404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2085/4184] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 02 21:01:10.069090 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2100/4185] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:09 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:10.073771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.082929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.087904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:10.092199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389069-092e-4b22-aa7e-ae295c0f257d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.098504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.099415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.099794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.100193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.101337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.103652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.118617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2086/4186] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:10.124502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.146568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9854f-7249-46ee-85e2-715b759dfcb1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.153418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.155085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.155327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.155713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.159392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.161217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.181271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2087/4187] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:10.182294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.210149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7670f-2b01-4c6c-893c-9450385cbdb6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.216646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.217763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.218231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.218687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] PATH_INFO: `/v3/projects/de63710973d349dea7a070116eeb6d33/users/9a3cb2d2505e446ba9cc6b429f07e9f6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.239087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f7f1-b0bd-4d0e-9acb-f1118a144478 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.241250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de63710973d349dea7a070116eeb6d33, user_id=9a3cb2d2505e446ba9cc6b429f07e9f6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.244244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416902c-499d-4cad-b7cd-0911ce96b316 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.256481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.257693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.258631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.259648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.269854 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2088/4188] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:10 2022] PUT /identity/v3/projects/de63710973d349dea7a070116eeb6d33/users/9a3cb2d2505e446ba9cc6b429f07e9f6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:10.273368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.273825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.274280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.275204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.277187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.301754 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2101/4189] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:10.314087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] MFA Rules not processed for user `9a3cb2d2505e446ba9cc6b429f07e9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:10.315295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:10.405291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2089/4190] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:01:10.406395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.427052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128d2e-d243-47ef-8a7c-c6cab68ada95 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.546648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.549935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.550295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.550590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.551309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.554842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.642620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2102/4191] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:10 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:10.648093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.664966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ceb4ff-39cb-49db-92ca-217e50bb9a00 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.829878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.830573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.830856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.831130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.831820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.833763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.881346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2090/4192] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:10 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:10.883126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:10.910840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05605995-a36e-4f26-94dc-93a5b0725172 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:10.925968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233329-33af-4163-8558-c179760084ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:10.927909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233329-33af-4163-8558-c179760084ca admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:10.928430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233329-33af-4163-8558-c179760084ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:10.930127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233329-33af-4163-8558-c179760084ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:10.931652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d233329-33af-4163-8558-c179760084ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:10.934540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d233329-33af-4163-8558-c179760084ca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:10.985763 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2103/4193] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:10.989849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:11.005565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd4411-06bf-4af9-89bd-aef848a05fbe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:11.029545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:11.031883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:11.032397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:11.033011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] PATH_INFO: `/v3/projects/436a3abed93b45a38be6104b312c49c6/users/90d5e8bfbc4144359d8af87e93bb67e1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:11.073985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436a3abed93b45a38be6104b312c49c6, user_id=90d5e8bfbc4144359d8af87e93bb67e1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:11.082422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:11.112081 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2091/4194] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:10 2022] PUT /identity/v3/projects/436a3abed93b45a38be6104b312c49c6/users/90d5e8bfbc4144359d8af87e93bb67e1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:11.114216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233329-33af-4163-8558-c179760084ca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:11.141478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233329-33af-4163-8558-c179760084ca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:11.285274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:11.285971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:11.286263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:11.286543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:11.292691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:11.294468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3af18-78e5-445d-98df-0e4a0430647d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:11.328659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2104/4195] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:11.328972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:11.340424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e82f01-195b-4376-91ed-a6f9bb6160a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:11.355141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:11.356076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:11.356412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:11.356767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] PATH_INFO: `/v3/projects/436a3abed93b45a38be6104b312c49c6/users/90d5e8bfbc4144359d8af87e93bb67e1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:11.362297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=436a3abed93b45a38be6104b312c49c6, user_id=90d5e8bfbc4144359d8af87e93bb67e1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:11.372195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4901f64-2e30-4b04-9616-d391078dfbfe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:11.392629 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2092/4196] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:11 2022] PUT /identity/v3/projects/436a3abed93b45a38be6104b312c49c6/users/90d5e8bfbc4144359d8af87e93bb67e1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:11.405486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:11.405817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:11.406095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:11.465556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] MFA Rules not processed for user `90d5e8bfbc4144359d8af87e93bb67e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:11.467707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:11.620552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2105/4197] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:11.627394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:11.627976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:11.628543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:11.696617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] MFA Rules not processed for user `9a3cb2d2505e446ba9cc6b429f07e9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:11.699295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:11.899183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2093/4198] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:12.121549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:12.126185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:12.319935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccffca-c721-4d08-ba27-1f1f450ff4eb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:12.337372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:12.338757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:12.340264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:12.342140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:12.361307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:12.363266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:12.384898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2106/4199] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:16.226985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:16.237047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:16.406397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a736db-0542-4282-8ccd-59b0eac73a4c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:16.412684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:16.413604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:16.413897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:16.414173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] PATH_INFO: `/v3/users/9c3d6fafce814991931adc2486a929c0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:16.415445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3d6fafce814991931adc2486a929c0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:16.418565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:16.491069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3d6fafce814991931adc2486a929c0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:16.508157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3d6fafce814991931adc2486a929c0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:16.509313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3d6fafce814991931adc2486a929c0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:16.517317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3d6fafce814991931adc2486a929c0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:16.526852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65a2d028-a79d-43aa-9ff0-dbf3f172c46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3d6fafce814991931adc2486a929c0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:16.534079 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2094/4200] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:16 2022] DELETE /identity/v3/users/9c3d6fafce814991931adc2486a929c0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:01:16.833228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:16.848274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0229d-4b86-420b-bc87-decdf87fbeba service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:16.921873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:16.922838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:16.923186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:16.923467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] PATH_INFO: `/v3/projects/e97fa5361ab649b3a0415bf0ea52bf33` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:16.924821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97fa5361ab649b3a0415bf0ea52bf33)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:16.938616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.072378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97fa5361ab649b3a0415bf0ea52bf33', 'request_id': 'req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:17.090079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97fa5361ab649b3a0415bf0ea52bf33', 'request_id': 'req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:17.115391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97fa5361ab649b3a0415bf0ea52bf33', 'request_id': 'req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:17.128884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] The token cache is being invalidate because project e97fa5361ab649b3a0415bf0ea52bf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:17.129441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:17.130530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-13ced6d0-1c01-4d9b-9303-6fde3f3dac8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:17.132930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2107/4201] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:16 2022] DELETE /identity/v3/projects/e97fa5361ab649b3a0415bf0ea52bf33 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:17.138050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.138770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.139406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.164042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:17.165547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:17.268786 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2095/4202] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:17.270319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.270618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.270901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.295605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:17.297952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:17.308286 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2108/4203] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:17.313351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.324801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877972-6eb5-4aeb-a23e-131d5de697e7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.333427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.334301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.334587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.334882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.335669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:01:17.335983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.341939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.373067 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2096/4204] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:01:17.374434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.396939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06578a-a6c4-422b-9733-018560577f8c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.407646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.408419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.408831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.409732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.411874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.416003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.470505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2109/4205] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:17 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:17.474424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.486000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e81db-2b7c-479d-b569-f659303fbb97 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.599964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.601300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.601939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.602434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.603740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.606963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.644675 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2097/4206] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:17 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:17.645002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.678261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01552-28bb-41b9-ac54-e7134bf87fa7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.691658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.692691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.693200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.693724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.694911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.697521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.714710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2110/4207] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:17.720500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.738036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96aa58-a18c-4391-b6cf-cf136a467b49 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.749842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.750898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.751408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.759909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.763453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.767309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2d1b9-2ada-41a7-bbc6-13622e2732e0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.800935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2098/4208] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:17.801862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:17.814391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe79b2-efb6-4336-9d8c-e950709e02dd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:17.847790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:17.849054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.849054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.849334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] PATH_INFO: `/v3/projects/23ceefc39a5247ae86277ab79385c021/users/ad3cf44a90a54b1eb08ba969847862e5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.876741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ceefc39a5247ae86277ab79385c021, user_id=ad3cf44a90a54b1eb08ba969847862e5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:17.879414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:17.900512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2111/4209] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:17 2022] PUT /identity/v3/projects/23ceefc39a5247ae86277ab79385c021/users/ad3cf44a90a54b1eb08ba969847862e5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:17.904416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53468c3-a1d0-423a-be7c-d33924cbd2a2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:17.904901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53468c3-a1d0-423a-be7c-d33924cbd2a2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:17.905313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53468c3-a1d0-423a-be7c-d33924cbd2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:17.956759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b53468c3-a1d0-423a-be7c-d33924cbd2a2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:17.961308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b53468c3-a1d0-423a-be7c-d33924cbd2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:18.091952 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2099/4210] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:18.101909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:18.103714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:18.240868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f2af0-7db4-4e1d-b275-947295dfece7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:18.261723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:18.262368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:18.262656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:18.262935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:18.296779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:18.304650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:18.353091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2112/4211] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:19.685499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199769a-3792-4af1-9d9c-f4fbf2725bc4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:19.686067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199769a-3792-4af1-9d9c-f4fbf2725bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:19.686362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199769a-3792-4af1-9d9c-f4fbf2725bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:19.734103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e199769a-3792-4af1-9d9c-f4fbf2725bc4 None None] MFA Rules not processed for user `ad3cf44a90a54b1eb08ba969847862e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:19.735372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e199769a-3792-4af1-9d9c-f4fbf2725bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:19.888057 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2100/4212] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:19.941940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:19.944160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:20.026144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e79e7-2903-4b0b-98eb-68f2659532d0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:20.031714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:20.032364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:20.032848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:20.033125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:20.041328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:20.043145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e656167-f197-41a2-9be8-ee763f72c834 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:20.053077 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2113/4213] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:20.373899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb126-92f2-428f-aa22-069d9db4955a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:20.374193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb126-92f2-428f-aa22-069d9db4955a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:20.374511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964eb126-92f2-428f-aa22-069d9db4955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:20.391750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-964eb126-92f2-428f-aa22-069d9db4955a None None] MFA Rules not processed for user `ad3cf44a90a54b1eb08ba969847862e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:20.392980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-964eb126-92f2-428f-aa22-069d9db4955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:20.399778 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2101/4214] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:27.782451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd85b-4389-4611-8f3b-4d60de799b69 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:27.782943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd85b-4389-4611-8f3b-4d60de799b69 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:27.783036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd85b-4389-4611-8f3b-4d60de799b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:27.801833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5b6dd85b-4389-4611-8f3b-4d60de799b69 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:27.803312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5b6dd85b-4389-4611-8f3b-4d60de799b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:27.867875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2114/4215] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:29.131660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.132233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.132563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.135968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2102/4216] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:01:29.145966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a439-9edc-462a-9517-c8dcc4bed301 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.146512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a439-9edc-462a-9517-c8dcc4bed301 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.146668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a439-9edc-462a-9517-c8dcc4bed301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.170938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0626a439-9edc-462a-9517-c8dcc4bed301 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:29.173764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0626a439-9edc-462a-9517-c8dcc4bed301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:29.263319 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2115/4217] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:29.283392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:29.285406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:29.305169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41b866-65af-475b-a1b7-26d2e89a95c1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:29.311126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:29.312090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.312740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.313196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.323317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:29.325199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6c24-60ea-4e94-8f25-e071ee3d0348 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:29.336597 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2103/4218] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:29.409621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.409920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.410198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.428498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:29.429804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:29.441634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2116/4219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:29.569987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f8cb-6f82-4ed5-8fe5-1a4cbf069c0f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.570270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f8cb-6f82-4ed5-8fe5-1a4cbf069c0f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.570738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22f8cb-6f82-4ed5-8fe5-1a4cbf069c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.607007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6a22f8cb-6f82-4ed5-8fe5-1a4cbf069c0f None None] MFA Rules not processed for user `de9e0b13df3b487cb16732fcf86746b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:29.608262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6a22f8cb-6f82-4ed5-8fe5-1a4cbf069c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:29.697918 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2104/4220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:29.860346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:29.876805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230fda-f36c-4218-acbd-898f59688654 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:29.883860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:29.884585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:29.885567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:29.885867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:29.888447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:29.955897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:29.957632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:29.968431 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2117/4221] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:33.325029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:33.325549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:33.325692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:33.349504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:33.351071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:33.436074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2105/4222] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:33.457729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:33.459428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:33.534568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17439fe-81fa-4029-bc5f-085e6fa298ce service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:33.539610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:33.540276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:33.540606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:33.540888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:33.549890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:33.551478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:33.559660 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2118/4223] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:38.546378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:38.548933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:38.567328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43816222-3b7c-48a3-8078-1e3cf35e64bc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:38.572670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:38.573351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:38.574001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:38.574514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:38.577257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:38.596050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:38.597771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:38.613389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2106/4224] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:39.185564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:39.200544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2c03c-8154-4ee0-9e8e-ebe425d9d8d6 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:39.206730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:39.207414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:39.207707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:39.207989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:39.209960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:39.274058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:39.275797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717a18-0a9f-499e-99e4-bef4ff31ae98 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:39.285647 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2119/4225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:40.405898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:40.415976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399cb6-3b2b-4384-a828-c4ff5ac7565f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:40.419604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:40.420244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:40.420633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:40.420910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:40.422671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:40.437500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:40.440856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:40.454650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2107/4226] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:41.380588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c972-a3c6-48b2-8dff-22a7e85e257b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:41.380979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c972-a3c6-48b2-8dff-22a7e85e257b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:41.381176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c972-a3c6-48b2-8dff-22a7e85e257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:41.398204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8882c972-a3c6-48b2-8dff-22a7e85e257b None None] MFA Rules not processed for user `ad3cf44a90a54b1eb08ba969847862e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:41.399442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8882c972-a3c6-48b2-8dff-22a7e85e257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:41.406448 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2120/4227] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:43.918021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:43.920973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:43.945658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41610f5-05f3-4e2a-9cc7-a97069dbdab2 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:43.955331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:43.956894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:43.957546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:43.958574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] PATH_INFO: `/v3/users/9a3cb2d2505e446ba9cc6b429f07e9f6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:43.960072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3cb2d2505e446ba9cc6b429f07e9f6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:43.963172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:44.027449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3cb2d2505e446ba9cc6b429f07e9f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.052339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3cb2d2505e446ba9cc6b429f07e9f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.053695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3cb2d2505e446ba9cc6b429f07e9f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.066463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3cb2d2505e446ba9cc6b429f07e9f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.078088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3cb2d2505e446ba9cc6b429f07e9f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.085660 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2108/4228] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:43 2022] DELETE /identity/v3/users/9a3cb2d2505e446ba9cc6b429f07e9f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:44.090147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:44.090621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:44.090850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:44.114092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:44.115722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:44.184345 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2121/4229] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:44.201031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:44.202559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:44.290723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8493e-3b34-471a-a685-b5ff83fda0ab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:44.296480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:44.297315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:44.297673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:44.298122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:44.310026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:44.311941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:44.326867 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2109/4230] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:44.597733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:44.599171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:44.617419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfa02-0298-45fb-a82a-858cf0f13122 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:44.622288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:44.623343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:44.623741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:44.624090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] PATH_INFO: `/v3/projects/de63710973d349dea7a070116eeb6d33` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:44.626160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de63710973d349dea7a070116eeb6d33)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:44.628649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:44.679695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de63710973d349dea7a070116eeb6d33', 'request_id': 'req-25a74f17-0445-4fd7-955a-0668016e0839'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.686203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de63710973d349dea7a070116eeb6d33', 'request_id': 'req-25a74f17-0445-4fd7-955a-0668016e0839'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.694950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de63710973d349dea7a070116eeb6d33', 'request_id': 'req-25a74f17-0445-4fd7-955a-0668016e0839'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.706604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] The token cache is being invalidate because project de63710973d349dea7a070116eeb6d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:44.707219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.707977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.710096 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2122/4231] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:44 2022] DELETE /identity/v3/projects/de63710973d349dea7a070116eeb6d33 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:44.714314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:44.724425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e664ed-2e2e-4210-8115-a454f6cc8c6a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:44.783834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:44.784905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:44.785225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:44.786634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] PATH_INFO: `/v3/users/90d5e8bfbc4144359d8af87e93bb67e1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:44.787022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d5e8bfbc4144359d8af87e93bb67e1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:44.789152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:44.840057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d5e8bfbc4144359d8af87e93bb67e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.851562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d5e8bfbc4144359d8af87e93bb67e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.852309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d5e8bfbc4144359d8af87e93bb67e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.858966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d5e8bfbc4144359d8af87e93bb67e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.866808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-50aa902a-c1c2-4917-87bc-a5cd6c0d4a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d5e8bfbc4144359d8af87e93bb67e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:44.872971 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2110/4232] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:01:44 2022] DELETE /identity/v3/users/90d5e8bfbc4144359d8af87e93bb67e1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:45.303153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:45.304801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:45.322404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74f17-0445-4fd7-955a-0668016e0839 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:45.417104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:45.417975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.418259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.418535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] PATH_INFO: `/v3/projects/436a3abed93b45a38be6104b312c49c6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.419904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=436a3abed93b45a38be6104b312c49c6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:45.421819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:45.481636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436a3abed93b45a38be6104b312c49c6', 'request_id': 'req-337eedcf-adc9-44d5-a0da-7bad70258e8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:45.491287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436a3abed93b45a38be6104b312c49c6', 'request_id': 'req-337eedcf-adc9-44d5-a0da-7bad70258e8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:45.510521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436a3abed93b45a38be6104b312c49c6', 'request_id': 'req-337eedcf-adc9-44d5-a0da-7bad70258e8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:45.525162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] The token cache is being invalidate because project 436a3abed93b45a38be6104b312c49c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:01:45.525458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:45.526134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-337eedcf-adc9-44d5-a0da-7bad70258e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:01:45.528335 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2123/4233] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:45 2022] DELETE /identity/v3/projects/436a3abed93b45a38be6104b312c49c6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:45.534570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.535066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.535470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.560941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:45.566892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:45.671527 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2111/4234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:01:45.679789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.680226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.680752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.704792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:45.706428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:45.716050 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2124/4235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:45.719992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:45.729903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966976-e58e-4dbb-b26f-88e8fe0b4190 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:45.735468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:45.736390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.737110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.737538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.739140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:01:45.739599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:45.741474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:45.766165 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2112/4236] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:01:45.771457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:45.785515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41105e-d660-49bb-b13a-aeeeb1f8bb37 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:45.792231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:45.792940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.793226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.793504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.794478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:45.797260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:45.836626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2125/4237] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:01:45 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:45.838982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:45.851791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269e178-97f6-4ec2-af50-23cb2fbd728c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:45.921410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:45.922994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.923359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.923870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.924856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:45.926893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:45.958336 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2113/4238] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:01:45 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:01:45.962337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:45.976269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfff52-16f1-4818-a0e0-0bf0cd7354c8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:45.988293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:45.989122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:45.989670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:45.990252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:45.992763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:45.995658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:46.016134 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2126/4239] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:01:46.019925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:46.030218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440e7c-3c53-45af-b8ef-0734ce94a136 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:46.035548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:46.036212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:46.036518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:46.036801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:46.037516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:46.039129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27ae3-6c6b-40e5-85ff-98d14406516d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:46.055717 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2114/4240] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:01:46.060378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:46.071279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bff2c-1dfa-491e-97a2-7ff2f08f6d45 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:46.076341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:46.077298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:46.077585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:46.077858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] PATH_INFO: `/v3/projects/434a8950c15b4a96a46ed0f64c87c417/users/4e687099ccfe4d6fbeca88231424699a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:46.115887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434a8950c15b4a96a46ed0f64c87c417, user_id=4e687099ccfe4d6fbeca88231424699a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:46.118976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:46.137125 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2127/4241] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:01:46 2022] PUT /identity/v3/projects/434a8950c15b4a96a46ed0f64c87c417/users/4e687099ccfe4d6fbeca88231424699a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:01:46.148957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727c4b-b3b2-4f54-acff-e1a521246204 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:46.152681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727c4b-b3b2-4f54-acff-e1a521246204 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:46.152993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28727c4b-b3b2-4f54-acff-e1a521246204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:46.181753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-28727c4b-b3b2-4f54-acff-e1a521246204 None None] MFA Rules not processed for user `4e687099ccfe4d6fbeca88231424699a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:46.183267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-28727c4b-b3b2-4f54-acff-e1a521246204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:46.253381 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2115/4242] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:46.267727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:46.271047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:46.336288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41727da-3bf7-4511-90d1-1defba3a4097 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:46.340610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:46.341278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:46.342062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:46.342062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:46.353584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:46.357133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:46.381669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2128/4243] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:47.471843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4106-38b9-48fc-b44b-5de24cc082a4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:47.472310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4106-38b9-48fc-b44b-5de24cc082a4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:47.472649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4106-38b9-48fc-b44b-5de24cc082a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:47.491291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b98c4106-38b9-48fc-b44b-5de24cc082a4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:47.492562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b98c4106-38b9-48fc-b44b-5de24cc082a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:47.546030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2116/4244] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:47.558417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:47.560915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:47.636055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e8ac9-4d73-413d-b3c8-e011a854e883 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:47.641961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:47.642616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:47.642897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:47.643175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:47.661894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:47.662322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:47.662773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:47.663440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:47.664601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df34fe4-a73f-4ad1-b040-e751f9a2372d service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:47.673468 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2129/4245] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:01:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:47.682993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:47.684237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:47.741283 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2117/4246] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:01:49.265399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60846ec-84e4-408c-981b-28a0362691fc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:49.266520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60846ec-84e4-408c-981b-28a0362691fc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:49.266520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60846ec-84e4-408c-981b-28a0362691fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:49.288039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f60846ec-84e4-408c-981b-28a0362691fc None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:49.290648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f60846ec-84e4-408c-981b-28a0362691fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:49.299781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2130/4247] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:49.319942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:49.333739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12952b-48cc-4447-852a-c12de1062187 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:49.338903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:49.339555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:49.339837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:49.340111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:49.359891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:49.361481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:49.371514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2118/4248] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:50.728503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250379a-cb52-436c-918e-abadb6cfca88 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:50.729416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250379a-cb52-436c-918e-abadb6cfca88 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:50.729907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250379a-cb52-436c-918e-abadb6cfca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:50.748533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3250379a-cb52-436c-918e-abadb6cfca88 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:50.750116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3250379a-cb52-436c-918e-abadb6cfca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:50.759828 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2131/4249] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:50.773472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:50.787068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4e10e-c740-4e6a-a3c1-57ba6618fb4f service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:50.793354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:50.794012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:50.794305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:50.794588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:50.803104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:50.804717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8cbf9-3918-4337-adf0-c75616cb9bb1 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:50.812861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2119/4250] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:51.062447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fda4-e276-41fe-841b-dc462976b5f1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:51.063291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fda4-e276-41fe-841b-dc462976b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:51.063555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2fda4-e276-41fe-841b-dc462976b5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:51.082619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-69f2fda4-e276-41fe-841b-dc462976b5f1 None None] MFA Rules not processed for user `4e687099ccfe4d6fbeca88231424699a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:51.084106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-69f2fda4-e276-41fe-841b-dc462976b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:51.091103 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2132/4251] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:51.466453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:51.466937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:51.467384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:51.509507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] MFA Rules not processed for user `4e687099ccfe4d6fbeca88231424699a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:51.511020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:51.521137 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2120/4252] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:53.789929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:53.790479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:53.790820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:53.824240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] MFA Rules not processed for user `de9e0b13df3b487cb16732fcf86746b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:01:53.826178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:53.955333 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2133/4253] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:01:54.945663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:54.947728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:55.090968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17884f-479b-4960-b2ee-9df40d4310e7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:55.107926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:55.108640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:55.108927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:55.109205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:55.112968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:55.127455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:55.130397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:55.148680 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2121/4254] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:56.199568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:56.201313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:56.316854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216a69-cd4c-463b-a995-8ae04bcc07a3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:56.330159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:56.331316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:56.331609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:56.331885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:56.336865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:56.351379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:56.353284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:56.367476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2134/4255] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:56.982888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:01:56.985401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:57.056702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b14e7-a804-403b-ad49-a6daf9dce966 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:01:57.062151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:01:57.063592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:01:57.064085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:01:57.064640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:01:57.066801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:01:57.083852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:01:57.085240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:01:57.095672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2122/4256] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:07.195570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:07.235142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022abe45-b5ee-46e0-a783-3b3a38baedd4 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:07.239924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:07.240618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:07.240903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:07.241176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:07.242939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:07.278597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:07.280154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:07.290499 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2135/4257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:11.335811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:11.337556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:11.420886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:11.424113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:11.500588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01da9f-44fb-4bcb-9036-9631a34bafb5 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:11.506010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:11.507176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.507513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.507796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] PATH_INFO: `/v3/users/41359fff35654f228021d168daf5f8d3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:11.509193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=41359fff35654f228021d168daf5f8d3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:11.511142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:11.520353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35baf36-42b0-4284-b1c9-2dfdf71a1536 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:11.525320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:11.526427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.527126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.527419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] PATH_INFO: `/v3/users/ad3cf44a90a54b1eb08ba969847862e5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:11.528764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3cf44a90a54b1eb08ba969847862e5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:11.531074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:11.566977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41359fff35654f228021d168daf5f8d3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.581415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41359fff35654f228021d168daf5f8d3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.582131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41359fff35654f228021d168daf5f8d3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.588585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3cf44a90a54b1eb08ba969847862e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.593724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41359fff35654f228021d168daf5f8d3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.596337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3cf44a90a54b1eb08ba969847862e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.597011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3cf44a90a54b1eb08ba969847862e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.597959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3cf44a90a54b1eb08ba969847862e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.601573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a83d82b1-0ab2-40f3-90f8-2a6d9a130abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41359fff35654f228021d168daf5f8d3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.605642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3cf44a90a54b1eb08ba969847862e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.608533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2123/4258] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:11 2022] DELETE /identity/v3/users/41359fff35654f228021d168daf5f8d3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:11.612384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.612905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.613193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:11.624550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2136/4259] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:11 2022] DELETE /identity/v3/users/ad3cf44a90a54b1eb08ba969847862e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:11.644612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:11.645893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:11.716200 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2124/4260] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:11.730290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:11.732043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:11.832674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555fad-611f-4988-8404-ca8abd968a43 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:11.838122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:11.839641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:11.840684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:11.841551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.841869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.842156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:11.855790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a31c0-2c58-4ad1-af6c-77fe2c44937b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:11.861563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:11.862388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:11.862580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.862945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.863439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] PATH_INFO: `/v3/projects/23ceefc39a5247ae86277ab79385c021` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:11.864866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ceefc39a5247ae86277ab79385c021)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:11.865308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49cbe2-0d07-455d-a476-9d062c4d4d1d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:11.867345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:11.891220 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2137/4261] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:11.949940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ceefc39a5247ae86277ab79385c021', 'request_id': 'req-ce64f285-8dcb-4a99-bef3-809fc768689f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.958648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ceefc39a5247ae86277ab79385c021', 'request_id': 'req-ce64f285-8dcb-4a99-bef3-809fc768689f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.965286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ceefc39a5247ae86277ab79385c021', 'request_id': 'req-ce64f285-8dcb-4a99-bef3-809fc768689f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.978954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] The token cache is being invalidate because project 23ceefc39a5247ae86277ab79385c021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:11.979401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.980391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce64f285-8dcb-4a99-bef3-809fc768689f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:11.982728 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2125/4262] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:11 2022] DELETE /identity/v3/projects/23ceefc39a5247ae86277ab79385c021 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:02:11.990237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:11.990532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:11.991299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.032585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:12.033840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.113508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2138/4263] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:12.122487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.122788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.123072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.146997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:12.148240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.158810 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2126/4264] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:12.163089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.173793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88668a-9187-4d30-8d9b-ee292810ff17 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.178896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.180228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.180540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.180818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.181664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:02:12.182002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.183941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.199305 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2139/4265] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:02:12.209143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.210842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.212643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.231306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8188e73-87da-4263-a0f7-73b6046b3453 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.233259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae33af-dd96-46ad-aab3-0e5815da5ce0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.237271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.238047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.238333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.238969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.239066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.239279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.239974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.240366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.240752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] PATH_INFO: `/v3/projects/0e9312a463f0419ca125b1155492d2c5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.241595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.242099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9312a463f0419ca125b1155492d2c5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.244082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.299680 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2127/4266] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:12 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:12.300524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.337522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9312a463f0419ca125b1155492d2c5', 'request_id': 'req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.348545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9312a463f0419ca125b1155492d2c5', 'request_id': 'req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.360349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9312a463f0419ca125b1155492d2c5', 'request_id': 'req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.378825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] The token cache is being invalidate because project 0e9312a463f0419ca125b1155492d2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:12.379555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.380421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.383039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2140/4267] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:12 2022] DELETE /identity/v3/projects/0e9312a463f0419ca125b1155492d2c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:12.387887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.389486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.400497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df63c-959f-4ef0-866c-74d85c86ca66 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.462714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.463386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.463676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.463950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.464675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.466567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.467679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc8fd-c348-46ba-9da0-dfc3f1a506d6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.473003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.473902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.474181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.474450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] PATH_INFO: `/v3/users/fc36955174db4ee3b411ab3d3c97b743` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.475690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc36955174db4ee3b411ab3d3c97b743)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.477706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.487643 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2128/4268] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:12 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:12.491984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.493898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.506827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8837a05-0a10-48f3-b90a-c65745d0382c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.513171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.514072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.514694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.515118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.516588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.518450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.527091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc36955174db4ee3b411ab3d3c97b743'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.529970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2129/4269] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:02:12.533988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.535777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc36955174db4ee3b411ab3d3c97b743'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.536569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc36955174db4ee3b411ab3d3c97b743'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.537915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc36955174db4ee3b411ab3d3c97b743'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.545016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41614c6-41c8-4128-a710-151b19510d73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.546666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-18b8f34e-8925-477e-a206-3a8041f16ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc36955174db4ee3b411ab3d3c97b743'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.551602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.552496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.552823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.553109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.553839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.555448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.566506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2130/4270] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:12.566941 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2141/4271] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:12 2022] DELETE /identity/v3/users/fc36955174db4ee3b411ab3d3c97b743 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:12.570732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.572411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.586525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b78e8-3117-46d6-9ce5-a73d0353c3f6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.654903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.655874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.656741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.657025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] PATH_INFO: `/v3/projects/ff8ea67a27f74237963a177abd07cc45/users/f15cc4e52d554c3e9ab441d22453fffd/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.679795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8ea67a27f74237963a177abd07cc45, user_id=f15cc4e52d554c3e9ab441d22453fffd, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.685297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.706718 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2131/4272] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:12 2022] PUT /identity/v3/projects/ff8ea67a27f74237963a177abd07cc45/users/f15cc4e52d554c3e9ab441d22453fffd/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:02:12.713093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.713571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.714246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.737412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:12.738871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.809532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2142/4273] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:12.819725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.821643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.883875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:12.886417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:12.894316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a8911-b40b-4eb6-a066-eaf0a7fc34cb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.898195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.898799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.899514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.899514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.902402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3321e8-53d5-4865-b9c4-30c8430bfc17 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:12.908226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:12.908907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.909284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:12.910351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34638-c622-46b6-8263-56b3a1622d91 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.912039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:12.912431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] PATH_INFO: `/v3/projects/e82913a6c5214b0d87081cbf003fecf1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:12.913928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82913a6c5214b0d87081cbf003fecf1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:12.916496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:12.920389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2132/4274] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:12.972592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82913a6c5214b0d87081cbf003fecf1', 'request_id': 'req-5b6aac5f-1c06-4d6f-9819-924707a202f6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.978900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82913a6c5214b0d87081cbf003fecf1', 'request_id': 'req-5b6aac5f-1c06-4d6f-9819-924707a202f6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.986257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82913a6c5214b0d87081cbf003fecf1', 'request_id': 'req-5b6aac5f-1c06-4d6f-9819-924707a202f6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.997676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] The token cache is being invalidate because project e82913a6c5214b0d87081cbf003fecf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:12.997883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:12.998628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5b6aac5f-1c06-4d6f-9819-924707a202f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:13.000890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2143/4275] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:12 2022] DELETE /identity/v3/projects/e82913a6c5214b0d87081cbf003fecf1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:02:13.007690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.008019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.008299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.027439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:13.028686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:13.091751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2133/4276] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:13.100011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.100403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.100605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.119160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:13.120674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:13.130815 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2144/4277] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:13.134877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.145963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab81923-fb13-410b-bdb3-0ef3e56ff51b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.150641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.151283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.151565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.151841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.152587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:02:13.152893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.154478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.166638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2134/4278] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:02:13.171131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.181142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775719e-6f30-4214-8a7c-39312297a4d0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.186229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.187193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.188121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.188760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.189479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.191360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.222843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2145/4279] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:13.224666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.236817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce2d-5266-4639-a1b9-16ce6591b953 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.306330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.307111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.307477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.307936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.309259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.311289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.335517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2135/4280] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:13.339865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.350887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6587a-2728-46b8-a891-a1331c36201b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.363014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.364214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.364675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.365037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.366397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.368138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.384595 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2146/4281] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:13.388387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.403860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89915f-61c1-4edb-aaad-2075850dce2e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.413523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.414736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.414736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.415014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.415873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.417619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8fca7-4f4c-42e5-92a6-b91d5bfe7527 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.429924 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2136/4282] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:13.433935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.452984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790c1a4-94e9-4ac4-a0ef-87dbaba3da7f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.460187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.461196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.461882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.462237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] PATH_INFO: `/v3/projects/6285976ac47c4791acbf3573297ab5a6/users/8bed37cfaf3c460fa0a378aba8953078/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.477922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6285976ac47c4791acbf3573297ab5a6, user_id=8bed37cfaf3c460fa0a378aba8953078, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.481936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.498557 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2147/4283] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:13 2022] PUT /identity/v3/projects/6285976ac47c4791acbf3573297ab5a6/users/8bed37cfaf3c460fa0a378aba8953078/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:13.510387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.510676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.510956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.543219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] MFA Rules not processed for user `8bed37cfaf3c460fa0a378aba8953078`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:13.544606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:13.669712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2137/4284] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:13.672172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.744015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26021e38-ebee-4bde-9b5c-4de263975dc8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.749071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.749780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.750070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.750353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.751051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.753054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.791091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2148/4285] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:13.795323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.818325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a668a23-b1c8-4cc4-9b35-7ba0451ed666 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.923383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.924936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.925473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.925999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.926991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.929531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:13.962789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2138/4286] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:13 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:02:13.967042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:13.983319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6d980-2084-4900-af82-a20abb7cb711 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:13.991508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:13.993114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:13.993615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:13.994262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:13.995395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:13.997822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:14.013216 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2149/4287] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:14.018063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:14.032934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ba2a-a59b-425e-89c6-0fc8fa741a6c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:14.050938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:14.050938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.050938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.050938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] PATH_INFO: `/v3/projects/db35456837dd4b1eba9e5eceddece4b0/users/d23e0be4bdb94826a97f344040416171/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.062465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db35456837dd4b1eba9e5eceddece4b0, user_id=d23e0be4bdb94826a97f344040416171, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:14.065268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:14.081430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2139/4288] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:14 2022] PUT /identity/v3/projects/db35456837dd4b1eba9e5eceddece4b0/users/d23e0be4bdb94826a97f344040416171/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:14.085603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:14.099368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c2ee-09ad-4e97-a494-462070dbd15c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:14.163027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:14.163870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.164158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.164442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.165323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:14.167099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef211d-0dcc-46bb-8739-2d2461dde757 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:14.177657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2150/4289] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:02:14.181559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:14.194984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e6aff-81bf-4515-a998-57a3da46ba58 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:14.202068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:14.203669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.204232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.204682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] PATH_INFO: `/v3/projects/db35456837dd4b1eba9e5eceddece4b0/users/d23e0be4bdb94826a97f344040416171/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.207156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db35456837dd4b1eba9e5eceddece4b0, user_id=d23e0be4bdb94826a97f344040416171, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:14.210465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f427a-ad1b-4225-b633-e9628b69cbf3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:14.242218 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2140/4290] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:14 2022] PUT /identity/v3/projects/db35456837dd4b1eba9e5eceddece4b0/users/d23e0be4bdb94826a97f344040416171/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:14.254693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.255056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.255512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.283849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] MFA Rules not processed for user `d23e0be4bdb94826a97f344040416171`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:14.285008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:14.376656 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2151/4291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:14.379400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.379696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.379979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.401497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] MFA Rules not processed for user `8bed37cfaf3c460fa0a378aba8953078`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:14.403111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:14.476673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2141/4292] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:14.487992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:14.489517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:14.595626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683078a7-5233-4f22-a1a9-a7512a523ecb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:14.603969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:14.604914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:14.605257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:14.605545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:14.614166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:14.615787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:14.625593 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2152/4293] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:15.148678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:15.151626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:15.264355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283eae-ee0b-466b-9dcf-030e98b04172 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:15.269569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:15.270464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:15.270747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:15.271022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] PATH_INFO: `/v3/users/de9e0b13df3b487cb16732fcf86746b3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:15.272223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9e0b13df3b487cb16732fcf86746b3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:15.274258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:15.331772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9e0b13df3b487cb16732fcf86746b3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.346144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9e0b13df3b487cb16732fcf86746b3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.346891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9e0b13df3b487cb16732fcf86746b3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.362045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9e0b13df3b487cb16732fcf86746b3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.371807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59c1cf4a-f13a-46e7-a3f3-4ff13f2e9385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9e0b13df3b487cb16732fcf86746b3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.379403 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2142/4294] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:15 2022] DELETE /identity/v3/users/de9e0b13df3b487cb16732fcf86746b3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:15.613238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:15.631113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e4d79-3a8d-4bbd-981e-def3c1b6a201 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:15.698884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:15.699992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:15.700273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:15.700637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] PATH_INFO: `/v3/projects/46605b214f8144ebbbd2aab432bb7633` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:15.702032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46605b214f8144ebbbd2aab432bb7633)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:15.704714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:15.754238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46605b214f8144ebbbd2aab432bb7633', 'request_id': 'req-96658a31-1383-41a8-9115-fc74415a3b5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.762089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46605b214f8144ebbbd2aab432bb7633', 'request_id': 'req-96658a31-1383-41a8-9115-fc74415a3b5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.774488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46605b214f8144ebbbd2aab432bb7633', 'request_id': 'req-96658a31-1383-41a8-9115-fc74415a3b5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.787678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] The token cache is being invalidate because project 46605b214f8144ebbbd2aab432bb7633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:15.788141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.788917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-96658a31-1383-41a8-9115-fc74415a3b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:15.794296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2153/4295] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:15 2022] DELETE /identity/v3/projects/46605b214f8144ebbbd2aab432bb7633 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:15.796720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:15.797182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:15.797393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:15.838783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:15.840016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:15.914217 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2143/4296] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:02:15.923296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:15.923997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:15.924320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:15.952591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:15.954762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:15.965303 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2154/4297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:15.969314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:15.979767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc94cf-b123-4a72-97ed-b59a296d000c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:15.985303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:15.985997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:15.986264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:15.986578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:15.987305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:02:15.987754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:15.989566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.009523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2144/4298] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:02:16.009668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.020179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8b92e-90d5-48cc-96f0-5d3c792abe75 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.025697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.026366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.026657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.027015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.027737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.029673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.065908 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2155/4299] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:16 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:02:16.070394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.083048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f71894-ac28-45be-8397-94fc2bce37b5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.156023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.157047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.157336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.157619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.158449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.160838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.191069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2145/4300] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:16 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:16.192621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.205995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db42a5-cb40-4604-8604-fa9c85f604db admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.213115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.213971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.214259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.214546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.215273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.217566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.240568 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2156/4301] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:16.243075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.256336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7116c-764d-4669-a271-8461eaa92552 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.262615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.263487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.264333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.266511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.266511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.268026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5724fc-d329-4d81-bf24-e57b942a9c56 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.280835 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2146/4302] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:16.285041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.299404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33b09-ce5c-40ab-8222-1fd2a2e9a45c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.305584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.307245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.307891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.308440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] PATH_INFO: `/v3/projects/273e387ae1624bacabc721d2c278ac11/users/87543d1fc636444393646043911fb4e0/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.336118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e387ae1624bacabc721d2c278ac11, user_id=87543d1fc636444393646043911fb4e0, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.354499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.380222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2157/4303] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:16 2022] PUT /identity/v3/projects/273e387ae1624bacabc721d2c278ac11/users/87543d1fc636444393646043911fb4e0/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:16.389124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.389370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.389824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.423477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] MFA Rules not processed for user `87543d1fc636444393646043911fb4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:16.424729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:16.516920 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2147/4304] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:16.533291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:16.535066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:16.647976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dda4ba-def7-438d-a916-4edac0a99be6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:16.654657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:16.655861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:16.656147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:16.656421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:16.670025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:16.672387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9886bc6-3a54-417f-9790-609b74c69275 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:16.692829 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2158/4305] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:17.137048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:17.250952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f087b-6dd3-4607-b7bd-3e83bf3fe0f9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:17.259331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:17.260665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:17.261244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:17.262014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] PATH_INFO: `/v3/users/87543d1fc636444393646043911fb4e0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:17.264697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87543d1fc636444393646043911fb4e0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:17.267606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:17.285385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:17.285854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:17.286142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:17.319873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:17.325269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:17.338782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87543d1fc636444393646043911fb4e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:17.358680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87543d1fc636444393646043911fb4e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:17.360147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87543d1fc636444393646043911fb4e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:17.374388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87543d1fc636444393646043911fb4e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:17.391305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2d18ed9e-68a8-45de-9ff0-cde00bc48483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87543d1fc636444393646043911fb4e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:17.403199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2148/4306] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:17 2022] DELETE /identity/v3/users/87543d1fc636444393646043911fb4e0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:17.410612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:17.411626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:17.411941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:17.454152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:17.454514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2159/4307] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:02:17.462539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:17.480269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:17.481827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:17.553452 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2149/4308] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:17.635122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:17.636801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:17.662200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c1792-18d6-4495-8960-82dd4f50577b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:17.779937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a620-b593-4d9d-8911-c44c8497d33e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:17.796613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:17.797364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:17.797577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:17.797855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:17.813581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:17.815045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb7699-0208-47d5-9496-79a66b8b2a6a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:17.822708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:17.823464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:17.823760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:17.824036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:17.841750 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2150/4309] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:17.900724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:17.902411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000643f9-b669-4ba2-996a-fb3d7c6c3350 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:17.920843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2160/4310] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:02:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:18.499338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:18.499967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:18.500087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:18.580444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] MFA Rules not processed for user `f15cc4e52d554c3e9ab441d22453fffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:18.582345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:18.759140 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2151/4311] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:18.771742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:18.772817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:18.773402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:18.809834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] MFA Rules not processed for user `f15cc4e52d554c3e9ab441d22453fffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:18.811274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:18.832333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:18.834618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:18.841269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2161/4312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:18.859789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:18.862987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:18.887051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1536313-bb77-424e-a364-946e20bb6017 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:18.905719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:18.907777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:18.908304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:18.908824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] PATH_INFO: `/v3/projects/273e387ae1624bacabc721d2c278ac11` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:18.910452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273e387ae1624bacabc721d2c278ac11)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:18.913247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.023888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273e387ae1624bacabc721d2c278ac11', 'request_id': 'req-07a2e2f7-cc1b-441c-8012-527607f0cdf6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:19.035990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273e387ae1624bacabc721d2c278ac11', 'request_id': 'req-07a2e2f7-cc1b-441c-8012-527607f0cdf6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:19.052889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273e387ae1624bacabc721d2c278ac11', 'request_id': 'req-07a2e2f7-cc1b-441c-8012-527607f0cdf6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:19.071309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] The token cache is being invalidate because project 273e387ae1624bacabc721d2c278ac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:19.071766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:19.073047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07a2e2f7-cc1b-441c-8012-527607f0cdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:19.074463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2152/4313] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:18 2022] DELETE /identity/v3/projects/273e387ae1624bacabc721d2c278ac11 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:19.080476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58784dc-a8cf-42ba-a6b9-d0708504f33b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.082078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58784dc-a8cf-42ba-a6b9-d0708504f33b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.084009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58784dc-a8cf-42ba-a6b9-d0708504f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.102964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d121-c0b3-4bd2-ab5c-47ddb4505f3d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.138356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f58784dc-a8cf-42ba-a6b9-d0708504f33b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:19.140775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f58784dc-a8cf-42ba-a6b9-d0708504f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:19.252330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.254039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.254368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.254594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.260576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2153/4314] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:19.260771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:19.263971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.264375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.264837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.322516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:19.323852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:19.338083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2154/4315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:19.344239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.346964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.349049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.353985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a22f0-e067-4766-ae57-a33f079354ee None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.359918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.360632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.360919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.361199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.361923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:02:19.362238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.364057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.381424 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2162/4316] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:19.381731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2155/4317] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:02:19.386183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.402530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846f17-469d-4069-9b82-b841da99aec2 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.409347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.410278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.410715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.411143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.412015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.414386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.454238 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2163/4318] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:19 2022] POST /identity/v3/projects => generated 397 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:02:19.455478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.469771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f29a2-bc71-434d-a52c-6ada0e1b9c48 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.585768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.586439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.586720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.587155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.587856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.590942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.626084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2156/4319] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:19 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:19.632200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.650354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083028-2974-4c45-858b-215092c68dfa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.667567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.668307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.668558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.668926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.669676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.671372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.703136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.707623 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2164/4320] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:19.717751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812703a-60b7-4d5a-972b-29fa5f14c8aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.731859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.736185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.736572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.736939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.739713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.741510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c461-7909-431a-9601-50fc29ee3aa2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.777427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2157/4321] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:02:19.778212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:19.790772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104be514-d012-492d-a1bf-7872fbe07d74 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:19.798743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:19.803862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.804147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.804645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] PATH_INFO: `/v3/projects/785cc73963384110988648167b1dc942/users/3535257f20f14f6588de00d021bc854b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.854867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785cc73963384110988648167b1dc942, user_id=3535257f20f14f6588de00d021bc854b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:19.858394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:19.960784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12a74-fa80-4930-be8a-07d0feb6fb14 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:19.961217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12a74-fa80-4930-be8a-07d0feb6fb14 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:19.961594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12a74-fa80-4930-be8a-07d0feb6fb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:19.963931 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2165/4322] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:19 2022] PUT /identity/v3/projects/785cc73963384110988648167b1dc942/users/3535257f20f14f6588de00d021bc854b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:02:20.029686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dff12a74-fa80-4930-be8a-07d0feb6fb14 None None] MFA Rules not processed for user `3535257f20f14f6588de00d021bc854b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:20.032505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dff12a74-fa80-4930-be8a-07d0feb6fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:20.173654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2158/4323] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:20.304471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:20.306893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:20.506512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6cc4a-feaa-4ffc-89a8-9fbebd0b2cf5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:20.519860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:20.521376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:20.521798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:20.522260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:20.534061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:20.536244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:20.548838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2166/4324] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:20.657674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493a6ec-5f83-4845-b50f-c365fe564989 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:20.658291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493a6ec-5f83-4845-b50f-c365fe564989 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:20.658291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493a6ec-5f83-4845-b50f-c365fe564989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:20.729004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f493a6ec-5f83-4845-b50f-c365fe564989 None None] MFA Rules not processed for user `3535257f20f14f6588de00d021bc854b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:20.730273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f493a6ec-5f83-4845-b50f-c365fe564989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:20.767561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2159/4325] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:02:21.361477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:21.508226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55733835-4ed9-49fe-ab74-e0a34753742c service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:21.527222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:21.528288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:21.529912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:21.530419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] PATH_INFO: `/v3/users/3535257f20f14f6588de00d021bc854b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:21.532697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3535257f20f14f6588de00d021bc854b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:21.535034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:21.624473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3535257f20f14f6588de00d021bc854b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:21.648333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3535257f20f14f6588de00d021bc854b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:21.649257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3535257f20f14f6588de00d021bc854b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:21.650081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3535257f20f14f6588de00d021bc854b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:21.682604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3535257f20f14f6588de00d021bc854b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:21.737019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2167/4326] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:21 2022] DELETE /identity/v3/users/3535257f20f14f6588de00d021bc854b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:21.740957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:21.741421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:21.741677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:21.787692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:21.790903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:21.962483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2160/4327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:21.970698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:21.973842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:22.087535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522f99f-e7e5-42b7-9e7c-3089fcc664bd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:22.093360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:22.094033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:22.094479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:22.094769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:22.109559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:22.111490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d768e-9b3a-420b-a67f-4f27fa109b83 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:22.133426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2168/4328] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:22.631900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:22.633926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:22.659936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e28abf-9e46-49e9-bd46-92af55284685 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:22.667686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:22.668788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:22.669238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:22.669653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] PATH_INFO: `/v3/projects/785cc73963384110988648167b1dc942` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:22.671403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785cc73963384110988648167b1dc942)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:22.673712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:22.741427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785cc73963384110988648167b1dc942', 'request_id': 'req-ca47db91-14b9-4f1a-bb93-f40d141f25e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:22.751842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785cc73963384110988648167b1dc942', 'request_id': 'req-ca47db91-14b9-4f1a-bb93-f40d141f25e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:22.758853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785cc73963384110988648167b1dc942', 'request_id': 'req-ca47db91-14b9-4f1a-bb93-f40d141f25e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:22.777872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] The token cache is being invalidate because project 785cc73963384110988648167b1dc942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:22.778162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:22.778814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca47db91-14b9-4f1a-bb93-f40d141f25e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:22.780556 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2161/4329] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:22 2022] DELETE /identity/v3/projects/785cc73963384110988648167b1dc942 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:22.789169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:22.789544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:22.789684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:22.812829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:22.814292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:22.897458 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2169/4330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:02:22.905105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:22.905521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:22.905703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:22.938668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:22.940193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:22.965896 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2162/4331] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:22.967247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:22.979261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f89a-a8d2-4bcf-b925-2ac390691ffe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:22.992850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:22.993668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:22.993951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:22.994223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:22.994959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:02:22.997714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.024024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.060628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2170/4332] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:02:23.066446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.079445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01f99-ab4f-429b-982a-55ddf048e86d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.090004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.091304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.091915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.092395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.093368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.096019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.148969 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2163/4333] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:02:23 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:02:23.152920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.166113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabc2ee-ba98-46d8-a192-47b1ecbca00c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.253538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.254371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.254748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.255128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.255915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.258987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.287535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2171/4334] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:02:23 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:02:23.288992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.305088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480200f-ce5e-4497-bdcb-ef3592be7bba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.311406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.312572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.312964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.313482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.314279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.316358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.331301 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2164/4335] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:02:23.335187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.347345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332a5ea-ab58-436d-b9b4-35b2f352aaee admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.356080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.356808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.357098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.357379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.358122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.360807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec8aa-fa92-4c11-bd68-81f48d4b442d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.378581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.378943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2172/4336] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:02:23.393079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152389c-ace4-4245-a14a-f25a8a8e4d22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.401667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.402658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.402948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.403278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] PATH_INFO: `/v3/projects/cf913c65b2ee4d168f38d2ffd7f02585/users/5bf97b33a7644fd9b2c92af3138f040c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.422040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf913c65b2ee4d168f38d2ffd7f02585, user_id=5bf97b33a7644fd9b2c92af3138f040c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.424886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.451219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.451516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.451803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.453394 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2165/4337] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:02:23 2022] PUT /identity/v3/projects/cf913c65b2ee4d168f38d2ffd7f02585/users/5bf97b33a7644fd9b2c92af3138f040c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:23.499527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:23.500611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:23.628434 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2173/4338] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:23.646748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:23.650532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:23.816052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488c6d-1715-4dac-a12a-0b025e25e3e7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:23.821314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:23.822486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:23.823111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:23.823603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:23.842939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:23.846503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:23.862477 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2166/4339] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:02:26.844044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:26.845664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:27.064728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7effd-ef87-4087-8f77-e0e6ba396096 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:27.079616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:27.080483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:27.080871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:27.081246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:27.085819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:27.135861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:27.139684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad3ae-38c1-4867-8243-57c044e2d31d service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:27.174468 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2174/4340] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:31.239172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:31.243315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:31.275320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee0a06-dfeb-4e42-8829-453f5b9275fd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:31.284787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:31.285466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:31.285755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:31.286038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:31.292050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:31.477661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:31.479339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a79b6-887e-4cd3-ac8d-a00819e67bb3 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:31.508933 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2167/4341] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:31.540855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:31.540855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:31.540855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:31.596992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] MFA Rules not processed for user `8bed37cfaf3c460fa0a378aba8953078`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:31.598252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:31.730521 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2175/4342] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:33.034405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a268-ddf6-4a25-a4b2-decf40fd0a80 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:33.034853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a268-ddf6-4a25-a4b2-decf40fd0a80 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:33.034965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a268-ddf6-4a25-a4b2-decf40fd0a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:33.080963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4bd5a268-ddf6-4a25-a4b2-decf40fd0a80 None None] MFA Rules not processed for user `5bf97b33a7644fd9b2c92af3138f040c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:33.082757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4bd5a268-ddf6-4a25-a4b2-decf40fd0a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:33.199053 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2168/4343] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:33.214280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:33.237126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed33974-296b-4909-9976-d57e2caec708 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:33.243530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:33.244415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:33.244931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:33.245390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:33.275215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:33.277554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:33.296686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2176/4344] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:33.490938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99ce2-6502-4531-813a-3aedc446ecaf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:33.491545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99ce2-6502-4531-813a-3aedc446ecaf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:33.492241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb99ce2-6502-4531-813a-3aedc446ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:33.535927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8cb99ce2-6502-4531-813a-3aedc446ecaf None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:33.537545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8cb99ce2-6502-4531-813a-3aedc446ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:33.690887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2169/4345] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:33.719265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:33.721653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:33.892874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418380-467d-40b5-9cfd-82a0ea0af238 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:33.907867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:33.908980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:33.909277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:33.909704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:33.948440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:33.953916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:33.976075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2177/4346] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:39.633247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81b1-7ca8-4380-83c9-d75f6d3b0fd0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:39.634412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81b1-7ca8-4380-83c9-d75f6d3b0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:39.634927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc81b1-7ca8-4380-83c9-d75f6d3b0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:39.695660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b7cc81b1-7ca8-4380-83c9-d75f6d3b0fd0 None None] MFA Rules not processed for user `5bf97b33a7644fd9b2c92af3138f040c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:39.699390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7cc81b1-7ca8-4380-83c9-d75f6d3b0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:39.733956 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2170/4347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:43.017128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:43.031249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30460351-66a9-4cc0-bbc7-14419becbe5f service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:43.036422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:43.037363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:43.037800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:43.038241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:43.040569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:43.053517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:43.053517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:43.083887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2178/4348] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:51.122592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33d7f-26cf-474c-bf86-5ed0964bd505 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:51.123220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33d7f-26cf-474c-bf86-5ed0964bd505 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:51.123322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a33d7f-26cf-474c-bf86-5ed0964bd505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:51.143714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e9a33d7f-26cf-474c-bf86-5ed0964bd505 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:51.145367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e9a33d7f-26cf-474c-bf86-5ed0964bd505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:51.153052 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2171/4349] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:02:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:51.169159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:51.184085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690bb1-6f78-4baa-8107-54a494b86d28 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:51.189639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:51.190287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:51.190597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:51.190875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:51.199441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:51.201076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:51.209038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2179/4350] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:51.789281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:51.790056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:51.790574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:51.815912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:51.818145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:51.833101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2172/4351] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:02:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:51.862482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:51.893901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a756-4383-4985-9465-b4a5dd1f65ce service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:51.904254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:51.904991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:51.905280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:51.905561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:51.915977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:51.917679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebdb34-5809-4986-83d0-ed88f337d10f service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:51.928110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2180/4352] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:53.289640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:53.312788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269c860-c3ac-4815-b7c8-67a1c42eb278 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:53.336150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:53.337254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:53.338300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:53.338735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:53.343642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:53.386629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:53.388510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af665a9c-1e85-43c3-bdc3-14e7e949a9a2 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:53.416616 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2173/4353] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:53.489454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:53.489973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:53.490140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:53.493091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2181/4354] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:02:53.501469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e85fd-bf47-469b-8d1c-fd7cf140dcc5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:53.501759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e85fd-bf47-469b-8d1c-fd7cf140dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:53.502039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e85fd-bf47-469b-8d1c-fd7cf140dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:53.625815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2f5e85fd-bf47-469b-8d1c-fd7cf140dcc5 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:53.627947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f5e85fd-bf47-469b-8d1c-fd7cf140dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:53.730306 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2174/4355] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:53.761597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:53.764032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:53.798101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8ebd-c47f-4fc2-8205-b6cc19911017 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:53.805476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:53.806472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:53.806950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:53.807386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:53.818700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:53.820713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:53.834232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2182/4356] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:54.269355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:54.269757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:54.270176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:54.306252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:54.308662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:54.423394 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2175/4357] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:54.782889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:54.784629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:54.798133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a274-c841-4700-9e19-70475514cf0c service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:54.802910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:54.803800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:54.804304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:54.804685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:54.806667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:54.823259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:54.824903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005781c-71bf-4b22-b75d-9094e7bd42c2 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:54.837209 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2183/4358] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:02:58.470193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:58.472427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:58.486719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8f36e-4bb8-4d0a-96b1-b54e635a1555 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:58.491947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:58.492861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:58.493305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:58.493762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] PATH_INFO: `/v3/users/8bed37cfaf3c460fa0a378aba8953078` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:58.495133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bed37cfaf3c460fa0a378aba8953078)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:58.497367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:58.592868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bed37cfaf3c460fa0a378aba8953078'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:58.612019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bed37cfaf3c460fa0a378aba8953078'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:58.613028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bed37cfaf3c460fa0a378aba8953078'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:58.629437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bed37cfaf3c460fa0a378aba8953078'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:58.640901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bed37cfaf3c460fa0a378aba8953078'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:58.649593 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2176/4359] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:58 2022] DELETE /identity/v3/users/8bed37cfaf3c460fa0a378aba8953078 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:58.654327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:58.656129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:58.656655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:58.681864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:02:58.683925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:58.853948 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2184/4360] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:02:58.863931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:58.865579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:59.058403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d63e06-4dfc-493b-ae1c-d603187224a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:59.067406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:59.068097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:59.068386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:59.068953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:59.114598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:59.120867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:59.173016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2177/4361] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:02:59.735733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:59.739322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:02:59.769080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6581dad-7faf-4dad-869b-212f55908087 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:02:59.785272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:02:59.788875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:02:59.790654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:02:59.791850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] PATH_INFO: `/v3/projects/6285976ac47c4791acbf3573297ab5a6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:02:59.797737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6285976ac47c4791acbf3573297ab5a6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:02:59.801146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:02:59.925701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6285976ac47c4791acbf3573297ab5a6', 'request_id': 'req-fc387cc8-87bb-4228-9f2d-4bf975b381a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:59.937309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6285976ac47c4791acbf3573297ab5a6', 'request_id': 'req-fc387cc8-87bb-4228-9f2d-4bf975b381a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:59.953457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6285976ac47c4791acbf3573297ab5a6', 'request_id': 'req-fc387cc8-87bb-4228-9f2d-4bf975b381a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:59.972938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] The token cache is being invalidate because project 6285976ac47c4791acbf3573297ab5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:02:59.973514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:59.974348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:02:59.981628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2185/4362] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:59 2022] DELETE /identity/v3/projects/6285976ac47c4791acbf3573297ab5a6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:02:59.981786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:02:59.994796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a9d7-5db8-4a53-8f12-4eda5be68182 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:00.090843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:00.093463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:00.093907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:00.094672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] PATH_INFO: `/v3/users/d23e0be4bdb94826a97f344040416171` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:00.096345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23e0be4bdb94826a97f344040416171)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:00.098440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:00.175886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23e0be4bdb94826a97f344040416171'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.197701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23e0be4bdb94826a97f344040416171'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.199297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23e0be4bdb94826a97f344040416171'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.228934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23e0be4bdb94826a97f344040416171'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.239376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eec2f252-a4d2-4c91-8081-95ae8fc89e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23e0be4bdb94826a97f344040416171'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.254414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2178/4363] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:02:59 2022] DELETE /identity/v3/users/d23e0be4bdb94826a97f344040416171 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:03:00.639599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:00.641132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:00.676494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387cc8-87bb-4228-9f2d-4bf975b381a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:00.805717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:00.807336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:00.807776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:00.808206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] PATH_INFO: `/v3/projects/db35456837dd4b1eba9e5eceddece4b0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:00.809816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db35456837dd4b1eba9e5eceddece4b0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:00.812840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:00.919660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db35456837dd4b1eba9e5eceddece4b0', 'request_id': 'req-ea58d756-76fc-4fa8-89a0-a611381c9861'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.941080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db35456837dd4b1eba9e5eceddece4b0', 'request_id': 'req-ea58d756-76fc-4fa8-89a0-a611381c9861'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.951093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db35456837dd4b1eba9e5eceddece4b0', 'request_id': 'req-ea58d756-76fc-4fa8-89a0-a611381c9861'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.970000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] The token cache is being invalidate because project db35456837dd4b1eba9e5eceddece4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:03:00.970527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.972867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea58d756-76fc-4fa8-89a0-a611381c9861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:00.977291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2186/4364] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:00 2022] DELETE /identity/v3/projects/db35456837dd4b1eba9e5eceddece4b0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:00.985960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:00.986474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:00.986571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.006779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:01.009025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:01.112831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.113085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.113671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.114104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2179/4365] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:01.160256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:01.161539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:01.187035 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2187/4366] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:03:01.191677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.207174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0dd9-5600-4a49-a713-368fc7ea6e47 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.217552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.229465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.232078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.232555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.234368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:03:01.235616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.239299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.265285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2180/4367] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:03:01.269474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.291707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eb657-abab-4bef-9b4f-98760d46f502 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.307417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.308296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.308783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.309216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.311334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.314308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.356832 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2188/4368] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:03:01.361469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.391335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1217-c216-4cda-8a77-44430a676201 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.534697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.543172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.543723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.544189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.545157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.552078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.598633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2181/4369] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:03:01 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:01.599794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.617497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121c333-094b-4713-aec3-dd650c7595bd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.632880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.633904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.634538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.634894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.636060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.638592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.655184 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2189/4370] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:01.658319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.673399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91fba3-6a30-4739-9be9-0ec165faa92e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.693093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.694159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.694520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.694873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.696632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.705332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997144a-6da9-4fc2-9036-1c68266c59db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.727156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2182/4371] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:01.728421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.747591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbccb2f-20c4-458e-920c-8a698d2e0d48 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:01.775776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:01.776983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.777419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.777875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] PATH_INFO: `/v3/projects/8431477fcd064f4f8ba2dedbed85b937/users/1925c01ee4d94de9a9a2e7d5735fea14/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.799566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8431477fcd064f4f8ba2dedbed85b937, user_id=1925c01ee4d94de9a9a2e7d5735fea14, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:01.802647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:01.828869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2190/4372] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:01 2022] PUT /identity/v3/projects/8431477fcd064f4f8ba2dedbed85b937/users/1925c01ee4d94de9a9a2e7d5735fea14/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:01.833817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b012-90b5-40b0-8c4f-e2507b003498 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:01.834219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b012-90b5-40b0-8c4f-e2507b003498 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:01.834621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b012-90b5-40b0-8c4f-e2507b003498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:01.860926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-faf0b012-90b5-40b0-8c4f-e2507b003498 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:01.862475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-faf0b012-90b5-40b0-8c4f-e2507b003498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:01.950266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2183/4373] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:01.975061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:01.977405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:02.105667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97b3d7-1720-40da-bcf9-930dbe5da92c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:02.118400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:02.119088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:02.120589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:02.121063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:02.140947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:02.142909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:02.157224 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2191/4374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:03.945942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:03.946531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:03.946531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:03.998708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] MFA Rules not processed for user `1925c01ee4d94de9a9a2e7d5735fea14`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:04.000440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:04.085034 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2184/4375] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:04.089601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.107138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f0fd-d82f-4cc9-9ac6-abb8a254b2c1 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.125606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.126640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.127211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.127748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.129119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:04.131883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:04.207570 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2192/4376] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:03:04 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:03:04.210184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.224987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697666-9c5d-4e28-a7b6-8e8b6d266b6e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.422241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.422937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.423310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.423591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.424561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:04.445248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:04.486669 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2185/4377] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:03:04 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:04.487760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.527528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead146dc-46a1-4fd7-8a00-2de68d72567b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.566575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.567473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.567856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.568389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.571981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:04.574737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:04.618989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2193/4378] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:03:04.620006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.643180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ea36-871a-4b3c-98a8-79487fb639b0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.660325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.661274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.661546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.661822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] PATH_INFO: `/v3/projects/7a9369859a1c47acac58bf9d2adb9300/users/bff34dff8177407885be62e78ab66147/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.715544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9369859a1c47acac58bf9d2adb9300, user_id=bff34dff8177407885be62e78ab66147, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:04.719557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:04.755991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2186/4379] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:04 2022] PUT /identity/v3/projects/7a9369859a1c47acac58bf9d2adb9300/users/bff34dff8177407885be62e78ab66147/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:03:04.757073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.774285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e25a95-70d4-4dab-a5a9-f5ca401b9a1f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.918684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.919502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.919878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.920732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.923600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:04.926600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d3d2-800e-459c-8ce5-e2159beb762c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:04.955721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2194/4380] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:04.956958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:04.969974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eb7-19dd-47c5-9030-c800dbb3c50e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:04.988186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:04.991291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:04.991904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:04.992393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] PATH_INFO: `/v3/projects/7a9369859a1c47acac58bf9d2adb9300/users/bff34dff8177407885be62e78ab66147/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:04.996442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9369859a1c47acac58bf9d2adb9300, user_id=bff34dff8177407885be62e78ab66147, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:05.001683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e51704-8b76-42a8-b98f-99b49df3c6a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:05.020119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2187/4381] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:04 2022] PUT /identity/v3/projects/7a9369859a1c47acac58bf9d2adb9300/users/bff34dff8177407885be62e78ab66147/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:06.157166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916a0e5-d121-4efa-9b6e-eab6102e64f6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:06.158039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916a0e5-d121-4efa-9b6e-eab6102e64f6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:06.158473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916a0e5-d121-4efa-9b6e-eab6102e64f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:06.213296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5916a0e5-d121-4efa-9b6e-eab6102e64f6 None None] MFA Rules not processed for user `bff34dff8177407885be62e78ab66147`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:06.214528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5916a0e5-d121-4efa-9b6e-eab6102e64f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:06.325691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:06.326167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:06.326167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:06.347517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] MFA Rules not processed for user `eaa8ffe0235f4759bdb071a51ad51410`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:06.348884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:06.351055 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2195/4382] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:06.362526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71b2d-5a31-43bb-8a8e-b0fc58a6ab24 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:06.363116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71b2d-5a31-43bb-8a8e-b0fc58a6ab24 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:06.363670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71b2d-5a31-43bb-8a8e-b0fc58a6ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:06.383577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6ce71b2d-5a31-43bb-8a8e-b0fc58a6ab24 None None] MFA Rules not processed for user `1925c01ee4d94de9a9a2e7d5735fea14`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:06.385286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6ce71b2d-5a31-43bb-8a8e-b0fc58a6ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:06.428647 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2188/4383] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:03:06.481987 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2196/4384] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:06.535903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:06.537483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:06.625541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7512d-2eb3-48aa-8a72-04f84c00723c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:06.633074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:06.633957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:06.634395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:06.634834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:06.646781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:06.648362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:06.659788 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2189/4385] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:12.950724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aae94-e86a-4505-92a9-81dc90800d08 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:12.951194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aae94-e86a-4505-92a9-81dc90800d08 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:12.951194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aae94-e86a-4505-92a9-81dc90800d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:12.970963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-416aae94-e86a-4505-92a9-81dc90800d08 None None] MFA Rules not processed for user `f15cc4e52d554c3e9ab441d22453fffd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:12.972245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-416aae94-e86a-4505-92a9-81dc90800d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:13.045116 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2197/4386] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:17.223822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:17.225296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:17.241782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04976288-3d3f-4d51-9f22-2159c9681041 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:17.247348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:17.248000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:17.248288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:17.248606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:17.250400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:17.307992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:17.309675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:17.319390 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2190/4387] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:18.961740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee55c9-69f0-4c43-9e7d-91dab762754a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:18.962238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee55c9-69f0-4c43-9e7d-91dab762754a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:18.962316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee55c9-69f0-4c43-9e7d-91dab762754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:18.987425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2fee55c9-69f0-4c43-9e7d-91dab762754a None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:18.989113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2fee55c9-69f0-4c43-9e7d-91dab762754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:19.076527 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2198/4388] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:19.104098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:19.106118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:19.191659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f102d-265e-4c1f-8fb8-8a23d9c0c2ad service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:19.197044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:19.197696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:19.197986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:19.198266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:19.207160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:19.209122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:19.218394 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2191/4389] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:24.561921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4621-bf06-4bc7-88ff-23fdd8f9cab6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:24.562927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4621-bf06-4bc7-88ff-23fdd8f9cab6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:24.563490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c4621-bf06-4bc7-88ff-23fdd8f9cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:24.586891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b61c4621-bf06-4bc7-88ff-23fdd8f9cab6 None None] MFA Rules not processed for user `449253ed73e04f47bcd09c3a1cca6e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:24.588509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b61c4621-bf06-4bc7-88ff-23fdd8f9cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:24.598899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2199/4390] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:33.120566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:33.136568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f50d6-8926-4d31-adf2-729b9b7435a4 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:33.143757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:33.144759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:33.152938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:33.152938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:33.154687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:33.156857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:33.172653 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2192/4391] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:36.676134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce95a-510e-46ad-9466-a37c0c1a9835 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:36.676732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce95a-510e-46ad-9466-a37c0c1a9835 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:36.676732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce95a-510e-46ad-9466-a37c0c1a9835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:36.700689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d27ce95a-510e-46ad-9466-a37c0c1a9835 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:36.701973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d27ce95a-510e-46ad-9466-a37c0c1a9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:36.710900 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2200/4392] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:36.724259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:36.738833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1e33-fc12-4de3-8f64-1b7ff6002846 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:36.744284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:36.745264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:36.745555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:36.745829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:36.754801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:36.756940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:36.766467 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2193/4393] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:37.093428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3a0-321a-434e-b56f-208edb6959d2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:37.093722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3a0-321a-434e-b56f-208edb6959d2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:37.093998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3a0-321a-434e-b56f-208edb6959d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:37.112644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cd23f3a0-321a-434e-b56f-208edb6959d2 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:37.113841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cd23f3a0-321a-434e-b56f-208edb6959d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:37.121174 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2201/4394] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:37.133358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:37.146122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c5be-7f9d-4364-adf3-08d3412455f2 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:37.151514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:37.152161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:37.152475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:37.152758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:37.162019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:37.163674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:37.172041 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2194/4395] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:37.610586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:37.610882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:37.611160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:37.631750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:37.633006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:37.642253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2202/4396] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:37.658330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:37.670504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67b2ea-4f01-42ff-9d37-6480ba265ab9 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:37.677783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:37.678419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:37.678668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:37.678982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:37.688431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:37.690195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:37.699536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2195/4397] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:03:44.890793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:44.964800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d729fa-31f4-4b9a-9f30-694bb6f34b9a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:44.970281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:44.971236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:44.971528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:44.971835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] PATH_INFO: `/v3/users/1925c01ee4d94de9a9a2e7d5735fea14` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:44.973193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1925c01ee4d94de9a9a2e7d5735fea14)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:44.975153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:45.023319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1925c01ee4d94de9a9a2e7d5735fea14'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.030265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1925c01ee4d94de9a9a2e7d5735fea14'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.030962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1925c01ee4d94de9a9a2e7d5735fea14'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.031628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1925c01ee4d94de9a9a2e7d5735fea14'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.039245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1925c01ee4d94de9a9a2e7d5735fea14'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.056440 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2203/4398] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:03:44 2022] DELETE /identity/v3/users/1925c01ee4d94de9a9a2e7d5735fea14 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:03:45.247405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:45.263734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af213a7d-f540-4e96-b43c-2b9668fb4167 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:45.329918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:45.330845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:45.331198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:45.331736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] PATH_INFO: `/v3/projects/8431477fcd064f4f8ba2dedbed85b937` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:45.333160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8431477fcd064f4f8ba2dedbed85b937)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:45.335299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:45.383324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8431477fcd064f4f8ba2dedbed85b937', 'request_id': 'req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.390123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8431477fcd064f4f8ba2dedbed85b937', 'request_id': 'req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.396037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8431477fcd064f4f8ba2dedbed85b937', 'request_id': 'req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.409808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] The token cache is being invalidate because project 8431477fcd064f4f8ba2dedbed85b937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:03:45.410098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.410739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd94e2d-0579-4fde-bb4e-fedfd87be05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.412594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2196/4399] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:45 2022] DELETE /identity/v3/projects/8431477fcd064f4f8ba2dedbed85b937 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:45.416413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:45.417976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:45.432873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c0fa9-c0f1-4d14-9d5c-3b153321ce59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:45.499621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:45.500592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:45.500823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:45.501103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] PATH_INFO: `/v3/users/bff34dff8177407885be62e78ab66147` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:45.502509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff34dff8177407885be62e78ab66147)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:45.504778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:45.533730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921f0c-df62-4133-b3e9-a867db182f23 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:45.533910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921f0c-df62-4133-b3e9-a867db182f23 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:45.534182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f921f0c-df62-4133-b3e9-a867db182f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:45.564784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5f921f0c-df62-4133-b3e9-a867db182f23 None None] MFA Rules not processed for user `3dfe516204634bdd902f2e1236d7a6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:45.566161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f921f0c-df62-4133-b3e9-a867db182f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:45.572120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff34dff8177407885be62e78ab66147'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.581127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff34dff8177407885be62e78ab66147'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.581845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff34dff8177407885be62e78ab66147'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.582714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff34dff8177407885be62e78ab66147'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.594061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff34dff8177407885be62e78ab66147'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:45.617425 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2204/4400] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:03:45 2022] DELETE /identity/v3/users/bff34dff8177407885be62e78ab66147 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:45.649832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2197/4401] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:45.908592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:45.910675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:45.992909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107341a-0896-429a-a654-7253c12ed4cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:45.998819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:45.999897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.000336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.001050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] PATH_INFO: `/v3/projects/7a9369859a1c47acac58bf9d2adb9300` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.002540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9369859a1c47acac58bf9d2adb9300)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.004836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.080070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9369859a1c47acac58bf9d2adb9300', 'request_id': 'req-1e85b35d-94c1-4d38-a1d4-cf849f261442'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:46.089522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9369859a1c47acac58bf9d2adb9300', 'request_id': 'req-1e85b35d-94c1-4d38-a1d4-cf849f261442'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:46.103103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9369859a1c47acac58bf9d2adb9300', 'request_id': 'req-1e85b35d-94c1-4d38-a1d4-cf849f261442'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:46.118462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] The token cache is being invalidate because project 7a9369859a1c47acac58bf9d2adb9300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:03:46.118758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:46.119600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1e85b35d-94c1-4d38-a1d4-cf849f261442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:46.125080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2205/4402] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:45 2022] DELETE /identity/v3/projects/7a9369859a1c47acac58bf9d2adb9300 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:46.127211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.127648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.128163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.166011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:46.168314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:46.275352 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2198/4403] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:46.277464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.278032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.278556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.307519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:46.309571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:46.330189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2206/4404] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:46.333496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.364300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1b8b5-2f39-431c-827c-b2ac102df4ba None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.370208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.371499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.372002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.372641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.374098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:03:46.374567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.376899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.406640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2199/4405] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:03:46.411053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.426836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c16ebe-0d03-421d-bc6f-3465474039c9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.433491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.434173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.434459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.434740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.435499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.437568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.499377 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2207/4406] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:03:46 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:46.503587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.532438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36529c6-3304-4a3d-b338-d6e64cdb2f16 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.630900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.631605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.631888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.632342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.633336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.635796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.665266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2200/4407] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:03:46 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:46.668811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.681568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432b0df-bb3d-4166-bc82-f1fdded91cc2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.688925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.690071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.690462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.690730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.691539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.693872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.706800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2208/4408] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:46.710882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.721579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba72ff-e57b-4890-9891-016113396631 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.726562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.727227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.727509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.727793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.728680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.730265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a526c27-6c89-4969-86c3-0564842fb449 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.741279 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2201/4409] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:03:46.745576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.757057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf5d1-db96-4816-91ed-bdecadc427c0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:46.763570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:46.765419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.765790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.766174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] PATH_INFO: `/v3/projects/b029d956221d4ab68b05371a35786d8a/users/a39c6f3190b54b30a27b8108a2a5d3db/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.783879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b029d956221d4ab68b05371a35786d8a, user_id=a39c6f3190b54b30a27b8108a2a5d3db, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:46.786641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:46.800735 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2209/4410] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:46 2022] PUT /identity/v3/projects/b029d956221d4ab68b05371a35786d8a/users/a39c6f3190b54b30a27b8108a2a5d3db/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:03:46.805952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2e57-2d62-4668-8e94-391a5110659d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:46.806238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2e57-2d62-4668-8e94-391a5110659d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:46.806521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed2e57-2d62-4668-8e94-391a5110659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:46.827949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9aed2e57-2d62-4668-8e94-391a5110659d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:46.829195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9aed2e57-2d62-4668-8e94-391a5110659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:46.910826 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2202/4411] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:46.922649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:46.926751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:47.003203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f27a-58f0-4e04-9da0-be7dee479883 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:47.007603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:47.008261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:47.008699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:47.008981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:47.020307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:47.022393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:47.034415 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2210/4412] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:47.186801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397067-288b-4d0b-b567-a168e093f08b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:47.187117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397067-288b-4d0b-b567-a168e093f08b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:47.187685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397067-288b-4d0b-b567-a168e093f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:47.250884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-14397067-288b-4d0b-b567-a168e093f08b None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:47.252126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14397067-288b-4d0b-b567-a168e093f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:47.322830 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2203/4413] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:47.336123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:47.337637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:47.477965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9182b6-e4fa-4516-811f-276458d9a257 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:47.491132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:47.492212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:47.493405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:47.494296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:47.511848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:47.514984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:47.542567 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2211/4414] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:47.824379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283c38-5ab5-43ce-941b-523c892eb7bb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:47.824746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283c38-5ab5-43ce-941b-523c892eb7bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:47.825189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283c38-5ab5-43ce-941b-523c892eb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:47.846454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d1283c38-5ab5-43ce-941b-523c892eb7bb None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:47.848687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1283c38-5ab5-43ce-941b-523c892eb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:47.862909 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2204/4415] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:47.873188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:47.889568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de550-0170-4431-9cfd-954afd7d184e service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:47.895436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:47.896097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:47.896625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:47.896938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:47.909747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:47.911920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:47.922700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2212/4416] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:48.146796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:48.147880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:48.148569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:48.190299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:48.191869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:48.203947 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2205/4417] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:48.221758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:48.237432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed38e2b-1c1f-4bf8-a89f-be5f25b43f86 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:48.243771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:48.244794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:48.245280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:48.245566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:48.257670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:48.260568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c175871-c8cb-40f2-b3a3-cd9a0c89e9e2 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:48.274949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2213/4418] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:48.438299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:48.440343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:48.476224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafbf07-3a46-4094-98bb-c5788ad73867 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:48.482996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:48.483984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:48.485079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:48.485788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] PATH_INFO: `/v3/users/4e687099ccfe4d6fbeca88231424699a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:48.488841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e687099ccfe4d6fbeca88231424699a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:48.491130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:48.566644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e687099ccfe4d6fbeca88231424699a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:48.581223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e687099ccfe4d6fbeca88231424699a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:48.583389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e687099ccfe4d6fbeca88231424699a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:48.594824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e687099ccfe4d6fbeca88231424699a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:48.606654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e687099ccfe4d6fbeca88231424699a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:48.616686 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2206/4419] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:03:48 2022] DELETE /identity/v3/users/4e687099ccfe4d6fbeca88231424699a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:48.621725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:48.622254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:48.622692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:48.654996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:48.656761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:48.783805 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2214/4420] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:48.801484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:48.803268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:48.894341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f45a-3103-4cd3-859c-c300f63a8d6c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:48.902254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:48.903448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:48.904803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:48.905787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:48.917844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:48.920707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8edfa-bc26-494a-82cb-e4ecf8de4681 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:48.940634 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2207/4421] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:03:49.480272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:49.482050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:49.505978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e46c6-fa1c-4861-8a69-4d320c8a7e49 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:49.520306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:49.522444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:49.523071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:49.523477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] PATH_INFO: `/v3/projects/434a8950c15b4a96a46ed0f64c87c417` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:49.526762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=434a8950c15b4a96a46ed0f64c87c417)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:49.530614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:49.631343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434a8950c15b4a96a46ed0f64c87c417', 'request_id': 'req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:49.641239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434a8950c15b4a96a46ed0f64c87c417', 'request_id': 'req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:49.653156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434a8950c15b4a96a46ed0f64c87c417', 'request_id': 'req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:49.670253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] The token cache is being invalidate because project 434a8950c15b4a96a46ed0f64c87c417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:03:49.670540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:49.671685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6cbb36ba-2efd-41f0-96fd-2c236b55e10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:49.673606 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2215/4422] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:49 2022] DELETE /identity/v3/projects/434a8950c15b4a96a46ed0f64c87c417 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:49.678782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:49.679713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:49.680146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:49.704153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:49.706522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:49.783396 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2208/4423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:49.794319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:49.795820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:49.798177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:49.832080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:49.834041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:49.845690 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2216/4424] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:49.850846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:49.869400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aafa63-f4b4-4fbd-9849-1e9ec1b68e32 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:49.875352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:49.876044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:49.876314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:49.876779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:49.877659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:03:49.878141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:49.879768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:49.897670 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2209/4425] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:03:49.912011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:49.943835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7912-c978-4862-9323-0bbe5906b64e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:49.952268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:49.953395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:49.953884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:49.954367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:49.955290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:49.961167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.021373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2217/4426] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:03:49 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:50.025987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:50.042737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72303c5f-7477-420d-8bb9-434236525155 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:50.196599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:50.198414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.199118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.199281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.201244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:50.206755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.261368 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2210/4427] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:03:50 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:03:50.262655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:50.285638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c71f-b800-42a5-b8a9-88fa284f4fda admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:50.302300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:50.303236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.303526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.304624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.305690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:50.310635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.336991 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2218/4428] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:50.342498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:50.359707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcae7-c4b4-4ee4-a636-3671c62b8212 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:50.366054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:50.367840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.369428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.369881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.371908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:50.374299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c24e00-b933-4a0c-9680-0f3c33be93d0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.388309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2211/4429] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:50.392842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:50.408123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f70acb-a6e2-49bb-84d9-dd79141178d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:50.413363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:50.414873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.415342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.415594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] PATH_INFO: `/v3/projects/63052419b46d46e8840aa2332ba5a904/users/ecb3c50cddf7417aac019b9e31df8dc8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.439353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63052419b46d46e8840aa2332ba5a904, user_id=ecb3c50cddf7417aac019b9e31df8dc8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:50.442642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.476694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2219/4430] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:50 2022] PUT /identity/v3/projects/63052419b46d46e8840aa2332ba5a904/users/ecb3c50cddf7417aac019b9e31df8dc8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:50.483373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.484414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.484802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.527487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] MFA Rules not processed for user `ecb3c50cddf7417aac019b9e31df8dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:50.530398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:50.647236 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2212/4431] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:50.671417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:50.675017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:50.820746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4249ac-c878-4d34-a3e2-5bed91148ab1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:50.827592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:50.828436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:50.828744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:50.829030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:50.838458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:50.840534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012be4-8fcf-4144-bc9b-20ecfb36a30a service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:50.863350 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2220/4432] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:50.912184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:51.042178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee22421-94d1-4b57-b29d-572cfee9aeb3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:51.055138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:51.056089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:51.056422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:51.056739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] PATH_INFO: `/v3/users/ecb3c50cddf7417aac019b9e31df8dc8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:51.058082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb3c50cddf7417aac019b9e31df8dc8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:51.060034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:51.143942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb3c50cddf7417aac019b9e31df8dc8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:51.174973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb3c50cddf7417aac019b9e31df8dc8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:51.176226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb3c50cddf7417aac019b9e31df8dc8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:51.195555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb3c50cddf7417aac019b9e31df8dc8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:51.215835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb3c50cddf7417aac019b9e31df8dc8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:51.227235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2213/4433] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:03:50 2022] DELETE /identity/v3/users/ecb3c50cddf7417aac019b9e31df8dc8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:51.231918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:51.233090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:51.233354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:51.257437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:51.259222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:51.344675 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2221/4434] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:51.356418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:51.358939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:51.448931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bb6a7-d5fe-4ef6-ad0c-447fa6a67946 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:51.455969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:51.457244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:51.457664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:51.458543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:51.471796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:51.473894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e158830-fe73-42c0-b36a-67b3256fec56 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:51.492985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2214/4435] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:52.075629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.078783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:52.096849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f343c-36d7-4947-8ae0-b0cff3f2cf05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.104654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.105986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.106171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.108417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] PATH_INFO: `/v3/projects/63052419b46d46e8840aa2332ba5a904` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.110103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=63052419b46d46e8840aa2332ba5a904)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.112337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.218948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63052419b46d46e8840aa2332ba5a904', 'request_id': 'req-d2825571-1cbf-42ae-9183-d4214e33df5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:52.230720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63052419b46d46e8840aa2332ba5a904', 'request_id': 'req-d2825571-1cbf-42ae-9183-d4214e33df5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:52.247631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63052419b46d46e8840aa2332ba5a904', 'request_id': 'req-d2825571-1cbf-42ae-9183-d4214e33df5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:52.263292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] The token cache is being invalidate because project 63052419b46d46e8840aa2332ba5a904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:03:52.263918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:52.264768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d2825571-1cbf-42ae-9183-d4214e33df5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:52.267308 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2222/4436] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:52 2022] DELETE /identity/v3/projects/63052419b46d46e8840aa2332ba5a904 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:52.273498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.273990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.274523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.301537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:52.302987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:52.406526 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2215/4437] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:52.414805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.415517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.416080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.455849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:52.459968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:52.471774 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2223/4438] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:52.476514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.489889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17275e-0299-484a-bf60-5771ba7d867a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.495816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.496727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.497340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.497785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.498700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:03:52.499153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.501072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.514247 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2216/4439] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:03:52.518500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.528657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3cea3-c71c-4857-8cea-c7c1e087eb81 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.533957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.534618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.534900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.535189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.535866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.537933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.565920 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2224/4440] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:03:52 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:03:52.570792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.585551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028a23-0c6b-45ef-b552-ea778cd7d54b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.658658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.659345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.659896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.660363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.661412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.663708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.695631 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2217/4441] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:03:52 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:03:52.699878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.716329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fcb31-b2f3-4f52-966b-5948fdd71526 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.722782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.723824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.724326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.725018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.725837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.727721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.742651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2225/4442] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:03:52.746661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.758721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce7d3-7e05-45a9-9caa-ce9d60322cac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.763812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.764551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.764992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.765460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.766904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.768742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b62b-bdc5-4e93-8904-3888b49871f1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.779140 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2218/4443] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:03:52.783918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:52.798513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f983487-6c13-426f-83db-8d22482137c5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:52.804273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:52.805332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.805729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.806113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] PATH_INFO: `/v3/projects/6ae16de34fd342cda85aa2bd981452c4/users/437b151556e04bdfa22a80b72f34c088/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.825613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae16de34fd342cda85aa2bd981452c4, user_id=437b151556e04bdfa22a80b72f34c088, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:52.828448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:52.848321 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2226/4444] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:03:52 2022] PUT /identity/v3/projects/6ae16de34fd342cda85aa2bd981452c4/users/437b151556e04bdfa22a80b72f34c088/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:03:52.853692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99422d6-ea6e-4fa1-8844-18b726df9cf9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:52.854061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99422d6-ea6e-4fa1-8844-18b726df9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:52.854943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99422d6-ea6e-4fa1-8844-18b726df9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:52.882012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e99422d6-ea6e-4fa1-8844-18b726df9cf9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:52.883272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e99422d6-ea6e-4fa1-8844-18b726df9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:53.008233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2219/4445] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:53.022970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:53.025322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:53.195291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2646e-bb50-43d7-ac5a-01e8a100a6fe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:53.201601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:53.203225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:53.203702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:53.204131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:53.222043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:53.223831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:53.235500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2227/4446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:53.316881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:53.317502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:53.317502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:53.375200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] MFA Rules not processed for user `a39c6f3190b54b30a27b8108a2a5d3db`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:03:53.376945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:53.498415 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2220/4447] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:03:53.505654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:53.507364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:53.652813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1cfb2-b51e-4873-a0f7-d49ec8c6de83 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:53.666637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:53.667885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:53.668257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:53.668579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:53.679849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:53.681925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:53.707897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2228/4448] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:03:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:03:59.602816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:03:59.604605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:03:59.637124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab145845-7361-4ea7-8cfc-83d7ed299492 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:03:59.649422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:03:59.650355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:03:59.650649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:03:59.650977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] PATH_INFO: `/v3/users/a39c6f3190b54b30a27b8108a2a5d3db` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:03:59.653311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39c6f3190b54b30a27b8108a2a5d3db)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:03:59.656064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:03:59.760983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39c6f3190b54b30a27b8108a2a5d3db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:59.776604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39c6f3190b54b30a27b8108a2a5d3db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:59.777597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39c6f3190b54b30a27b8108a2a5d3db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:59.788818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39c6f3190b54b30a27b8108a2a5d3db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:59.800653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cf498779-70f6-4a8b-9041-9a95d2621c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39c6f3190b54b30a27b8108a2a5d3db'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:03:59.811281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2221/4449] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:03:59 2022] DELETE /identity/v3/users/a39c6f3190b54b30a27b8108a2a5d3db => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:00.070953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.083417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e88c61-a612-4a72-8e92-78aa8e193867 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.182235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.183416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.183961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.184489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] PATH_INFO: `/v3/projects/b029d956221d4ab68b05371a35786d8a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.187170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b029d956221d4ab68b05371a35786d8a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.189700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.265511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b029d956221d4ab68b05371a35786d8a', 'request_id': 'req-e531e5c4-c1a4-4622-bd95-646cd1dade7b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:00.283087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b029d956221d4ab68b05371a35786d8a', 'request_id': 'req-e531e5c4-c1a4-4622-bd95-646cd1dade7b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:00.294763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b029d956221d4ab68b05371a35786d8a', 'request_id': 'req-e531e5c4-c1a4-4622-bd95-646cd1dade7b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:00.330875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] The token cache is being invalidate because project b029d956221d4ab68b05371a35786d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:00.332879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:00.335409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e531e5c4-c1a4-4622-bd95-646cd1dade7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:00.338528 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2229/4450] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:00 2022] DELETE /identity/v3/projects/b029d956221d4ab68b05371a35786d8a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:00.343901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.344275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.344664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.373732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:00.374965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:00.470394 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2222/4451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:00.479425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e934-ef78-43e3-a69c-3d3ef9134857 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.479718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e934-ef78-43e3-a69c-3d3ef9134857 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.480001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e934-ef78-43e3-a69c-3d3ef9134857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.503800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e847e934-ef78-43e3-a69c-3d3ef9134857 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:00.505939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e847e934-ef78-43e3-a69c-3d3ef9134857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:00.519147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2230/4452] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:00.521300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.537401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639b3e-5222-4538-a2a3-dc40c280d438 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.547414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.558527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.559449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.559849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.560950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.561309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.561465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:04:00.561715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.561827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.563719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.587632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2223/4453] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:00.592233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.604092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdd58-f59b-4ab0-a562-e11c160f930a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.611713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] MFA Rules not processed for user `437b151556e04bdfa22a80b72f34c088`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:00.612962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.613111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:00.613933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.614303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.614714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.615877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.618054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.655457 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2224/4454] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:00 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:00.661239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.714985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2231/4455] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:00.728050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.730088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:00.763251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc8952-4ac5-4c67-b740-f49fbe5f58e9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.770080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.770792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.771171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.771593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.772443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.774797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.807360 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2225/4456] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:00 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:00.808360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.820446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bc31b-0a97-417c-9a53-5942007f954c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.824995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80384f-9a7c-444d-9738-ab6eceab4bbf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.830507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.831224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.831681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.832159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.833417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.835021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.859999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2226/4457] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:00.864556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.893270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e649-68b9-400e-9345-cbd32449d6b2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.903718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.905365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.905655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.905942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.906852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.908731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:00.918141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.918915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.919280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.920333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.926362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2227/4458] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:00.930693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:00.945752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d2108-ba97-4d67-9fbc-528d063814d7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:00.953036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:00.954875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:00.955340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:00.955891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] PATH_INFO: `/v3/projects/a5aab95c86ad418185090595372fd48c/users/b3fba445dba44b79a1e912e2cf10c905/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:00.977142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5aab95c86ad418185090595372fd48c, user_id=b3fba445dba44b79a1e912e2cf10c905, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:00.981807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98043067-7c65-4e0b-83aa-561aa884f013 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:01.004406 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2228/4459] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:00 2022] PUT /identity/v3/projects/a5aab95c86ad418185090595372fd48c/users/b3fba445dba44b79a1e912e2cf10c905/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:01.009455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bd59-1eb7-4f88-8308-121e58c06ac5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:01.009746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bd59-1eb7-4f88-8308-121e58c06ac5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:01.010028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382bd59-1eb7-4f88-8308-121e58c06ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:01.021052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:01.022547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:01.031374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3382bd59-1eb7-4f88-8308-121e58c06ac5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:01.032839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3382bd59-1eb7-4f88-8308-121e58c06ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:01.035934 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2232/4460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:04:01.114090 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2229/4461] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:01.123676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:01.125665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:01.142413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7c71d-81d3-4d4b-b013-144b42bb02bc service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:01.229865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:01.235952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:01.235952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:01.235952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:01.273776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:01.275278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b072a3-360f-49bc-ae31-42b8ce417228 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:01.287628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2233/4462] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:04.149689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:04.150238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:04.150238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:04.201714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] MFA Rules not processed for user `437b151556e04bdfa22a80b72f34c088`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:04.202995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:04.363196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2230/4463] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:10.325073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:10.326563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:10.327069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:10.390281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] MFA Rules not processed for user `b3fba445dba44b79a1e912e2cf10c905`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:10.391712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:10.604142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:10.605817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:10.607943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2234/4464] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:10.619395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:10.621191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:10.638902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e7cb6-2fbe-4e2c-bc5a-86a58932404c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:10.653216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:10.654141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:10.654730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:10.655020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] PATH_INFO: `/v3/users/3dfe516204634bdd902f2e1236d7a6ec` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:10.656361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfe516204634bdd902f2e1236d7a6ec)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:10.658337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:10.759570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfe516204634bdd902f2e1236d7a6ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:10.775173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfe516204634bdd902f2e1236d7a6ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:10.776300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfe516204634bdd902f2e1236d7a6ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:10.778134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc963ab-9073-49ef-93f0-0cb60058897b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:10.785754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:10.786693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:10.787166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:10.787623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:10.787732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfe516204634bdd902f2e1236d7a6ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:10.789984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:10.799652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfe516204634bdd902f2e1236d7a6ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:10.808014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2231/4465] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:10 2022] DELETE /identity/v3/users/3dfe516204634bdd902f2e1236d7a6ec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:10.820941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:10.837381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684acdcf-cfad-427b-83ec-f9b31bce2705 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:10.849325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2235/4466] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:04:11.373394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:11.375892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:11.505670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670231c-ee5f-48b7-bf67-ab144089d95b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:11.511763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:11.513125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:11.513414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:11.513693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] PATH_INFO: `/v3/projects/67592663633d4cd89aed8f728fd7ca86` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:11.514939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67592663633d4cd89aed8f728fd7ca86)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:11.517730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:11.582743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67592663633d4cd89aed8f728fd7ca86', 'request_id': 'req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:11.591690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67592663633d4cd89aed8f728fd7ca86', 'request_id': 'req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:11.600258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67592663633d4cd89aed8f728fd7ca86', 'request_id': 'req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:11.625018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] The token cache is being invalidate because project 67592663633d4cd89aed8f728fd7ca86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:11.625018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:11.625018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd1115f3-cf07-4ae0-b2c5-a5d1679e8b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:11.627500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2232/4467] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:11 2022] DELETE /identity/v3/projects/67592663633d4cd89aed8f728fd7ca86 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:11.632552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:11.633543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:11.634029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:11.687288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:11.688780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:11.810495 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2236/4468] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:11.817291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:11.817580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:11.818116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:11.852025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:11.853962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:11.864497 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2233/4469] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:11.868912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:11.882240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00600fd-d3db-4bf9-b0ad-98ae723da96c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:11.887732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:11.889235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:11.889525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:11.889812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:11.890653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:04:11.891209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:11.893134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:11.908861 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2237/4470] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:11.913070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:11.925162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bac82-17b8-4091-ad1d-095734d7f2de None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:11.930581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:11.931563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:11.931996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:11.932940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:11.933853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:11.936573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:11.998200 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2234/4471] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:11 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:12.001136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:12.017880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed772c2d-887e-451e-b70e-b6deaeb17cd2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:12.124199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:12.125369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.125867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.126353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.127266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:12.129609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:12.164899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2238/4472] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:12 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:12.167008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:12.180238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee256-8df7-4be9-bf74-f3171d51c195 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:12.190899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:12.191996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.192590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.193359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.194481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:12.198635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:12.224509 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2235/4473] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:12.225885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:12.251068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488017-0df8-4c2f-838e-2e3248dc18e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:12.257793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:12.260130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.260673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.261117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.262173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:12.266343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667bf5c-f094-4198-b8b1-90bccfcdc38c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:12.291718 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2239/4474] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:04:12.296839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:12.310848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41756-f9ca-4459-b19a-ddfa948fe276 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:12.318275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:12.319364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.319864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.320237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] PATH_INFO: `/v3/projects/7f1a5e5adf8141058ce50ee9295e57cc/users/5331b96019b4418a8aa6a1facd9e1c06/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.339397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1a5e5adf8141058ce50ee9295e57cc, user_id=5331b96019b4418a8aa6a1facd9e1c06, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:12.343293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:12.380947 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2236/4475] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:12 2022] PUT /identity/v3/projects/7f1a5e5adf8141058ce50ee9295e57cc/users/5331b96019b4418a8aa6a1facd9e1c06/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:12.382176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb87f7-392d-40c4-a288-730d4be9c05b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.382476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb87f7-392d-40c4-a288-730d4be9c05b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.382992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb87f7-392d-40c4-a288-730d4be9c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.422940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-04bb87f7-392d-40c4-a288-730d4be9c05b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:12.424855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-04bb87f7-392d-40c4-a288-730d4be9c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:12.513579 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2240/4476] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:12.530062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:12.532099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:12.621754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbc11a-ab3f-4114-b811-2a7f5f7c0990 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:12.627217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:12.628029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:12.628321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:12.628634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:12.639744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:12.641308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddc341-d78b-46bd-9fc5-1751d2e4cd05 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:12.654688 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2237/4477] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:14.362045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:14.362553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:14.363058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:14.450576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] MFA Rules not processed for user `5331b96019b4418a8aa6a1facd9e1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:14.451898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:14.612826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2241/4478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:14.623540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158557-8631-4b76-9c72-916705a677cc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:14.624338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158557-8631-4b76-9c72-916705a677cc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:14.624794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158557-8631-4b76-9c72-916705a677cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:14.648443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70158557-8631-4b76-9c72-916705a677cc None None] MFA Rules not processed for user `5331b96019b4418a8aa6a1facd9e1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:14.650155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70158557-8631-4b76-9c72-916705a677cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:14.664896 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2238/4479] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:14.671288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:14.673054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:14.920178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38a85-4c5c-4a74-b69b-c3d4ea397330 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:14.947818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:14.953623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:14.954152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:14.956749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:14.979698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:14.982119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:14.998607 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2242/4480] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:16.428270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:16.428851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:16.428978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:16.487961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] MFA Rules not processed for user `b3fba445dba44b79a1e912e2cf10c905`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:16.489794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:16.734552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2239/4481] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:28.224752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:28.230297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:28.268799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56b438-7191-4d7a-8193-bd7edfc981d7 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:28.273606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:28.274718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:28.275714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:28.276077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] PATH_INFO: `/v3/users/f15cc4e52d554c3e9ab441d22453fffd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:28.281707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15cc4e52d554c3e9ab441d22453fffd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:28.284404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:28.312417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:28.315157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:28.332474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651dc6-c04b-40c7-9c6c-74dbf69996d1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:28.338564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:28.339690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:28.340272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:28.341644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] PATH_INFO: `/v3/users/5bf97b33a7644fd9b2c92af3138f040c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:28.342953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf97b33a7644fd9b2c92af3138f040c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:28.344960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:28.355238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15cc4e52d554c3e9ab441d22453fffd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.369831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15cc4e52d554c3e9ab441d22453fffd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.370489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15cc4e52d554c3e9ab441d22453fffd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.371210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15cc4e52d554c3e9ab441d22453fffd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.379245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15cc4e52d554c3e9ab441d22453fffd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.393988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf97b33a7644fd9b2c92af3138f040c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.396962 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2243/4482] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:28 2022] DELETE /identity/v3/users/f15cc4e52d554c3e9ab441d22453fffd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:28.406551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf97b33a7644fd9b2c92af3138f040c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.407518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf97b33a7644fd9b2c92af3138f040c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.415695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf97b33a7644fd9b2c92af3138f040c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.425876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf97b33a7644fd9b2c92af3138f040c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.433112 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2240/4483] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:28 2022] DELETE /identity/v3/users/5bf97b33a7644fd9b2c92af3138f040c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:28.653418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:28.655278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:28.737146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:28.738807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:28.770402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45b44-9333-4fdc-a098-7f7b7e22342b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:28.861980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:28.863026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:28.863413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:28.863849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] PATH_INFO: `/v3/projects/cf913c65b2ee4d168f38d2ffd7f02585` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:28.865342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf913c65b2ee4d168f38d2ffd7f02585)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:28.867537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:28.873187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ed96-e961-466e-a160-8679797ae0f3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:28.880121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:28.881618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:28.882362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:28.882809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] PATH_INFO: `/v3/projects/ff8ea67a27f74237963a177abd07cc45` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:28.884410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8ea67a27f74237963a177abd07cc45)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:28.887378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:28.965061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf913c65b2ee4d168f38d2ffd7f02585', 'request_id': 'req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.972729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf913c65b2ee4d168f38d2ffd7f02585', 'request_id': 'req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.987519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf913c65b2ee4d168f38d2ffd7f02585', 'request_id': 'req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:28.993874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8ea67a27f74237963a177abd07cc45', 'request_id': 'req-62565e70-3d0d-4901-8f94-6b8058dbe365'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.004538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8ea67a27f74237963a177abd07cc45', 'request_id': 'req-62565e70-3d0d-4901-8f94-6b8058dbe365'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.012050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8ea67a27f74237963a177abd07cc45', 'request_id': 'req-62565e70-3d0d-4901-8f94-6b8058dbe365'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.012258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] The token cache is being invalidate because project cf913c65b2ee4d168f38d2ffd7f02585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:29.013138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.014714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ece220-20fa-4ce3-b912-2ae437ef4ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.018818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2244/4484] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:28 2022] DELETE /identity/v3/projects/cf913c65b2ee4d168f38d2ffd7f02585 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:29.030682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52406e4-4756-4285-b75c-fff9de26f315 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.032114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52406e4-4756-4285-b75c-fff9de26f315 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.032488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52406e4-4756-4285-b75c-fff9de26f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.050145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] The token cache is being invalidate because project ff8ea67a27f74237963a177abd07cc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:29.050484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.051336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62565e70-3d0d-4901-8f94-6b8058dbe365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:29.057638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2241/4485] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:28 2022] DELETE /identity/v3/projects/ff8ea67a27f74237963a177abd07cc45 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:29.059309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443064-eda0-49ac-aa0f-fa65b3a1ff13 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.060343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443064-eda0-49ac-aa0f-fa65b3a1ff13 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.060811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443064-eda0-49ac-aa0f-fa65b3a1ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.073337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e52406e4-4756-4285-b75c-fff9de26f315 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.074634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e52406e4-4756-4285-b75c-fff9de26f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.093532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-74443064-eda0-49ac-aa0f-fa65b3a1ff13 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.095104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-74443064-eda0-49ac-aa0f-fa65b3a1ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.184060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2245/4486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:29.195125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.196704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.197068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.214622 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2242/4487] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:29.224171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.224500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.224804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.233409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.236143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.248827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2246/4488] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:29.251766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.253056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.256758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.266015 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2243/4489] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:29.267151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.277782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad74b4-54e3-48e8-bb16-394982c248e2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.283893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e364a3-2528-4009-9c97-c7ee281f2d04 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.290440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.292389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.293237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.293552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.294509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.294729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:04:29.295092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.295397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.295825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.296313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.296759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.297064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:04:29.297371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.298998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.312146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2247/4490] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:29.316101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2244/4491] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:29.316655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.320974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.331594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab935-a949-44c0-bdab-f7c9fbe82a31 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.333280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4280d-9af2-478f-bd07-963f591d0c51 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.336338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.337255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.337559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.337835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.338513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.339296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.340149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.340443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.340816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.340923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.344960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.348166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.382703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2248/4492] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:04:29.385955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2245/4493] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:29.386073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.386972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.453957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c36ddd-26d7-4b44-8c3f-9efe9dabd4b9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.457000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00df58-e5ab-4ba2-973c-5297de6624db admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.459060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.459743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.460029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.460308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.461039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.462149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.462821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.462964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.463110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.463391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.464072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.466051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.484136 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2249/4494] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:29.491159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.491316 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2246/4495] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:29.492176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.498877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1158-2ad0-42e0-915d-dcab6a4ed26d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.502615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88fbc1-a19a-46c2-9de5-5e9741852f9e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.503591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.504250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.504568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.504853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.505670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.507227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.507352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.507925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.508209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.508706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.509423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.510983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.517823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2250/4496] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:04:29.521682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.527950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2247/4497] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:29.532085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.534122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2beedd3-da69-4028-ab8d-a978a4dbb83d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.538801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.539463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.539874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.540163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.540984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.541851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a581fa-d5c7-470b-913d-45222b8f0301 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.542712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.546654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.547310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.547600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.547882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.548644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.550222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.553102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2251/4498] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:29.557079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.561385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2248/4499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:04:29.565324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.568230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36339e84-3917-4831-8085-43b7f2405f05 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.572998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.573868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.574154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.574434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] PATH_INFO: `/v3/projects/fad5516982b843a9a35e49795fda0844/users/ee1c48c096304c819e0eac11e84aef26/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.576813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d13e69-26ca-48b4-876e-96ddc46c4ceb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.581769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.582676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.582965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.583249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] PATH_INFO: `/v3/projects/bb31a4915e1341839e229bc3786bb4b2/users/2fed8f5059c44a8fa1a9526e81fa73e8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.589449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad5516982b843a9a35e49795fda0844, user_id=ee1c48c096304c819e0eac11e84aef26, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.592131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd58f00-6fff-4dc1-be95-37594f684180 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.598104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb31a4915e1341839e229bc3786bb4b2, user_id=2fed8f5059c44a8fa1a9526e81fa73e8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.600826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992f417-24a7-42bc-ba5a-810719078b75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.605535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2252/4500] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:29 2022] PUT /identity/v3/projects/fad5516982b843a9a35e49795fda0844/users/ee1c48c096304c819e0eac11e84aef26/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:29.611425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.611719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.612001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.615780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2249/4501] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:29 2022] PUT /identity/v3/projects/bb31a4915e1341839e229bc3786bb4b2/users/2fed8f5059c44a8fa1a9526e81fa73e8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:29.620919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.621213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.621497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.630166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.631366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.639531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:29.640927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.705252 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2250/4502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:29.708439 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2253/4503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:29.716682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.717076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.718562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.719424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.796827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7483f7-6a37-4ebc-94d6-f9424329b960 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.801483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595d4a-158d-4bad-ac75-5589e3281c0b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:29.806341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.807364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.810459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.814295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:29.814493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.814605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:29.814605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:29.814605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:29.831975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.833902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.854578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:29.856897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:29.864959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2251/4504] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:29.871162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:29.873660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:29.879063 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2254/4505] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:30.054885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506b2c8-889b-4c70-bf35-e3688f69a4ad service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:30.076144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:30.079100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:30.082119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:30.082119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:30.090201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:30.124442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:30.129217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:30.174139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2252/4506] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:36.511384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:36.514631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:36.543822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7f568-e6fb-4e3b-ae69-46267bafc603 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:36.556820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:36.557633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:36.558023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:36.558403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:36.560507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:36.599278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:36.600909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea972afb-f831-46c5-b8ab-9143a9e4abf5 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:36.643329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2255/4507] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:41.497701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:41.499902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:41.709921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b0be-0779-45e1-a98e-e72c4b5a6023 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:41.727562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:41.731855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:41.732383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:41.732964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:41.736124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:41.868857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:41.872409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:41.910736 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2253/4508] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:43.915225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87204f-0fc0-436c-b9b3-33abe6f5ebd4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:43.915657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87204f-0fc0-436c-b9b3-33abe6f5ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:43.915788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87204f-0fc0-436c-b9b3-33abe6f5ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:43.982470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dd87204f-0fc0-436c-b9b3-33abe6f5ebd4 None None] MFA Rules not processed for user `2fed8f5059c44a8fa1a9526e81fa73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:43.983991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dd87204f-0fc0-436c-b9b3-33abe6f5ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:44.094854 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2256/4509] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:44.107084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:44.120657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7be7c-9eac-477b-877f-6c4b17c7f003 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:44.126985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:44.127796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:44.128133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:44.128567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:44.139991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:44.146004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:44.172702 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2254/4510] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:44.598207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:44.598838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:44.599648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:44.683105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] MFA Rules not processed for user `ee1c48c096304c819e0eac11e84aef26`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:44.689239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:44.802540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:44.825692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e107ee-27c0-492b-89be-1844681c2922 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:44.837843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:44.838568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:44.838911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:44.839823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:44.850552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:44.878694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:44.880473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:44.905273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2255/4511] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:04:44.975647 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2257/4512] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:44.976942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:44.995278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3175ca-9d8a-44fa-a0df-266ea4f0273e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.008515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.010353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.010650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.016581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.018949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.022216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.081630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2256/4513] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:44 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:45.082832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:45.095748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43951a6-ead1-4eb9-b0d7-446e8f3cf570 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.192701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.193725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.194158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.194605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.195662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.197881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.235059 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2258/4514] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:45 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:45.235222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:45.253197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227ff3-fd67-4046-9fe9-d63de548f03e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.266479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.267502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.267787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.268067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.268840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.270434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.289242 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2257/4515] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:04:45.296412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:45.315495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a19bb-f3eb-4f46-9dbf-3efe85c5051c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.322863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.325546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.326138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.326658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] PATH_INFO: `/v3/projects/3594e07bf51f4a24bf631961d5366fd7/users/2071e721c18d4b0da78ece25fae86679/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.379158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3594e07bf51f4a24bf631961d5366fd7, user_id=2071e721c18d4b0da78ece25fae86679, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.383019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.412008 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2259/4516] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:45 2022] PUT /identity/v3/projects/3594e07bf51f4a24bf631961d5366fd7/users/2071e721c18d4b0da78ece25fae86679/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:45.413069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:45.426476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6791d5-adc7-40a8-aaf1-20a02b327087 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.569896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.571673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.572362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.573443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.574396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.576794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78ad69-c936-44f3-b598-86194ad89523 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.595286 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2258/4517] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:45.596712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:45.614131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a11480-d297-4a6f-a738-b906479eba3b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:45.630310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:45.631646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:45.632035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:45.634119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] PATH_INFO: `/v3/projects/3594e07bf51f4a24bf631961d5366fd7/users/2071e721c18d4b0da78ece25fae86679/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:45.638345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3594e07bf51f4a24bf631961d5366fd7, user_id=2071e721c18d4b0da78ece25fae86679, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:45.650332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:45.680336 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2260/4518] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:45 2022] PUT /identity/v3/projects/3594e07bf51f4a24bf631961d5366fd7/users/2071e721c18d4b0da78ece25fae86679/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:48.639756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:48.641249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:48.641882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:48.714764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] MFA Rules not processed for user `2fed8f5059c44a8fa1a9526e81fa73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:48.718528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:48.851260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2259/4519] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:53.094869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:53.098273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:53.188847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3401f7-4813-480a-9cee-01377cedc5e3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:53.194285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:53.195094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:53.195659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:53.195659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] PATH_INFO: `/v3/users/449253ed73e04f47bcd09c3a1cca6e8c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:53.197222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449253ed73e04f47bcd09c3a1cca6e8c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:53.199262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:53.267602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449253ed73e04f47bcd09c3a1cca6e8c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.279788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449253ed73e04f47bcd09c3a1cca6e8c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.280518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449253ed73e04f47bcd09c3a1cca6e8c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.281435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449253ed73e04f47bcd09c3a1cca6e8c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.290625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c7c294f-be70-4be7-833e-b1812cfe3f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449253ed73e04f47bcd09c3a1cca6e8c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.328596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2261/4520] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:53 2022] DELETE /identity/v3/users/449253ed73e04f47bcd09c3a1cca6e8c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:53.581358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:53.601495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56cac-ceb2-46f2-9cc4-8dff1a72141d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:53.722191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:53.723336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:53.723809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:53.724241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] PATH_INFO: `/v3/projects/da03d0fc36de405d87c8e99d209af9fe` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:53.726561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da03d0fc36de405d87c8e99d209af9fe)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:53.730914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:53.815429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da03d0fc36de405d87c8e99d209af9fe', 'request_id': 'req-8a0508d4-bc89-4fc7-8bde-578730fd3138'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.824089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da03d0fc36de405d87c8e99d209af9fe', 'request_id': 'req-8a0508d4-bc89-4fc7-8bde-578730fd3138'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.831109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da03d0fc36de405d87c8e99d209af9fe', 'request_id': 'req-8a0508d4-bc89-4fc7-8bde-578730fd3138'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.849855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] The token cache is being invalidate because project da03d0fc36de405d87c8e99d209af9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:53.850350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.851192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0508d4-bc89-4fc7-8bde-578730fd3138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:53.853305 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2260/4521] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:53 2022] DELETE /identity/v3/projects/da03d0fc36de405d87c8e99d209af9fe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:53.864261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:53.864831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:53.865387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:53.904781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:53.906765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:54.083633 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2262/4522] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:54.085400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.085691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.086231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.114368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:54.116033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:54.136242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.148069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2261/4523] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:04:54.151547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09603a50-a5a7-4aea-b3c3-c2d6af290ae7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.160013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.160794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.161144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.161432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.162684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:04:54.163120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.165296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.187990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.197933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2263/4524] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:54.199996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7923c4c-5a27-47ba-956a-fdcdcc7dae72 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.207040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.207726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.208008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.208285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.209822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.211813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.251129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2262/4525] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:54.256392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.274217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a25f1-d92a-49cf-8ba1-027ee6436140 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.405104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.405962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.406326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.406680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.407461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.410910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.462221 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2264/4526] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:54.466022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.479777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcb993-853b-4640-8a3f-8484748b133c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.487051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.488064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.489312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.489783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.490751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.493872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.508734 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2263/4527] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:54.513059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.532991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38013cd-19fe-49c2-803c-a48687bd4db5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.548533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.549624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.550153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.550665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.551669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.555781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f654258-093f-4e63-8840-08dc2f0e17f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.581948 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2265/4528] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:54.586166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.598588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cf853-310a-4c89-af4b-82aef6b1b373 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:54.636018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:54.636916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.637205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.637482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] PATH_INFO: `/v3/projects/5d9c6e3adc60420798a51492ca80b78b/users/7ea875d90308476191915c4f73c41501/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.682093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9c6e3adc60420798a51492ca80b78b, user_id=7ea875d90308476191915c4f73c41501, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:54.688246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9756a4-7920-4a85-ae31-eb9a6c151a34 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:54.747679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2264/4529] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:54 2022] PUT /identity/v3/projects/5d9c6e3adc60420798a51492ca80b78b/users/7ea875d90308476191915c4f73c41501/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:54.757752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.758247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.758669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.827545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] MFA Rules not processed for user `7ea875d90308476191915c4f73c41501`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:54.829046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:54.952581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:54.953340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:54.954013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:54.967265 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2266/4530] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:54.972991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:54.989939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] MFA Rules not processed for user `437b151556e04bdfa22a80b72f34c088`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:54.991314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:55.062294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac12e4-a0a2-405e-9ef5-5deeb8c514dd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.077755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.078745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.079252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.079741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.081319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.083690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.103293 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2265/4531] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:55.124540 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2267/4532] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:54 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:55.127325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.149275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa332-31a3-46b8-900f-2f194dc3d4ca None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.237448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.238702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.239059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.239417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.240324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.242384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.270791 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2266/4533] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:55 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:55.274844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.291316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f4c4d-3858-41d3-9e3b-bc5cd134bdf5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.300685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.301494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.301835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.302162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.303929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.306878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.328751 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2268/4534] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:55.332679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.345071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d5314-c4d0-46b9-b58a-7543c74bf8ac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.350792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.355524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.355736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.356078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] PATH_INFO: `/v3/projects/29e40169756c4c9b9c5083f30a5761a4/users/86b04521211949b4b8933cfd4ce6538d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.380736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e40169756c4c9b9c5083f30a5761a4, user_id=86b04521211949b4b8933cfd4ce6538d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.384001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.420854 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2267/4535] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:55 2022] PUT /identity/v3/projects/29e40169756c4c9b9c5083f30a5761a4/users/86b04521211949b4b8933cfd4ce6538d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:55.423437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.440138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597209ea-12d6-4473-95ce-7ddebf72f152 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.561535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.563058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.563424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.563715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.564479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.571086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5f1df-a11f-4113-9e61-e945f80d4082 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.604523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2269/4536] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:04:55.607280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.631979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013fa52-2d5c-4b41-9564-d4b449850dda admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.640538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.641698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.642141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.642576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] PATH_INFO: `/v3/projects/29e40169756c4c9b9c5083f30a5761a4/users/86b04521211949b4b8933cfd4ce6538d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.647271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e40169756c4c9b9c5083f30a5761a4, user_id=86b04521211949b4b8933cfd4ce6538d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.654173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.673156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2268/4537] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:55 2022] PUT /identity/v3/projects/29e40169756c4c9b9c5083f30a5761a4/users/86b04521211949b4b8933cfd4ce6538d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:55.684237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.684646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.685057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.728769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] MFA Rules not processed for user `86b04521211949b4b8933cfd4ce6538d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:55.730208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:55.829893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2270/4538] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:55.834465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.846966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1964-b2a0-4370-a7c9-a691d721e3a3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:55.852537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:55.853646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:55.854133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:55.854685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:55.856395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:55.858328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:55.904174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2269/4539] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:04:55 2022] POST /identity/v3/domains => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:55.908842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:55.923547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873525c-b648-4907-a98b-d4d75b0cfa0a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:56.016131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:56.017151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.017455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.017743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.018518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:56.020486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:56.127533 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2271/4540] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:04:55 2022] POST /identity/v3/projects => generated 409 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:56.131445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:56.159278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487274c6-2a2a-4c33-8702-b3a5ca944e3a tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:56.353178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:56.353890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.354181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.354464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.359784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:56.365338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:56.456781 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2270/4541] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:04:56 2022] POST /identity/v3/users => generated 348 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:04:56.457352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:56.474378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f7476-c32d-4828-a6a1-c9f18fbeb04b tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:56.485311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:56.489315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.489796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.489908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.499591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:56.506080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a95804-f87e-4d26-b4c0-4c56e1a0f96c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:56.554520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:56.560839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2272/4542] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:04:56.567490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35258a-fde1-4f1b-b2b8-504fbbe6ae61 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:56.581899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:56.582877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.583164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.583443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/projects/472ae11f37b943688fa543188442146a/users/c73e8cad2bb54b9cb1a0c91490e3f35a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.634114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:create_grant(project_id=472ae11f37b943688fa543188442146a, user_id=c73e8cad2bb54b9cb1a0c91490e3f35a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:56.637371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53c05b-8fc0-4758-a9bf-68772f50c0a3 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:56.665806 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2271/4543] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:04:56 2022] PUT /identity/v3/projects/472ae11f37b943688fa543188442146a/users/c73e8cad2bb54b9cb1a0c91490e3f35a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:56.671372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.671704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.672035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.897491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] MFA Rules not processed for user `c73e8cad2bb54b9cb1a0c91490e3f35a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:56.898746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:56.931175 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2273/4544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:56.942464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:56.942751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:56.943105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:56.980772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] MFA Rules not processed for user `c73e8cad2bb54b9cb1a0c91490e3f35a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:56.982016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:57.006356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2272/4545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:57.008877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:57.022159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330554af-5299-42cc-ae6e-11132349fae0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:57.029793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c73e8cad2bb54b9cb1a0c91490e3f35a', 'user_domain_id': 'be1b1a74566c48ba92bc4745465891cc', 'system_scope': None, 'project_id': '472ae11f37b943688fa543188442146a', 'project_domain_id': 'be1b1a74566c48ba92bc4745465891cc', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:57.030778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:57.031164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:57.031547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:57.043537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:57.045641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:57.059027 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2274/4546] 10.222.0.18 () {56 vars in 1283 bytes} [Sat Apr 2 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:57.063807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:57.151888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d87dd-9f74-4d14-a550-a0305b3a8fbf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:57.165342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:57.166429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:57.166736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:57.167002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/users/c73e8cad2bb54b9cb1a0c91490e3f35a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:57.170228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c73e8cad2bb54b9cb1a0c91490e3f35a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:57.174902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:57.266089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73e8cad2bb54b9cb1a0c91490e3f35a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.282316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73e8cad2bb54b9cb1a0c91490e3f35a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.283240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73e8cad2bb54b9cb1a0c91490e3f35a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.293946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73e8cad2bb54b9cb1a0c91490e3f35a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.303746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73e8cad2bb54b9cb1a0c91490e3f35a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.316281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2273/4547] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:57 2022] DELETE /identity/v3/users/c73e8cad2bb54b9cb1a0c91490e3f35a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:57.318070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:57.338862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02590afc-4b59-4866-8552-45eb873a7621 tempest-test_project-1092101913 tempest-user-1682220391] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:57.517795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:57.519885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:57.520387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:57.520836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/projects/472ae11f37b943688fa543188442146a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:57.523748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:delete_project(project_id=472ae11f37b943688fa543188442146a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:57.526357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:57.648184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472ae11f37b943688fa543188442146a', 'request_id': 'req-8c4c9883-976a-4477-866d-6517428d73d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.693523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472ae11f37b943688fa543188442146a', 'request_id': 'req-8c4c9883-976a-4477-866d-6517428d73d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.716667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472ae11f37b943688fa543188442146a', 'request_id': 'req-8c4c9883-976a-4477-866d-6517428d73d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.762195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] The token cache is being invalidate because project 472ae11f37b943688fa543188442146a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:57.762497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.767720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.771838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2275/4548] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:04:57 2022] DELETE /identity/v3/projects/472ae11f37b943688fa543188442146a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:57.776269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:57.778427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:57.804524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b305013-ce81-457e-9f56-e2acf1b85286 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:57.954395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:57.955595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:57.956103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:57.956662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/domains/be1b1a74566c48ba92bc4745465891cc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:57.959029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=be1b1a74566c48ba92bc4745465891cc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:57.965451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:57.996961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:57.998219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.045686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.046548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7082920e-02fd-45c2-8934-341572ca3401 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.062341 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2274/4549] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:04:57 2022] PATCH /identity/v3/domains/be1b1a74566c48ba92bc4745465891cc => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:04:58.064358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:58.066775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:58.092982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9883-976a-4477-866d-6517428d73d7 tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:58.208646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b04521211949b4b8933cfd4ce6538d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29e40169756c4c9b9c5083f30a5761a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:58.209759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:58.210276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:58.210930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] PATH_INFO: `/v3/domains/be1b1a74566c48ba92bc4745465891cc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:58.229152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=be1b1a74566c48ba92bc4745465891cc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:58.232410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:58.271725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.281400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.351697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:58.351992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:58.352275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:58.369373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.382080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.411027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.433099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] The token cache is being invalidate because project be1b1a74566c48ba92bc4745465891cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:04:58.435203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.436421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] MFA Rules not processed for user `2071e721c18d4b0da78ece25fae86679`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:58.437702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:58.439682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.459378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.464442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.466854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'be1b1a74566c48ba92bc4745465891cc', 'request_id': 'req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.485912 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2276/4550] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:04:58 2022] DELETE /identity/v3/domains/be1b1a74566c48ba92bc4745465891cc => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:04:58.493381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:58.494820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:58.686058 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2275/4551] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:58.695428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:58.698230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:58.735438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c1ad-fa6b-4608-9f49-170fdc2b0e5c tempest-TestDefaultProjectId-100351726 tempest-TestDefaultProjectId-100351726-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:58.759771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:58.760869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:58.761239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:58.762340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] PATH_INFO: `/v3/users/7ea875d90308476191915c4f73c41501` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:58.764538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea875d90308476191915c4f73c41501)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:58.771196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:58.894501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339c58-1885-44ac-9bde-166fc6dec986 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:58.904231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:58.906403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:58.908056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:58.908587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:58.914208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:58.914757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea875d90308476191915c4f73c41501'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.930840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea875d90308476191915c4f73c41501'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.937397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea875d90308476191915c4f73c41501'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.939072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea875d90308476191915c4f73c41501'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.964043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f87797cc-1662-433f-bb51-1f6e3a1e10e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea875d90308476191915c4f73c41501'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:04:58.989195 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2277/4552] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:04:58 2022] DELETE /identity/v3/users/7ea875d90308476191915c4f73c41501 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:04:59.002662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:59.002946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:59.003225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:59.029294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:04:59.032003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:59.171725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:59.176494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:59.201803 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2276/4553] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:04:59.234725 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2278/4554] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:04:59.279943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:04:59.282002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:04:59.448754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0fa71-9e78-4393-8f4f-25936b61e6b6 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:04:59.575626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:04:59.576444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:04:59.576788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:04:59.577109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:04:59.593360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:04:59.597185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:04:59.614166 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2277/4555] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:00.896753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:00.898797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:00.930273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b8f6-eba5-4722-810a-019d50881924 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:00.946059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:00.948673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:00.948984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:00.950031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] PATH_INFO: `/v3/projects/5d9c6e3adc60420798a51492ca80b78b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:00.957086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9c6e3adc60420798a51492ca80b78b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:00.959576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:01.087917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9c6e3adc60420798a51492ca80b78b', 'request_id': 'req-8b3688f2-2b7e-461b-95cb-f614ead37c52'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.094971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9c6e3adc60420798a51492ca80b78b', 'request_id': 'req-8b3688f2-2b7e-461b-95cb-f614ead37c52'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.108509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9c6e3adc60420798a51492ca80b78b', 'request_id': 'req-8b3688f2-2b7e-461b-95cb-f614ead37c52'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.127624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] The token cache is being invalidate because project 5d9c6e3adc60420798a51492ca80b78b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:01.128258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.129971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.133248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2279/4556] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:00 2022] DELETE /identity/v3/projects/5d9c6e3adc60420798a51492ca80b78b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:01.137243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:01.153250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50bd83-58d8-42e5-bb7c-37456827a3b8 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:01.259822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:01.262720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:01.262720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:01.264210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] PATH_INFO: `/v3/users/86b04521211949b4b8933cfd4ce6538d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:01.266001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b04521211949b4b8933cfd4ce6538d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:01.267768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:01.379223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b04521211949b4b8933cfd4ce6538d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.409768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b04521211949b4b8933cfd4ce6538d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.411213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b04521211949b4b8933cfd4ce6538d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.428022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b04521211949b4b8933cfd4ce6538d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.467095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-78a906da-99ec-4df1-a28b-d33232e4b8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b04521211949b4b8933cfd4ce6538d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:01.478566 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2278/4557] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:01 2022] DELETE /identity/v3/users/86b04521211949b4b8933cfd4ce6538d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:02.210128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:02.213284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:02.249127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3688f2-2b7e-461b-95cb-f614ead37c52 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:02.351230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:02.352140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:02.352805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:02.353629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] PATH_INFO: `/v3/projects/29e40169756c4c9b9c5083f30a5761a4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:02.356706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e40169756c4c9b9c5083f30a5761a4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:02.360033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:02.474259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e40169756c4c9b9c5083f30a5761a4', 'request_id': 'req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:02.489583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e40169756c4c9b9c5083f30a5761a4', 'request_id': 'req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:02.500016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e40169756c4c9b9c5083f30a5761a4', 'request_id': 'req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:02.517943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] The token cache is being invalidate because project 29e40169756c4c9b9c5083f30a5761a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:02.518498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:02.519498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c1249e3f-7d1b-4c59-96a8-d18ec8147eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:02.522253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2280/4558] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:02 2022] DELETE /identity/v3/projects/29e40169756c4c9b9c5083f30a5761a4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:02.526999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:02.527503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:02.527599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:02.565027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:02.566313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:02.744714 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2279/4559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:02.753537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:02.754086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:02.754536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:02.800629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:02.802568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:02.835826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2281/4560] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:05:02.840853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:02.851009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e948c-249c-4e0e-9a34-2c805e3eab65 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:02.857126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:02.858037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:02.858513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:02.859201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:02.860175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:02.860721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:02.862609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:02.878159 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2280/4561] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:02.882213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:02.896243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c74db1-6ce7-4817-ac8f-39be123572c3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:02.901727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:02.902705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:02.903171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:02.903596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:02.905150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:02.908522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:02.958597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:02.967723 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2282/4562] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:02 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:02.981862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112e69-1d2d-4755-8c70-9480b4c5ab7d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.110498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.111750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.112282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.112915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.113869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.118766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.168719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2281/4563] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:02 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:03.173510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.191177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3125-85ec-435b-8028-abb529ac4664 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.203376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.204088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.204379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.204793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.206228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.213692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.235782 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2283/4564] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:03.240314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.256080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b056d-00b8-4f9a-b5a2-7c633929aa87 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.267431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.268739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.269710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.270280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.273378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.280159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86475-cc96-4703-afb4-fcc35c7f52a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.303428 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2282/4565] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:03.306526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.325293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceaad1-2aa0-4497-bc53-4ee8e3a64c7b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.335148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.337507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.347570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.348325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] PATH_INFO: `/v3/projects/919d34def6c64ddb814f5326614e50f3/users/dcf4423e131f4073a5c833738497e281/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.377335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=919d34def6c64ddb814f5326614e50f3, user_id=dcf4423e131f4073a5c833738497e281, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.380722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.413542 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2284/4566] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:03 2022] PUT /identity/v3/projects/919d34def6c64ddb814f5326614e50f3/users/dcf4423e131f4073a5c833738497e281/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:03.426736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.427032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.427316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.473787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] MFA Rules not processed for user `dcf4423e131f4073a5c833738497e281`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:03.476238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:03.610712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2283/4567] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:03.615788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.722749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463802ff-fd4b-433e-9e52-34a1b2a3a42c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.728765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.729665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.730091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.731136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.732303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.734862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.769249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2285/4568] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:03 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:03.773230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.787441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211867-b4ea-4ea0-a87d-4a9bd2ff206d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.852240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.853043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.860260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.860260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.864999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.869169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.907740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2284/4569] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:03 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:03.908808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:03.925129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0b3f7-6652-4bea-84cf-aecce51cd377 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:03.942290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:03.944095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:03.944396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:03.945735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:03.947782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:03.950635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:03.983416 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2286/4570] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:03.988975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.010637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8129d-cc6b-453e-a1d1-1b09c1f2e937 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.035127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.036509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.036948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.037672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] PATH_INFO: `/v3/projects/5009da1978c642cb965d59e6a24dd49a/users/ae4d7f0c50b446f999b5be6aabdc5ac2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.086712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009da1978c642cb965d59e6a24dd49a, user_id=ae4d7f0c50b446f999b5be6aabdc5ac2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.089440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.135523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2285/4571] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:03 2022] PUT /identity/v3/projects/5009da1978c642cb965d59e6a24dd49a/users/ae4d7f0c50b446f999b5be6aabdc5ac2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:04.138886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.154897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1258a0-23bc-4192-adc5-d7347e0d85c5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.297422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.301953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.302495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.303003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.304105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.309381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d8650-b591-410d-be4d-bdbaefa4ce4c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.330572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2287/4572] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:04.336648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.354947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d09ff2-f7b3-45e5-8ec6-31afbda8bcbf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.365193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.366118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.366941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.366941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] PATH_INFO: `/v3/projects/5009da1978c642cb965d59e6a24dd49a/users/ae4d7f0c50b446f999b5be6aabdc5ac2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.378558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009da1978c642cb965d59e6a24dd49a, user_id=ae4d7f0c50b446f999b5be6aabdc5ac2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.382873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.415118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2286/4573] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:04 2022] PUT /identity/v3/projects/5009da1978c642cb965d59e6a24dd49a/users/ae4d7f0c50b446f999b5be6aabdc5ac2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:04.417216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.417512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.417953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.460228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] MFA Rules not processed for user `ae4d7f0c50b446f999b5be6aabdc5ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:04.463140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:04.587008 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2288/4574] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:04.591152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.608680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc81-d0fc-49fc-8b08-6917f483cac8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.618962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.619650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.619932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.620208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.621512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.624695 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:04.624695 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:04.624695 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:04.627839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.659998 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2287/4575] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:04 2022] POST /identity/v3/services => generated 288 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:04.664218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.686890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729dde0-a412-42c7-a39c-9a73bd16dd0e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.705366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.706406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.706868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.707310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.709051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.711039 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:04.711039 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:04.711039 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:04.712350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.725824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2289/4576] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Apr 2 21:05:04 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:04.729984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.748684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aa5e9-0703-46ae-af30-18dc3041e35e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.760905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.762105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.763243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.764355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.765180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.767382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.796481 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2288/4577] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:04 2022] POST /identity/v3/services => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:04.799235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.813456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d404-f245-4acc-983f-edf6165bceaa tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.840125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.840809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.841307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.841786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.842673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.844639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.859841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2290/4578] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Apr 2 21:05:04 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:04.863723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.895425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04bd8-0db7-439e-9a3a-58656323e584 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.924780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.925441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.925730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.926006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.928711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.933135 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:04.933135 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:04.933135 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:04.935175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.956552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2289/4579] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 21:05:04 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:04.958473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:04.970511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfc0e1-2d79-4d01-b9d8-80e6e375c29e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:04.975929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:04.977234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:04.977797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:04.978331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:04.979492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=69e0365b9fed4a0289a84ee38f04368f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:04.981058 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:04.981058 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:04.981058 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:04.982490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:04.996825 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2291/4580] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Apr 2 21:05:04 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f => generated 333 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:05.002377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.031544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4962c-74d3-4e24-a1e5-d86bb0db0c3d tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.041824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.043028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.043735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.043735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.044431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=69e0365b9fed4a0289a84ee38f04368f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.045761 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.045761 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:05.045761 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:05.046966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.055490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2290/4581] 10.222.0.18 () {58 vars in 1290 bytes} [Sat Apr 2 21:05:05 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f => generated 0 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 02 21:05:05.059357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.078801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86fe2-7a73-4d76-8ab7-4fd282977824 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.086131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.087554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.088194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.088724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.090821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=69e0365b9fed4a0289a84ee38f04368f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.092218 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.092218 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:05.092218 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:05.093980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.115080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2292/4582] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.118848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.147111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a6fc5-ee07-47fc-a8a0-eb920c603baf tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.154745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.155636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.155926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.156207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.157007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.160909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.175885 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2291/4583] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 21:05:05 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:05.186758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.202893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93670-a00e-461e-8eb1-f35bc4527ff1 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.213676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.216353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.216678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.217071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.218388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=69e0365b9fed4a0289a84ee38f04368f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.221265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.241293 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Could not find Endpoint Group: 69e0365b9fed4a0289a84ee38f04368f.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 69e0365b9fed4a0289a84ee38f04368f. Apr 02 21:05:05.243186 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2293/4584] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/69e0365b9fed4a0289a84ee38f04368f => generated 120 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:05:05.248133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.263014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0428183-363a-46b5-b49f-c1af4647cb58 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.290968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.303493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.303929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.304153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services/9771f8caff924a53a5282849958f4b75` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.304884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9771f8caff924a53a5282849958f4b75)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.305922 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.305922 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:05.305922 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:05.306888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.360504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2292/4585] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/services/9771f8caff924a53a5282849958f4b75 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.367061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.382017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2f4f-cc93-4548-95c3-e2f3c5263961 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.406275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.407246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.407849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.408365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.409392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.410643 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.410643 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:05.410643 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:05.412001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.430391 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2294/4586] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:05 2022] POST /identity/v3/services => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:05.435129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.459497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb041-5eb1-479b-934a-0a28ca3ebce0 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.487006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.487776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.488170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.488604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.489609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.490837 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.490837 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:05.490837 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:05.492218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.506650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2293/4587] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Apr 2 21:05:05 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:05.507916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.524706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df237-a105-42f0-8cfa-58bb0c64d8b7 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.529572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.530388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.530683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.530968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.531687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.533433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.553271 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2295/4588] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:05 2022] POST /identity/v3/services => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:05.554747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.566298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dcdaf-8743-43e4-9bfb-a586f67d987a tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.593223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.594450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.595829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.596126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f76123dec6654fdab76ad63b89a97412` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.597144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f76123dec6654fdab76ad63b89a97412)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.599094 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.599094 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:05.599094 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:05.600316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.616985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2294/4589] 10.222.0.18 () {60 vars in 1312 bytes} [Sat Apr 2 21:05:05 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f76123dec6654fdab76ad63b89a97412 => generated 335 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:05.622702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.646162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09559-8801-4299-9c41-740dcf455b60 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.650991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.651912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.653041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.653740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services/aaf5735470054bdabee7e5bde2d2afea` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.654558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aaf5735470054bdabee7e5bde2d2afea)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.655830 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.655830 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:05.655830 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:05.657419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.692345 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2296/4590] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/services/aaf5735470054bdabee7e5bde2d2afea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.697811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.708354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b7dba-9620-4e07-a5d5-40426e389d91 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.732787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.734136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.734654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.735245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f76123dec6654fdab76ad63b89a97412` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.736289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f76123dec6654fdab76ad63b89a97412)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.738126 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:05.738126 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:05.738126 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:05.739749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.753489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2295/4591] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f76123dec6654fdab76ad63b89a97412 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.757809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.769968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e408ed0-033c-4b2b-b444-a182076b8936 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.775053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.776106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.776397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.776713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services/8f9268795abf4cc6ab4bf66a9a32d02b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.777499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8f9268795abf4cc6ab4bf66a9a32d02b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.779136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.805321 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2297/4592] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/services/8f9268795abf4cc6ab4bf66a9a32d02b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:05.812013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.830523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8cc4-5491-4fb5-9b51-bcaf8862baa8 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.846729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.847793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.848259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.848857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6d31d1ec0f5a4a3f9f1b09ada173e90e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.849660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6d31d1ec0f5a4a3f9f1b09ada173e90e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.851504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.867370 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2296/4593] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6d31d1ec0f5a4a3f9f1b09ada173e90e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.871937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:05.885725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb383fc-be98-4539-9218-463bd8b2fe35 tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:05.894171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4d7f0c50b446f999b5be6aabdc5ac2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5009da1978c642cb965d59e6a24dd49a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:05.894660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:05.895127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:05.895569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] PATH_INFO: `/v3/services/ad5bd96b2c7c4b2a9cb26f76e6f13b49` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:05.896601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ad5bd96b2c7c4b2a9cb26f76e6f13b49)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:05.898864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13503e-3091-4097-aa3f-0dcf4a43959b tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:05.952401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2298/4594] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/services/ad5bd96b2c7c4b2a9cb26f76e6f13b49 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:05.956694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:06.091663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4250-3c50-4895-a609-ca6d7768a91e tempest-EndPointGroupsTest-1267875168 tempest-EndPointGroupsTest-1267875168-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:06.110846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:06.112298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:06.112821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:06.113515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] PATH_INFO: `/v3/users/dcf4423e131f4073a5c833738497e281` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:06.115769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf4423e131f4073a5c833738497e281)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:06.118315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:06.159099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:06.160699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:06.161046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:06.184177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:06.185489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:06.196782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf4423e131f4073a5c833738497e281'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:06.214344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf4423e131f4073a5c833738497e281'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:06.216059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf4423e131f4073a5c833738497e281'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:06.227861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf4423e131f4073a5c833738497e281'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:06.262060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6cb9cc7d-2fbc-4e3f-837e-2cf0ece43c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf4423e131f4073a5c833738497e281'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:06.270617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2297/4595] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:05 2022] DELETE /identity/v3/users/dcf4423e131f4073a5c833738497e281 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:06.275607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:06.275909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:06.276251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:06.296747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2299/4596] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:05:06.297797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:06.299102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:06.375081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:06.377006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:06.430265 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2298/4597] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:06.475830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:06.477956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:06.493841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105a33e-fe93-4666-9adb-9f07cc2685b4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:06.577803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75313-762b-446a-ac19-26410e621562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:06.578582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75313-762b-446a-ac19-26410e621562 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:06.578766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75313-762b-446a-ac19-26410e621562 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:06.579373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a75313-762b-446a-ac19-26410e621562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:06.592500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475ad5-6f0b-45be-bdd4-a89b59a7182e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:06.598059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:06.598878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:06.599234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:06.599637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:06.611169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:06.612861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:06.632127 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2299/4598] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:05:06.667883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a75313-762b-446a-ac19-26410e621562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:06.669677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a75313-762b-446a-ac19-26410e621562 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:06.679472 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2300/4599] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:05:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:05:07.224867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:07.226568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:07.255933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a8e2e-40ac-4a1e-926e-bb61ac7ee89d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:07.273787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:07.277616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:07.277979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:07.278278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] PATH_INFO: `/v3/projects/919d34def6c64ddb814f5326614e50f3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:07.290471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919d34def6c64ddb814f5326614e50f3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:07.300360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:07.419855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919d34def6c64ddb814f5326614e50f3', 'request_id': 'req-288aba3a-6cc3-41a4-a095-6ed14953c5a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.435547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919d34def6c64ddb814f5326614e50f3', 'request_id': 'req-288aba3a-6cc3-41a4-a095-6ed14953c5a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.472024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919d34def6c64ddb814f5326614e50f3', 'request_id': 'req-288aba3a-6cc3-41a4-a095-6ed14953c5a1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.494058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] The token cache is being invalidate because project 919d34def6c64ddb814f5326614e50f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:07.494293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.495986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.499048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2300/4600] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:07 2022] DELETE /identity/v3/projects/919d34def6c64ddb814f5326614e50f3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:07.502979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75313-762b-446a-ac19-26410e621562 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:07.521619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a75313-762b-446a-ac19-26410e621562 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:07.624221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:07.625345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:07.625781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:07.626207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] PATH_INFO: `/v3/users/ae4d7f0c50b446f999b5be6aabdc5ac2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:07.627633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4d7f0c50b446f999b5be6aabdc5ac2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:07.630973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:07.710762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4d7f0c50b446f999b5be6aabdc5ac2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.728431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4d7f0c50b446f999b5be6aabdc5ac2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.729429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4d7f0c50b446f999b5be6aabdc5ac2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.731564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4d7f0c50b446f999b5be6aabdc5ac2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.750069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58dcdf96-bf71-496a-aee4-e11c33097dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4d7f0c50b446f999b5be6aabdc5ac2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:07.795405 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2301/4601] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:07 2022] DELETE /identity/v3/users/ae4d7f0c50b446f999b5be6aabdc5ac2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:08.463426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:08.469066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:08.499228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aba3a-6cc3-41a4-a095-6ed14953c5a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:08.621140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:08.623215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:08.624367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:08.624534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] PATH_INFO: `/v3/projects/5009da1978c642cb965d59e6a24dd49a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:08.626449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5009da1978c642cb965d59e6a24dd49a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:08.628966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:08.719067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5009da1978c642cb965d59e6a24dd49a', 'request_id': 'req-3054be42-434a-4822-b239-2227028ef310'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:08.729069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5009da1978c642cb965d59e6a24dd49a', 'request_id': 'req-3054be42-434a-4822-b239-2227028ef310'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:08.739732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5009da1978c642cb965d59e6a24dd49a', 'request_id': 'req-3054be42-434a-4822-b239-2227028ef310'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:08.759251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] The token cache is being invalidate because project 5009da1978c642cb965d59e6a24dd49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:08.759500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:08.782818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3054be42-434a-4822-b239-2227028ef310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:08.790771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:08.791756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:08.792291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:08.793221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2301/4602] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:08 2022] DELETE /identity/v3/projects/5009da1978c642cb965d59e6a24dd49a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:08.829792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:08.831489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:08.924421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2302/4603] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:08.934654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:08.934979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:08.936284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:08.988999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:08.994130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:09.018025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.021151 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2302/4604] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:09.037873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204663d3-cd62-48b1-827a-962bca4f4ce5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.055821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.058615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.062518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.064881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.068435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:09.069353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.079414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.175230 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2303/4605] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:09.178264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.194986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac77379-22b6-4093-acec-0c8cdd742b2d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.212522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.214282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.214775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.215219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.216078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.218874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.278757 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2303/4606] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:09 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:09.284028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.315191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d648-f8ff-40c5-a625-a8b026192415 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.435935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.436850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.437239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.437625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.438430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.442350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.499338 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2304/4607] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:09 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:09.503372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.520381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf6aee-b31c-455b-b0af-47c3fe2c9bb2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.529382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.530278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.533362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.533795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.535015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.539061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.565789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2304/4608] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:09.570865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.586806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a1d10-b66f-45cd-ae66-fcec11712182 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.606979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.643447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.643924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.644312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.645402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.664082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42e9c-8308-4ff9-9e56-59d91b96fb8b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.686590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2305/4609] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:09.690844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:09.720352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7b54-53dc-43bc-9c61-3cfe128a5338 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:09.736296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:09.739768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.740067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.740351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] PATH_INFO: `/v3/projects/5558ab6ac597475d922e4f0306a42f7e/users/c0ec9ad284424ee3b350f08773f6ba0f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.818355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5558ab6ac597475d922e4f0306a42f7e, user_id=c0ec9ad284424ee3b350f08773f6ba0f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:09.820408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:09.872588 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2305/4610] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:09 2022] PUT /identity/v3/projects/5558ab6ac597475d922e4f0306a42f7e/users/c0ec9ad284424ee3b350f08773f6ba0f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:09.874707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:09.875229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:09.875318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:09.936873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] MFA Rules not processed for user `c0ec9ad284424ee3b350f08773f6ba0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:09.938392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:10.081300 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2306/4611] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:10.087760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:10.329464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89472cd-3bd5-4cb4-bbbe-1c384fe34fa3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:10.337749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:10.348494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:10.348823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:10.349115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:10.349835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:10.351942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:10.400173 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2306/4612] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:10 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:10.405068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:10.421812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063b40f-acfe-4ccf-bb43-7ce9892c8010 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:10.586390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:10.587766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:10.588210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:10.588597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:10.589489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:10.591887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:10.677611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2307/4613] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:10 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:10.679117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:10.705604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72e51-cca6-4ffd-9816-ca68e34e9a8a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:10.742682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:10.743830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:10.744341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:10.744874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:10.746955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:10.751727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:10.805161 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2307/4614] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:10.810642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:10.828986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfa401-d7bb-43bf-847c-8505ff61d95a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:10.875291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:10.885123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:10.887597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:10.895659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] PATH_INFO: `/v3/projects/6a807579a1bd4502bb7fb61756f68d12/users/b545f5249de8487493fa2f142da6f028/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.003865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a807579a1bd4502bb7fb61756f68d12, user_id=b545f5249de8487493fa2f142da6f028, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.006635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.070069 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2308/4615] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:10 2022] PUT /identity/v3/projects/6a807579a1bd4502bb7fb61756f68d12/users/b545f5249de8487493fa2f142da6f028/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:11.070654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.086129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7a84-ab80-4f9a-a37e-0cac79eeeed9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.227433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.228158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.228466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.228758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.229652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.231887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f006eb-ab2d-4fdb-8b91-f61c47b5a1b4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.247956 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2308/4616] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:11.252301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.267826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a74f4-4498-4abd-b966-88fdc69ac0b8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.297348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.300653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.300949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.301236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] PATH_INFO: `/v3/projects/6a807579a1bd4502bb7fb61756f68d12/users/b545f5249de8487493fa2f142da6f028/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.315785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a807579a1bd4502bb7fb61756f68d12, user_id=b545f5249de8487493fa2f142da6f028, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.330741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.392417 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2309/4617] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:11 2022] PUT /identity/v3/projects/6a807579a1bd4502bb7fb61756f68d12/users/b545f5249de8487493fa2f142da6f028/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:11.394519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.394916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.395179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.459975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] MFA Rules not processed for user `b545f5249de8487493fa2f142da6f028`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:11.461418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:11.632119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2309/4618] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:11.637136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.653770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d325aa5-2d98-41ec-a646-507b09498a2c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.667210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.671059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.671377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.671702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.672393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.677025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.712895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.726277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2310/4619] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:11 2022] POST /identity/v3/services => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:11.727401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e987b-70f8-4813-82c3-c08c34df9217 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.746243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.747236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.748299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.748802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.749800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.751185 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:11.751185 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:11.751185 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:11.752840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.788115 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 02 21:05:11.788115 ncdv-master-1 devstack@keystone.service[97316]: Failed validating 'type' in schema['properties']['enabled']: Apr 02 21:05:11.788115 ncdv-master-1 devstack@keystone.service[97316]: {'enum': [True, False, None], 'type': 'boolean'} Apr 02 21:05:11.788115 ncdv-master-1 devstack@keystone.service[97316]: On instance['enabled']: Apr 02 21:05:11.788115 ncdv-master-1 devstack@keystone.service[97316]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 02 21:05:11.790592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2310/4620] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:05:11 2022] POST /identity/v3/endpoints => generated 283 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:11.795929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.809728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73331fc9-87c0-40be-947e-46b86c92fda5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.830910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.831596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.832323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.832637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.833398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.834901 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:11.834901 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:11.834901 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:11.836113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.853861 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 02 21:05:11.853861 ncdv-master-1 devstack@keystone.service[97317]: Failed validating 'type' in schema['properties']['enabled']: Apr 02 21:05:11.853861 ncdv-master-1 devstack@keystone.service[97317]: {'enum': [True, False, None], 'type': 'boolean'} Apr 02 21:05:11.853861 ncdv-master-1 devstack@keystone.service[97317]: On instance['enabled']: Apr 02 21:05:11.853861 ncdv-master-1 devstack@keystone.service[97317]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 02 21:05:11.856181 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2311/4621] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:05:11 2022] POST /identity/v3/endpoints => generated 281 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:11.861308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:11.874563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c4792-755b-49fa-8cdb-a8e7a6b6d318 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:11.889987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:11.890591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:11.890919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:11.891209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:11.891994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:11.893628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:11.943072 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-175516932. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:05:11.943072 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:05:11.943072 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:12.010545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.021695 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2311/4622] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:05:11 2022] POST /identity/v3/endpoints => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:12.031456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff43ce-8b0f-465c-a218-a5a74cb3c5e5 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.080881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.081980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.082467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.083505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/regions/tempest-region-175516932` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.084432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-175516932)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.087376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.098990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.110485 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2312/4623] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 21:05:12 2022] GET /identity/v3/regions/tempest-region-175516932 => generated 178 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:12.111863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905e1d-102b-45ee-afdc-90de8fa925d7 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.117103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.118196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.118705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.119167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints/7d46acca857740ec95cae2fc991fec21` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.145683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7d46acca857740ec95cae2fc991fec21)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.145683 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.145683 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:12.145683 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:12.145683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.164043 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 02 21:05:12.164043 ncdv-master-1 devstack@keystone.service[97316]: Failed validating 'type' in schema['properties']['enabled']: Apr 02 21:05:12.164043 ncdv-master-1 devstack@keystone.service[97316]: {'enum': [True, False, None], 'type': 'boolean'} Apr 02 21:05:12.164043 ncdv-master-1 devstack@keystone.service[97316]: On instance['enabled']: Apr 02 21:05:12.164043 ncdv-master-1 devstack@keystone.service[97316]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 02 21:05:12.169014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2312/4624] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Apr 2 21:05:12 2022] PATCH /identity/v3/endpoints/7d46acca857740ec95cae2fc991fec21 => generated 283 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:12.173250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.185583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e5cc-1587-4f74-ba81-b9c6f2b7ace9 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.202538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.203421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.203706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.203985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints/7d46acca857740ec95cae2fc991fec21` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.206094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7d46acca857740ec95cae2fc991fec21)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.208030 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.208030 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:12.208030 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:12.210560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.237758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7d46acca857740ec95cae2fc991fec21', 'request_id': 'req-6f01d95e-fc63-4186-afd1-e47eccab7816'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:12.263675 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2313/4625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:12 2022] DELETE /identity/v3/endpoints/7d46acca857740ec95cae2fc991fec21 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:12.267716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.279848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c9d32-501f-4465-bb0d-55a9ad557251 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.314044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.314893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.315181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.315458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/regions/tempest-region-175516932` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.316112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-175516932)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.321148 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.321148 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:12.321148 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:12.322064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.367536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2313/4626] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:05:12 2022] DELETE /identity/v3/regions/tempest-region-175516932 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:12.373742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.399898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01d95e-fc63-4186-afd1-e47eccab7816 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.457196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.458114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.458589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.460020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.461233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.463076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.518879 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-854765223. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:05:12.518879 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:05:12.518879 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:12.572931 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2314/4627] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:05:12 2022] POST /identity/v3/endpoints => generated 358 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:12.576858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.592987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415ca8-f3af-41da-906c-705f4c1f8f01 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.634920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.635795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.636115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.636406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/regions/tempest-region-854765223` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.637121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-854765223)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.638218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.647250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.647691 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2314/4628] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 21:05:12 2022] GET /identity/v3/regions/tempest-region-854765223 => generated 178 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:12.660958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43818c-b5de-476f-a675-0b6c1c8c62fc tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.676033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.677038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.677368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.677654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints/cdfbc12d309f4084a078ff1f0abfd9e9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.691196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cdfbc12d309f4084a078ff1f0abfd9e9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.692668 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.692668 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:12.692668 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:12.696120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.721844 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 02 21:05:12.721844 ncdv-master-1 devstack@keystone.service[97317]: Failed validating 'type' in schema['properties']['enabled']: Apr 02 21:05:12.721844 ncdv-master-1 devstack@keystone.service[97317]: {'enum': [True, False, None], 'type': 'boolean'} Apr 02 21:05:12.721844 ncdv-master-1 devstack@keystone.service[97317]: On instance['enabled']: Apr 02 21:05:12.721844 ncdv-master-1 devstack@keystone.service[97317]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 02 21:05:12.741517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2315/4629] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Apr 2 21:05:12 2022] PATCH /identity/v3/endpoints/cdfbc12d309f4084a078ff1f0abfd9e9 => generated 281 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:12.746265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.776009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092454e-16f4-4b0a-be97-ce9d1011d926 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.790538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.791915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.792286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.793416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/endpoints/cdfbc12d309f4084a078ff1f0abfd9e9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.795237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cdfbc12d309f4084a078ff1f0abfd9e9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.797463 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.797463 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:12.797463 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:12.801545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.829384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cdfbc12d309f4084a078ff1f0abfd9e9', 'request_id': 'req-c5e357d5-29c8-455e-88bc-ffed9423c366'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:12.848798 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2315/4630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:12 2022] DELETE /identity/v3/endpoints/cdfbc12d309f4084a078ff1f0abfd9e9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:12.852739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:12.868432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb578-0c78-4f9b-a722-be6f81f75b42 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:12.925798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:12.926583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:12.926873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:12.927155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/regions/tempest-region-854765223` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:12.927812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-854765223)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:12.928864 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:12.928864 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:12.928864 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:12.929756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:12.986352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2316/4631] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:05:12 2022] DELETE /identity/v3/regions/tempest-region-854765223 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:12.991401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:13.006218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e357d5-29c8-455e-88bc-ffed9423c366 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:13.044392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b545f5249de8487493fa2f142da6f028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a807579a1bd4502bb7fb61756f68d12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:13.045452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:13.045841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:13.046228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] PATH_INFO: `/v3/services/9046a4964acb4d5d8ac48ed76507f79c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:13.047266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9046a4964acb4d5d8ac48ed76507f79c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:13.049326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd7e8-e99e-44dc-ba4b-b089353dae74 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:13.105801 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2316/4632] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:12 2022] DELETE /identity/v3/services/9046a4964acb4d5d8ac48ed76507f79c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:13.111255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:13.273753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797a331-315e-4813-a194-f5b91da15cd3 tempest-EndpointsNegativeTestJSON-1370771543 tempest-EndpointsNegativeTestJSON-1370771543-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:13.310294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:13.311436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:13.311787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:13.312249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] PATH_INFO: `/v3/users/c0ec9ad284424ee3b350f08773f6ba0f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:13.313594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ec9ad284424ee3b350f08773f6ba0f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:13.316740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:13.411334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ec9ad284424ee3b350f08773f6ba0f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:13.434576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ec9ad284424ee3b350f08773f6ba0f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:13.435271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ec9ad284424ee3b350f08773f6ba0f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:13.435951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ec9ad284424ee3b350f08773f6ba0f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:13.465633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ec9ad284424ee3b350f08773f6ba0f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:13.493481 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2317/4633] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:13 2022] DELETE /identity/v3/users/c0ec9ad284424ee3b350f08773f6ba0f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:13.499889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:13.500277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:13.502209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:13.542141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:13.543499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:13.691273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2317/4634] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:13.726202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:13.733155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:14.016438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be2491-a88d-47e5-ac7d-565e01a356f2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:14.026115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:14.027417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:14.027714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:14.028002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:14.069453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:14.075029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:14.105201 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2318/4635] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:15.280969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:15.283027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:15.304203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa604-8c19-4579-9539-96c0a7f8e42c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:15.321394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:15.322318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:15.322583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:15.322851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] PATH_INFO: `/v3/projects/5558ab6ac597475d922e4f0306a42f7e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:15.330764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5558ab6ac597475d922e4f0306a42f7e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:15.332617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:15.428764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5558ab6ac597475d922e4f0306a42f7e', 'request_id': 'req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.437053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5558ab6ac597475d922e4f0306a42f7e', 'request_id': 'req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.445217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5558ab6ac597475d922e4f0306a42f7e', 'request_id': 'req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.460577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] The token cache is being invalidate because project 5558ab6ac597475d922e4f0306a42f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:15.461084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.461900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5dbf1331-c1c9-4464-b9a0-a1869da7e1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.463916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2318/4636] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:15 2022] DELETE /identity/v3/projects/5558ab6ac597475d922e4f0306a42f7e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:15.467782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:15.479533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c343fc-d921-4f8c-858b-1c133cc3c74a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:15.625068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:15.627795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:15.628083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:15.628365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] PATH_INFO: `/v3/users/b545f5249de8487493fa2f142da6f028` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:15.641648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b545f5249de8487493fa2f142da6f028)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:15.643622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:15.722641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b545f5249de8487493fa2f142da6f028'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.732974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b545f5249de8487493fa2f142da6f028'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.734006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b545f5249de8487493fa2f142da6f028'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.735200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b545f5249de8487493fa2f142da6f028'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.760104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b545f5249de8487493fa2f142da6f028'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:15.794488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2319/4637] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:15 2022] DELETE /identity/v3/users/b545f5249de8487493fa2f142da6f028 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:16.101152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635be3b-82c5-41a1-921e-3023254ccfe0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.101527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635be3b-82c5-41a1-921e-3023254ccfe0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.102025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635be3b-82c5-41a1-921e-3023254ccfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.134261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2635be3b-82c5-41a1-921e-3023254ccfe0 None None] MFA Rules not processed for user `5331b96019b4418a8aa6a1facd9e1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:16.137765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2635be3b-82c5-41a1-921e-3023254ccfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.315506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2319/4638] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:16.364271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:16.365742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.532361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba61418-0921-4342-b4fe-96c5016ae304 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:16.547120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:16.548003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.548285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.548778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] PATH_INFO: `/v3/projects/6a807579a1bd4502bb7fb61756f68d12` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.550059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a807579a1bd4502bb7fb61756f68d12)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:16.552180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:16.633522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a807579a1bd4502bb7fb61756f68d12', 'request_id': 'req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:16.641894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a807579a1bd4502bb7fb61756f68d12', 'request_id': 'req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:16.652384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a807579a1bd4502bb7fb61756f68d12', 'request_id': 'req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:16.668245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] The token cache is being invalidate because project 6a807579a1bd4502bb7fb61756f68d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:16.668245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:16.668767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32b10057-ff7d-4705-8e1d-f0db0ba9dab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:16.670484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2320/4639] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:16 2022] DELETE /identity/v3/projects/6a807579a1bd4502bb7fb61756f68d12 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:16.675226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4387-ce9b-4d34-bb6c-3de0a107c38f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.675716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4387-ce9b-4d34-bb6c-3de0a107c38f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.676179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4387-ce9b-4d34-bb6c-3de0a107c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.710984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0e7a4387-ce9b-4d34-bb6c-3de0a107c38f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:16.713207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0e7a4387-ce9b-4d34-bb6c-3de0a107c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.730589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616deb2b-9185-499b-8ae3-565f7dadcfa9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.730996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616deb2b-9185-499b-8ae3-565f7dadcfa9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.731393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616deb2b-9185-499b-8ae3-565f7dadcfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.771479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-616deb2b-9185-499b-8ae3-565f7dadcfa9 None None] MFA Rules not processed for user `ee1c48c096304c819e0eac11e84aef26`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:16.773290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-616deb2b-9185-499b-8ae3-565f7dadcfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.799557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2320/4640] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:16.810599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.810998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.811516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.854389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:16.858052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.879266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2321/4641] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:16.883643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:16.896507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2321/4642] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:16.903055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.903378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.903659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.904769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9ef40-c345-44cd-b533-109c7c12bcc1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:16.922300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:16.923417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.923862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:16.924297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:16.925216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:16.925936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:16.927706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:16.928240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] MFA Rules not processed for user `ee1c48c096304c819e0eac11e84aef26`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:16.931394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:16.946836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2322/4643] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:16.960721 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2322/4644] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:16.965493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:16.981358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6083-1a67-441e-8cc1-5c5c712d280a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:16.997388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:16.999117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:16.999953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.000303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.001836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.005062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.063959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2323/4645] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:16 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:17.068377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.079010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7406f-5a98-45fc-98db-a8b2a05eab31 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:17.217688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:17.218536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.218917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.219413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.220485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.222600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.265160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2323/4646] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:17 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:17.270683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.286127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb746639-6afb-4f5c-8359-0819128d5af9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:17.295546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:17.296583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.297089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.297557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.298499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.300859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.322367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2324/4647] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:17.326965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.341476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864df18-ac7c-4f8a-8b18-e82f1e823238 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:17.358924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:17.359664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.360075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.360448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.361571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.363798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dd2f1-60f7-43bc-b6b0-ef349f0f90fb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.380113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.387402 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2324/4648] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:17.392215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1884d-7f9d-41a1-93e2-c699fa327afa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:17.406992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:17.407955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.408339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.408748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] PATH_INFO: `/v3/projects/28248a0a244f435685c030c39531492d/users/3eee5c2841cb41c5801c76916eaf759d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.445703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28248a0a244f435685c030c39531492d, user_id=3eee5c2841cb41c5801c76916eaf759d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.456886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.481015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2325/4649] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:17 2022] PUT /identity/v3/projects/28248a0a244f435685c030c39531492d/users/3eee5c2841cb41c5801c76916eaf759d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:17.496766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.497372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.498326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.593367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] MFA Rules not processed for user `3eee5c2841cb41c5801c76916eaf759d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:17.595250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:17.736518 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2325/4650] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:17.743002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.898585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293dd0a-34fc-4f40-ba8c-e461ed157c98 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:17.909623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:17.914007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:17.914517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:17.914994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:17.915956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:17.918846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:17.975268 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2326/4651] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:17 2022] POST /identity/v3/projects => generated 389 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:17.976828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:17.993049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d2436-a7c1-441c-b6ff-4d7be4be7583 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.152700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.153386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.153852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.154282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.155142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.161708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.197705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2326/4652] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:17 2022] POST /identity/v3/users => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:18.203991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.219315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75662-2e0a-4782-90eb-4f178d533d54 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.230315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.232344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.232854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.233248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.234755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.238663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.270110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2327/4653] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:18.271396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.285755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec264-b7fb-4df2-9eb1-36347eff3675 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.299300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.300751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.301290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.301722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] PATH_INFO: `/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1/users/43378e36781c4dcc8394362eb6ad2f06/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.333114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbfe2145dd6421ca5e1518b22baf0e1, user_id=43378e36781c4dcc8394362eb6ad2f06, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.338495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.368146 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2327/4654] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:18 2022] PUT /identity/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1/users/43378e36781c4dcc8394362eb6ad2f06/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:18.372693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.389264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe83e1d-0722-46d4-abb5-8b0dab7941ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.555260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.555967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.556501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.556615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.557387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.560305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c55afc-e4d8-45c5-af91-fb7e90cf2ec7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.589717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.595044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2328/4655] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:18.602346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771dcb-22a4-45de-be2f-2481628acf97 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.623169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.624698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.624995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.625335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] PATH_INFO: `/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1/users/43378e36781c4dcc8394362eb6ad2f06/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.628188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbfe2145dd6421ca5e1518b22baf0e1, user_id=43378e36781c4dcc8394362eb6ad2f06, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.630923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.645916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2328/4656] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:18 2022] PUT /identity/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1/users/43378e36781c4dcc8394362eb6ad2f06/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:18.656777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.657129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.657488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.687681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] MFA Rules not processed for user `43378e36781c4dcc8394362eb6ad2f06`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:18.689079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:18.811381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.819716 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2329/4657] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:18.834923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2571-cfbe-4462-ab3a-f5d9bb969e34 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.845442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.846625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.851653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.851653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects/28248a0a244f435685c030c39531492d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.851653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:get_project(project_id=28248a0a244f435685c030c39531492d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.854010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.856981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2329/4658] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:18 2022] GET /identity/v3/projects/28248a0a244f435685c030c39531492d => generated 389 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:18.861369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.873464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6df2c3-fc76-43f1-ab62-dae62082a109 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:18.878551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:18.879300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:18.879654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:18.880051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:18.880902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:18.883674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:18.936954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2330/4659] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:18 2022] POST /identity/v3/projects => generated 339 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:18.937918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:18.952018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a15b3-326a-4a39-884e-9af5cfce4648 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.057006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.058398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.058760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.059140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.059952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.062046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.093341 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2330/4660] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:18 2022] GET /identity/v3/projects => generated 6205 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:19.099262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.114345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e766d9e-b6ce-4534-af62-f12718a9e79f tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.121002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.122666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.123024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.124963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects/28248a0a244f435685c030c39531492d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.127410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:get_project(project_id=28248a0a244f435685c030c39531492d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.143140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.146811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2331/4661] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects/28248a0a244f435685c030c39531492d => generated 389 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:19.151152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.192676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5975-ba76-456d-8db3-1b8defb02fcb tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.200960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.202617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.203013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.203366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects/91fa495803b746f1862468114b6c9a32` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.207673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:get_project(project_id=91fa495803b746f1862468114b6c9a32)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.210058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.212532 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2331/4662] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects/91fa495803b746f1862468114b6c9a32 => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:19.218264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.233316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce339a0-7568-49d7-8a89-cd97db48c7f5 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.249243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.250098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.251805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.252355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.253395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.256907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.299712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2332/4663] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects => generated 6205 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:19.301245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.314162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb78f22-15ec-4332-a114-c3b6d1987ce3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.320570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.321280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.321569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.321849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.322739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:19.322982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.325443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.427193 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2332/4664] 10.222.0.18 () {58 vars in 1165 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects?domain_id=default => generated 5874 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:19.431797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.459109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e84df-28b7-48d9-80c3-92e445a1e517 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.481468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.485335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.488327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.489072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.490042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.492168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.537630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.538711 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2333/4665] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects => generated 6205 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:19.561791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea885f-c83e-4c9f-b139-c49e973067fd tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.573550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.574238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.574525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.574806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.575562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:19.575869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.578116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.614430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2333/4666] 10.222.0.18 () {58 vars in 1165 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects?domain_id=default => generated 5874 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:19.615371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.628852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0d40-2cf7-4606-a761-fdab8802dc00 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.634465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.635184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.635477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.636345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.637027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.638959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.696116 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2334/4667] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects => generated 6205 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:19.700089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.735167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ed955-d182-4a18-80df-48d1eb57bd05 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.745028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.748249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.748810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.749320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.750879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1668947619) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:19.752159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.759281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.780669 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2334/4668] 10.222.0.18 () {58 vars in 1231 bytes} [Sat Apr 2 21:05:19 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1668947619 => generated 537 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:19.785589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:19.802555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc02ff-cd62-4b9f-9e4e-747f9de7eda3 tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:19.813490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43378e36781c4dcc8394362eb6ad2f06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dbfe2145dd6421ca5e1518b22baf0e1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:19.816075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:19.817141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:19.817746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] PATH_INFO: `/v3/projects/91fa495803b746f1862468114b6c9a32` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:19.819898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91fa495803b746f1862468114b6c9a32)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:19.830942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:19.934882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fa495803b746f1862468114b6c9a32', 'request_id': 'req-22dff907-6b4b-40cd-b122-d5c404c2769e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:19.949938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fa495803b746f1862468114b6c9a32', 'request_id': 'req-22dff907-6b4b-40cd-b122-d5c404c2769e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:19.974676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fa495803b746f1862468114b6c9a32', 'request_id': 'req-22dff907-6b4b-40cd-b122-d5c404c2769e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:19.996933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] The token cache is being invalidate because project 91fa495803b746f1862468114b6c9a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:19.998189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:19.999691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-22dff907-6b4b-40cd-b122-d5c404c2769e tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.006473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:20.007752 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2335/4669] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:19 2022] DELETE /identity/v3/projects/91fa495803b746f1862468114b6c9a32 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:20.009022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:20.127619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146e76-e343-41a4-8830-912847a13c4d tempest-ListProjectsStaticTestJSON-1774552558 tempest-ListProjectsStaticTestJSON-1774552558-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:20.231327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:20.232811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:20.234175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:20.234463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] PATH_INFO: `/v3/users/3eee5c2841cb41c5801c76916eaf759d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:20.240200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eee5c2841cb41c5801c76916eaf759d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:20.242932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:20.319851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eee5c2841cb41c5801c76916eaf759d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.352270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eee5c2841cb41c5801c76916eaf759d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.353046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eee5c2841cb41c5801c76916eaf759d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.374779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eee5c2841cb41c5801c76916eaf759d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.389083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eee5c2841cb41c5801c76916eaf759d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:20.404377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:20.405113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:20.405890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:20.408779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2335/4670] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:20 2022] DELETE /identity/v3/users/3eee5c2841cb41c5801c76916eaf759d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:20.444928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:20.447863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:20.618464 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2336/4671] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:20.641515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:20.645812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:20.849029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2018651-8f05-4cc3-ac94-553ca3f37a75 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:20.852937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:20.853704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:20.854117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:20.854462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:20.867283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:20.868912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:20.880391 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2336/4672] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:21.502218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:21.503841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:21.525568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbba9d-2c75-4773-82c6-cef1a4dad925 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:21.545240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:21.546403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:21.546879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:21.547316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] PATH_INFO: `/v3/projects/28248a0a244f435685c030c39531492d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:21.550459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28248a0a244f435685c030c39531492d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:21.552616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:21.671923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28248a0a244f435685c030c39531492d', 'request_id': 'req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:21.701981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28248a0a244f435685c030c39531492d', 'request_id': 'req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:21.719541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28248a0a244f435685c030c39531492d', 'request_id': 'req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:21.741643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] The token cache is being invalidate because project 28248a0a244f435685c030c39531492d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:21.742801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:21.746042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:21.752659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2337/4673] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:21 2022] DELETE /identity/v3/projects/28248a0a244f435685c030c39531492d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:21.756864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:21.772828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32441079-b267-4ba1-bea9-6a2f1b05e239 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:21.891532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:21.893151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:21.893642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:21.894382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] PATH_INFO: `/v3/users/43378e36781c4dcc8394362eb6ad2f06` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:21.895816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43378e36781c4dcc8394362eb6ad2f06)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:21.898953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:21.975179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:21.976934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:22.026869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43378e36781c4dcc8394362eb6ad2f06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.058708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43378e36781c4dcc8394362eb6ad2f06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.060159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43378e36781c4dcc8394362eb6ad2f06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.075258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43378e36781c4dcc8394362eb6ad2f06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.086042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43378e36781c4dcc8394362eb6ad2f06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.095782 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2337/4674] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:21 2022] DELETE /identity/v3/users/43378e36781c4dcc8394362eb6ad2f06 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:22.097126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3914266-95d5-4ede-ae2b-acaaaf62ad5d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:22.198055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:22.199231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:22.200186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:22.200692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:22.205790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:22.349081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:22.351916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642f3e-455e-4ebc-9649-3785c0c95c37 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:22.391387 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2338/4675] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:05:22.610717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:22.612557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:22.762115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97260d4-7122-40aa-82b7-f519620ba879 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:22.774416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:22.775930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:22.777412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:22.779525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] PATH_INFO: `/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:22.785311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbfe2145dd6421ca5e1518b22baf0e1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:22.793766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:22.871594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbfe2145dd6421ca5e1518b22baf0e1', 'request_id': 'req-4e8227a0-e86f-4471-9cb6-88490cf00d14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.899130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbfe2145dd6421ca5e1518b22baf0e1', 'request_id': 'req-4e8227a0-e86f-4471-9cb6-88490cf00d14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.911453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbfe2145dd6421ca5e1518b22baf0e1', 'request_id': 'req-4e8227a0-e86f-4471-9cb6-88490cf00d14'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.935631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] The token cache is being invalidate because project 9dbfe2145dd6421ca5e1518b22baf0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:22.936064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.936996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4e8227a0-e86f-4471-9cb6-88490cf00d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:22.939008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2338/4676] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:22 2022] DELETE /identity/v3/projects/9dbfe2145dd6421ca5e1518b22baf0e1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:22.943963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:22.945004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:22.945536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:22.965774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:22.967175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:23.071679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2339/4677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:05:23.083696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.084187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.084832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.126913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:23.128512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:23.144986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2339/4678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:23.145637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.162133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616703-70a1-40eb-8532-710f5f927f7b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.173026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.173986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.175415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.175862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.177322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:23.177821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.181346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.216030 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2340/4679] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:23.219739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.235913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca5c8a-79d9-44fd-8509-e6cdcc15432f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.246689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.248117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.251100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.251600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.252409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.255703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.315508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2340/4680] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:23 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:23.316067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.330851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69108f-c772-49eb-8956-6cb1e31e4c59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.464547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.465930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.466460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.467077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.468039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.471449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.506801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.512529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2341/4681] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:23 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:23.538909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec9507-99bd-432b-a7a9-ae699a4748df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.552608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.553309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.553599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.553885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.554655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.556257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.599401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2341/4682] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:23.607108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.636683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e98c-870b-4dac-910e-be47f295c544 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.651855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.653804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.656442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.656841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.657669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.659881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1519f48-b2d3-4cb1-86c7-040f3ca27ad6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.686862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2342/4683] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:23.691018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:23.707743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1bd5-d68a-4fed-8846-9f31ea6727e5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:23.721000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:23.723117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.723599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.723897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] PATH_INFO: `/v3/projects/4400c8f4daad450a989e0f6bb0330746/users/2fcdc4c3623443a59dcd9fa32eb1eb38/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.790672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4400c8f4daad450a989e0f6bb0330746, user_id=2fcdc4c3623443a59dcd9fa32eb1eb38, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:23.795394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:23.821798 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2342/4684] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:23 2022] PUT /identity/v3/projects/4400c8f4daad450a989e0f6bb0330746/users/2fcdc4c3623443a59dcd9fa32eb1eb38/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:23.921353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:23.921656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:23.921938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:23.954385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] MFA Rules not processed for user `2fcdc4c3623443a59dcd9fa32eb1eb38`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:23.956826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:24.055552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2343/4685] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:24.060789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.177553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44bc88-44e6-4cf7-b5fd-a8dd4027a398 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.184082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.193332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.193928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.194528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.195353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.205000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.280723 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2343/4686] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:24 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:24.281858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.295716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203dfc-3414-4a3e-b8a6-6da5d282c061 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.436970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.437662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.437951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.438457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.439151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.441141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.473501 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2344/4687] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:24 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:24.477168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.506857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe45b09-5e85-471e-8ee2-760ce4b35c87 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.528848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.529552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.529839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.530165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.531125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.533115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.546383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2344/4688] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:24.550379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.562655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d802f7-59c8-449f-a361-94e9b34a35f3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.568267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.569593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.569965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.570333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] PATH_INFO: `/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554/users/af83af0a45a44551afc0d0fdd1d8590d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.589861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6c9963eef4ec5ab15bc57e8af4554, user_id=af83af0a45a44551afc0d0fdd1d8590d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.593059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.612182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2345/4689] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:24 2022] PUT /identity/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554/users/af83af0a45a44551afc0d0fdd1d8590d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:24.613684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.629431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7400-fa02-4753-91ef-9a984dad51d8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.741889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.743004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.743285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.743564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.744809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.746966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81bfef-79a2-4a60-b46e-4bcbe5eee59c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.762358 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2345/4690] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:24.765708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.781467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a5f40-945e-4b3f-996d-2027aa8a742c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:24.788441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:24.789370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.789653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.789930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] PATH_INFO: `/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554/users/af83af0a45a44551afc0d0fdd1d8590d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.792969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6c9963eef4ec5ab15bc57e8af4554, user_id=af83af0a45a44551afc0d0fdd1d8590d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:24.795531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:24.819751 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2346/4691] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:24 2022] PUT /identity/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554/users/af83af0a45a44551afc0d0fdd1d8590d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:24.824489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:24.825036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:24.825036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:24.871061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] MFA Rules not processed for user `af83af0a45a44551afc0d0fdd1d8590d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:24.872939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:24.964340 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2346/4692] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:24.966964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:24.991108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb806a0d-9e81-4233-b899-e6d2f6360f90 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.018550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.020288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.020869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.022797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.024746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.027589 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.027589 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:25.027589 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:25.028892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.068178 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2347/4693] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Apr 2 21:05:24 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:25.068380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.079036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f44b1-22b5-4fca-a6b7-d43b3327c83c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.095837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.096730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.097017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.097298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/968b1b271d664e52b6a0930e001b559d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.104406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=968b1b271d664e52b6a0930e001b559d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.110601 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.110601 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:25.110601 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:25.112155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.142497 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2347/4694] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:05:25 2022] GET /identity/v3/OS-OAUTH1/consumers/968b1b271d664e52b6a0930e001b559d => generated 220 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:25.145338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.165835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622477-df19-4a9e-9749-f2d01ef46ca2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.178004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.180064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.181304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.181676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/968b1b271d664e52b6a0930e001b559d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.183092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=968b1b271d664e52b6a0930e001b559d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.187829 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.187829 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:25.187829 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:25.190348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.191183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer 968b1b271d664e52b6a0930e001b559d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:25.192887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.194892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.248554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '968b1b271d664e52b6a0930e001b559d', 'request_id': 'req-851d339b-37d2-4b57-872a-406c82df74d4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.283528 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2348/4695] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/968b1b271d664e52b6a0930e001b559d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:25.288237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.290314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:25.318558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd3537-eec0-4cfc-a296-3bcaceca38fe tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.329043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.329916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.330272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.330569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.331326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.332439 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.332439 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:25.332439 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:25.339837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.367175 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2348/4696] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Apr 2 21:05:25 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:25.371403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.383426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d339b-37d2-4b57-872a-406c82df74d4 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.398119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.400804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.401206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.404203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.404901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2a1a92a655fb4a2392d0fe7882991d5e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.406393 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.406393 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:25.406393 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:25.409617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.421079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2349/4697] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:05:25 2022] GET /identity/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e => generated 221 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:25.425411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.450631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900de85-8fad-48f5-8478-8f7a09dabd71 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.458416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.459364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.459974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.460351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.461131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2a1a92a655fb4a2392d0fe7882991d5e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.462253 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.462253 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:25.462253 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:25.466379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.466379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer 2a1a92a655fb4a2392d0fe7882991d5e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:25.466379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.469561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.520280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2a1a92a655fb4a2392d0fe7882991d5e', 'request_id': 'req-fb21ca53-8407-4bf1-afe9-e876764ab873'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.540126 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2349/4698] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:25.544089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.546307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:25.571329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c71e9-c13a-4d8f-a04d-73e555bfb28f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.588270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.589193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.589480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.589765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.590403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2a1a92a655fb4a2392d0fe7882991d5e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.592130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.618622 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 02 21:05:25.624994 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2350/4699] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:05:25 2022] GET /identity/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e => generated 74 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:05:25.629910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.653729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21ca53-8407-4bf1-afe9-e876764ab873 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.660683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.661529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.661907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.662090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.662741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2a1a92a655fb4a2392d0fe7882991d5e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.671039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.671293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer 2a1a92a655fb4a2392d0fe7882991d5e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:25.671577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.672365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.697861 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 02 21:05:25.710395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2350/4700] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2a1a92a655fb4a2392d0fe7882991d5e => generated 74 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:05:25.714552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.716413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:25.740581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea359932-9a35-44d1-8b87-cf00e0512eba tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.747380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.748624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.748917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.749195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.749920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.751946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.782886 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2351/4701] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Apr 2 21:05:25 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:25.786603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.800146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d138-9cb3-4e66-905b-7bd4bb8dd8b2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.806002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.806793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.807333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.808242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.809096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.810839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.840537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2351/4702] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Apr 2 21:05:25 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:25.844768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.859404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ef1d0-82de-4746-8d42-d2d833c69113 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.865000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.865874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.866672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.867104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.867854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.869194 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:25.869194 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:25.869194 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:25.871057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.878563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2352/4703] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Apr 2 21:05:25 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:25.882341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.894490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f9f7-70bc-4f5e-87be-9651c12c07f2 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.900275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.901514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.901971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.902409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0c50aada700743359f113dc562260c7e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:25.903225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0c50aada700743359f113dc562260c7e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:25.905022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:25.905477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer 0c50aada700743359f113dc562260c7e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:25.905923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.906848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.929108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0c50aada700743359f113dc562260c7e', 'request_id': 'req-9d3eae8c-b637-450e-b161-483b4018e402'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:25.954320 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2352/4704] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0c50aada700743359f113dc562260c7e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:25.958723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:25.965132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:25.986464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087d39-bf22-444c-bdec-82362b5b2838 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:25.992113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:25.997479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:25.998932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:25.999413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/21c32ae255694b61a3567c0641fb9974` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.000285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=21c32ae255694b61a3567c0641fb9974)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.002153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.002738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer 21c32ae255694b61a3567c0641fb9974 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:26.003212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.004139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.021207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '21c32ae255694b61a3567c0641fb9974', 'request_id': 'req-5e687345-9238-4875-8ba0-21386786c06f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.049618 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2353/4705] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/21c32ae255694b61a3567c0641fb9974 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:26.054366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.077276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3eae8c-b637-450e-b161-483b4018e402 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:26.101428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:26.106243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.106598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.106820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.107552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.120141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.151995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2353/4706] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Apr 2 21:05:26 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:26.157513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.160896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:26.188843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687345-9238-4875-8ba0-21386786c06f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:26.197114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:26.198761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.199348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.200196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.201165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=b1f7098a51524452aa3a1e64b22123f4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.203216 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:26.203216 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:26.203216 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:26.205172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.234990 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2354/4707] 10.222.0.18 () {60 vars in 1284 bytes} [Sat Apr 2 21:05:26 2022] PATCH /identity/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4 => generated 221 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:26.236430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.248071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0d65-95b5-4e3d-99c0-955e71ae86e3 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:26.256482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:26.257887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.258178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.258509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.259177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b1f7098a51524452aa3a1e64b22123f4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.260939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.269179 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2354/4708] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:05:26 2022] GET /identity/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4 => generated 221 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:26.270308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.285229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d19018-e51a-461e-b135-778d129dc9de tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:26.290467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af83af0a45a44551afc0d0fdd1d8590d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:26.291661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.292020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.292834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.293564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b1f7098a51524452aa3a1e64b22123f4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.295214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.295487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invalidating token cache because consumer b1f7098a51524452aa3a1e64b22123f4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:26.295760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.296484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.330546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c420056b-eea1-4157-9ac5-12e8263444c1 tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b1f7098a51524452aa3a1e64b22123f4', 'request_id': 'req-c420056b-eea1-4157-9ac5-12e8263444c1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.370777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2355/4709] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:05:26 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b1f7098a51524452aa3a1e64b22123f4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:26.376105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.378224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:26.546083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b5f1-12dd-40cf-a2e5-136f2eada43f tempest-OAUTHConsumersV3Test-1213646332 tempest-OAUTHConsumersV3Test-1213646332-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:26.553188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:26.554539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.554764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.555201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] PATH_INFO: `/v3/users/2fcdc4c3623443a59dcd9fa32eb1eb38` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.557655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcdc4c3623443a59dcd9fa32eb1eb38)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:26.558804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:26.682225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcdc4c3623443a59dcd9fa32eb1eb38'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.705217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcdc4c3623443a59dcd9fa32eb1eb38'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.706175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcdc4c3623443a59dcd9fa32eb1eb38'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.721801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcdc4c3623443a59dcd9fa32eb1eb38'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.742433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcdc4c3623443a59dcd9fa32eb1eb38'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:26.762503 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2355/4710] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:26 2022] DELETE /identity/v3/users/2fcdc4c3623443a59dcd9fa32eb1eb38 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:26.764558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:26.764851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:26.765135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:26.799550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:26.800842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:26.967956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2356/4711] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:26.978990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:26.981229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:27.186770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0d5c-d5d2-44c1-a627-4aad943fd06c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:27.194041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:27.195029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:27.195534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:27.200168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:27.220989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:27.223212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:27.248864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2356/4712] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:27.775334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:27.777893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:27.804155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466d7d2-e2e7-43c8-93cf-4ff055d3d178 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:27.821679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:27.822519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:27.822787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:27.823065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] PATH_INFO: `/v3/projects/4400c8f4daad450a989e0f6bb0330746` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:27.825822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4400c8f4daad450a989e0f6bb0330746)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:27.827835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:27.921888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4400c8f4daad450a989e0f6bb0330746', 'request_id': 'req-0f834543-0f90-4f17-aab1-70816bdd8a61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:27.929713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4400c8f4daad450a989e0f6bb0330746', 'request_id': 'req-0f834543-0f90-4f17-aab1-70816bdd8a61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:27.950609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4400c8f4daad450a989e0f6bb0330746', 'request_id': 'req-0f834543-0f90-4f17-aab1-70816bdd8a61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:27.985410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] The token cache is being invalidate because project 4400c8f4daad450a989e0f6bb0330746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:27.985985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:27.989115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:27.991710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2357/4713] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:27 2022] DELETE /identity/v3/projects/4400c8f4daad450a989e0f6bb0330746 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:27.996513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:28.011921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fd7f3-4e30-4822-9bb1-3467a1f726c9 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:28.112196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:28.113391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:28.113838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:28.114300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] PATH_INFO: `/v3/users/af83af0a45a44551afc0d0fdd1d8590d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:28.115707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af83af0a45a44551afc0d0fdd1d8590d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:28.117829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:28.202366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af83af0a45a44551afc0d0fdd1d8590d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:28.221310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af83af0a45a44551afc0d0fdd1d8590d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:28.222473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af83af0a45a44551afc0d0fdd1d8590d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:28.257752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af83af0a45a44551afc0d0fdd1d8590d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:28.273023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa988de2-287e-473a-b0ad-e486b269e757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af83af0a45a44551afc0d0fdd1d8590d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:28.281108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2357/4714] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:27 2022] DELETE /identity/v3/users/af83af0a45a44551afc0d0fdd1d8590d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:29.347657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:29.352992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:29.382230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834543-0f90-4f17-aab1-70816bdd8a61 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:29.488562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:29.489497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:29.489784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:29.490273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] PATH_INFO: `/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:29.491680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf6c9963eef4ec5ab15bc57e8af4554)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:29.494447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:29.591781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'request_id': 'req-01dd13ef-e11a-469e-a80c-744282b8e8d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:29.605487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'request_id': 'req-01dd13ef-e11a-469e-a80c-744282b8e8d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:29.622548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf6c9963eef4ec5ab15bc57e8af4554', 'request_id': 'req-01dd13ef-e11a-469e-a80c-744282b8e8d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:29.638869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] The token cache is being invalidate because project eaf6c9963eef4ec5ab15bc57e8af4554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:29.639627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:29.640682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01dd13ef-e11a-469e-a80c-744282b8e8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:29.643883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2358/4715] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:29 2022] DELETE /identity/v3/projects/eaf6c9963eef4ec5ab15bc57e8af4554 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:29.648895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:29.649778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:29.650203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:29.676649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:29.678410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:29.758196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2358/4716] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:29.766735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:29.767503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:29.767751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:29.799354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:29.806233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:29.817736 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2359/4717] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:29.821789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:29.834379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5a84-9bf0-4e67-8d3f-c2ed30f675f6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:29.841105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:29.842073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:29.842612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:29.843154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:29.844210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:29.845072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:29.847770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:29.864386 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2359/4718] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:29.868573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:29.892359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eedda-a94f-49b7-b101-0773bdaa0dad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:29.899524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:29.900359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:29.900686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:29.900970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:29.902602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:29.904594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:29.943476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2360/4719] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:29 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:29.947971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:29.961603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b31bd-d366-469b-9956-3fa88e11dead admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.041023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.042578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.042961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.043239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.044139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.046516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.089070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2360/4720] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:29 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:30.090784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.106562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e90265-a0e2-4ef9-b2e2-634cf89dc54f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.126896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.128430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.129216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.129976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.130575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.132291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.150248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2361/4721] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:30.155324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.180427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421e25f-c8ee-45d4-9784-6531713daea2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.186673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.187439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.187729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.188073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.188940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.190877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f42dd-cbd6-4839-ad26-13fe299e13d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.211973 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2361/4722] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:30.213280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.223603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbaba-de49-4d36-ac35-c4b1985a3dfe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.228165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.229114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.229431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.229708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] PATH_INFO: `/v3/projects/d8e7dce91bdc4b71a6e59902fb1b3a6e/users/959c88ae2194462cbc09b93e2f2dbdff/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.245756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e7dce91bdc4b71a6e59902fb1b3a6e, user_id=959c88ae2194462cbc09b93e2f2dbdff, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.248681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.263104 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2362/4723] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:30 2022] PUT /identity/v3/projects/d8e7dce91bdc4b71a6e59902fb1b3a6e/users/959c88ae2194462cbc09b93e2f2dbdff/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:30.274926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.275181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.275575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.302677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] MFA Rules not processed for user `959c88ae2194462cbc09b93e2f2dbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:30.304005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:30.374726 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2362/4724] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:30.379363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.449493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cc13f-ad79-4a5a-804c-fea82d69e959 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.454473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.455159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.455445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.455728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.456418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.458367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.486054 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2363/4725] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:30 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:30.490227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.503424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1dea-1e03-438a-8074-fdf25ea3856d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.561200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.562080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.562369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.562647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.563628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.565533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.590789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2363/4726] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:30 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:30.592349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.604934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737deaf9-2824-41b6-b742-8a8694c4e514 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.610590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.611558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.612053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.612514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.613459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.615441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.630823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2364/4727] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:30.632200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.654428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0e79-6c28-4405-8607-0d2041b87ab9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.660151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.661516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.661942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.662230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] PATH_INFO: `/v3/projects/67d8f0026de04a318a78ef0faaee8281/users/ac5659f6209b47ec8f2eac34e5466724/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.681691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d8f0026de04a318a78ef0faaee8281, user_id=ac5659f6209b47ec8f2eac34e5466724, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.685430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.700225 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2364/4728] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:30 2022] PUT /identity/v3/projects/67d8f0026de04a318a78ef0faaee8281/users/ac5659f6209b47ec8f2eac34e5466724/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:30.704186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.715989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad4818-bedf-4a62-9ed3-f7108c902276 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.808267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.808999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.809287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.809570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.810298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.811910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d67ba7-6dca-4ee9-b124-ab0947faf632 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.828327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:30.836503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2365/4729] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:30.842177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d2fdc-e3dd-456a-a94d-4e330e6b5da1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:30.847700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:30.855756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.856269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.856789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] PATH_INFO: `/v3/projects/67d8f0026de04a318a78ef0faaee8281/users/ac5659f6209b47ec8f2eac34e5466724/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.859852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d8f0026de04a318a78ef0faaee8281, user_id=ac5659f6209b47ec8f2eac34e5466724, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:30.862721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:30.888937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2365/4730] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:30 2022] PUT /identity/v3/projects/67d8f0026de04a318a78ef0faaee8281/users/ac5659f6209b47ec8f2eac34e5466724/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:30.893989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:30.894645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:30.895124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:30.966595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] MFA Rules not processed for user `ac5659f6209b47ec8f2eac34e5466724`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:30.967822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:31.075627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2366/4731] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:31.080562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.094261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1ad4-4c7a-4546-bd4c-5c7c75877399 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.101706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.102522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.102913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.103299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.105210 ncdv-master-1 devstack@keystone.service[97316]: WARNING oslo_log.versionutils [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.105869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.107208 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.107208 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:31.107208 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:31.108375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.129942 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2366/4732] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:31 2022] POST /identity/v3/policies => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:31.134266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.145176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f752-40fe-4216-811f-a784e1ed9254 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.151859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.153170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.153441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.153821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/87cb68f66cf94589bc0b79df03de7f88` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.154912 ncdv-master-1 devstack@keystone.service[97317]: WARNING oslo_log.versionutils [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.155553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=87cb68f66cf94589bc0b79df03de7f88)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.157056 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.157056 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:31.157056 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:31.158691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.194094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2367/4733] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 21:05:31 2022] PATCH /identity/v3/policies/87cb68f66cf94589bc0b79df03de7f88 => generated 235 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:31.195636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.213388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659fe84-ccb8-481d-a49e-0ed41eaa793e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.224760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.225659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.226124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.226551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/87cb68f66cf94589bc0b79df03de7f88` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.227540 ncdv-master-1 devstack@keystone.service[97316]: WARNING oslo_log.versionutils [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.228795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=87cb68f66cf94589bc0b79df03de7f88)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.231336 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.231336 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:31.231336 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:31.233133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.255827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2367/4734] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:31 2022] GET /identity/v3/policies/87cb68f66cf94589bc0b79df03de7f88 => generated 235 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:31.260253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.277216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ad53f-0755-406d-8abd-4b81cbfbe35b tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.284625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.285871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.286312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.287155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/87cb68f66cf94589bc0b79df03de7f88` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.288489 ncdv-master-1 devstack@keystone.service[97317]: WARNING oslo_log.versionutils [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.289435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=87cb68f66cf94589bc0b79df03de7f88)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.291035 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.291035 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:31.291035 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:31.292275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.318688 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2368/4735] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:31 2022] DELETE /identity/v3/policies/87cb68f66cf94589bc0b79df03de7f88 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:31.324188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.341302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874cc00-8f1e-458f-a861-0c25bfe354c2 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.347803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.348844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.349305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.349610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.351205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.353229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.375741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2368/4736] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:31 2022] POST /identity/v3/policies => generated 229 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:31.379705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.398150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1f18e-26ec-41fa-8514-b2be71712b2e tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.407560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.408557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.409033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.409477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.410585 ncdv-master-1 devstack@keystone.service[97317]: WARNING oslo_log.versionutils [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.411322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.412777 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.412777 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:31.412777 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:31.413995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.437641 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2369/4737] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:31 2022] POST /identity/v3/policies => generated 229 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:31.442218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.457785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907612d4-5af5-4c33-930c-9d9d76a8c955 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.464382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.465336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.465626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.465949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.467909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.469966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.490957 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2369/4738] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:31 2022] POST /identity/v3/policies => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:31.495627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.507140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df20766-ad9d-48ae-9176-8db2e383691d tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.512561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.513224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.513506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.513809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.514607 ncdv-master-1 devstack@keystone.service[97317]: WARNING oslo_log.versionutils [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.515201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.516632 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.516632 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:31.516632 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:31.518385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.527147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2370/4739] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:31 2022] GET /identity/v3/policies => generated 763 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:31.532080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.543196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0054ce-b883-44d9-82c8-5ada820b1760 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.548389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.549377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.549741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.550112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/3bd64a1016ea434fbf1ab9516805bd21` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.550952 ncdv-master-1 devstack@keystone.service[97316]: WARNING oslo_log.versionutils [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 02 21:05:31.551646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3bd64a1016ea434fbf1ab9516805bd21)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.552980 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:31.552980 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:31.552980 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:31.554271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.577538 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2370/4740] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:31 2022] DELETE /identity/v3/policies/3bd64a1016ea434fbf1ab9516805bd21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:31.581873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.592717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90508cdc-7ef2-43c9-ae59-97667020b2ee tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.599409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.599409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.599409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.599756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/5ff0868a6ab5429f98e9c5784e60ae5d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.600830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=5ff0868a6ab5429f98e9c5784e60ae5d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.602312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.618714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2371/4741] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:31 2022] DELETE /identity/v3/policies/5ff0868a6ab5429f98e9c5784e60ae5d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:31.623731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.635355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2416e3-4a8c-4c14-9880-1d81f0d9662a tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.641228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac5659f6209b47ec8f2eac34e5466724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67d8f0026de04a318a78ef0faaee8281', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.642307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.642666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.643014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] PATH_INFO: `/v3/policies/ea0c5bb9de31411ba167cbde0d2f40dc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.644208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ea0c5bb9de31411ba167cbde0d2f40dc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.646133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54a4b-0ce0-45bb-854e-417cdef86990 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.665585 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2371/4742] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:31 2022] DELETE /identity/v3/policies/ea0c5bb9de31411ba167cbde0d2f40dc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:31.671547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:31.746065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d85479-46e9-4b77-878e-c5c01d909d06 tempest-PoliciesTestJSON-237793852 tempest-PoliciesTestJSON-237793852-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:31.752440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:31.753660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.754378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.755395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] PATH_INFO: `/v3/users/959c88ae2194462cbc09b93e2f2dbdff` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.757077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=959c88ae2194462cbc09b93e2f2dbdff)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:31.759343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:31.822084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959c88ae2194462cbc09b93e2f2dbdff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:31.834361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959c88ae2194462cbc09b93e2f2dbdff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:31.835087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959c88ae2194462cbc09b93e2f2dbdff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:31.836018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959c88ae2194462cbc09b93e2f2dbdff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:31.844395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959c88ae2194462cbc09b93e2f2dbdff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:31.867046 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2372/4743] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:31 2022] DELETE /identity/v3/users/959c88ae2194462cbc09b93e2f2dbdff => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:31.871846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:31.872319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:31.872693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:31.912125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:31.914006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:32.056853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2372/4744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:32.067303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:32.069038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:32.171384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41471a87-b128-4266-889e-a2aa4e2e5afc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:32.186726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:32.187399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:32.188147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:32.188147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:32.201227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:32.203010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:32.222422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2373/4745] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:33.440797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:33.443254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:33.465947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d823-b72b-4813-857b-322525b3e92a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:33.472288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:33.473978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:33.474265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:33.474543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] PATH_INFO: `/v3/projects/d8e7dce91bdc4b71a6e59902fb1b3a6e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:33.476826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e7dce91bdc4b71a6e59902fb1b3a6e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:33.480279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:33.558379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e7dce91bdc4b71a6e59902fb1b3a6e', 'request_id': 'req-d343ada2-fdd0-47a1-aefd-1f74f17784ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.566289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e7dce91bdc4b71a6e59902fb1b3a6e', 'request_id': 'req-d343ada2-fdd0-47a1-aefd-1f74f17784ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.574294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e7dce91bdc4b71a6e59902fb1b3a6e', 'request_id': 'req-d343ada2-fdd0-47a1-aefd-1f74f17784ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.599763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] The token cache is being invalidate because project d8e7dce91bdc4b71a6e59902fb1b3a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:33.600520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.601391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.604810 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2373/4746] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:33 2022] DELETE /identity/v3/projects/d8e7dce91bdc4b71a6e59902fb1b3a6e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:33.608698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:33.625136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77ad2-4145-4310-8e55-4d154b15762a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:33.690758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:33.692012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:33.692369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:33.692744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] PATH_INFO: `/v3/users/ac5659f6209b47ec8f2eac34e5466724` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:33.694180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5659f6209b47ec8f2eac34e5466724)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:33.696176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:33.755789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5659f6209b47ec8f2eac34e5466724'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.771984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5659f6209b47ec8f2eac34e5466724'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.772782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5659f6209b47ec8f2eac34e5466724'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.773466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5659f6209b47ec8f2eac34e5466724'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.781544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5beb1c1-692c-4c91-96f4-12073b8e4751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5659f6209b47ec8f2eac34e5466724'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:33.815918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2374/4747] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:33 2022] DELETE /identity/v3/users/ac5659f6209b47ec8f2eac34e5466724 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:34.133364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.135436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:34.159006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343ada2-fdd0-47a1-aefd-1f74f17784ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.242761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.243925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.244385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.245483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] PATH_INFO: `/v3/projects/67d8f0026de04a318a78ef0faaee8281` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.246869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d8f0026de04a318a78ef0faaee8281)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.249667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.302601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d8f0026de04a318a78ef0faaee8281', 'request_id': 'req-c6e8d0a1-a361-4f84-a0e4-522676217552'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:34.314092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d8f0026de04a318a78ef0faaee8281', 'request_id': 'req-c6e8d0a1-a361-4f84-a0e4-522676217552'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:34.321154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d8f0026de04a318a78ef0faaee8281', 'request_id': 'req-c6e8d0a1-a361-4f84-a0e4-522676217552'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:34.342253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] The token cache is being invalidate because project 67d8f0026de04a318a78ef0faaee8281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:34.342563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:34.343426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c6e8d0a1-a361-4f84-a0e4-522676217552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:34.345962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2374/4748] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:34 2022] DELETE /identity/v3/projects/67d8f0026de04a318a78ef0faaee8281 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:34.352546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.352851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.353111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.393634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:34.397603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:34.490476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2375/4749] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:34.498452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.499266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.499551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.537251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:34.538530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:34.557404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2375/4750] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:34.559876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.574389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4365a0-9348-4a3d-8459-6cd96afbb000 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.579986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.580730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.581096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.581448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.582314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:34.582716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.584546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.602464 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2376/4751] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:34.608161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.621201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc3f08-4716-4fa2-a96c-bf8e45ce7b87 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.628940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.629900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.630335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.630965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.632170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.637834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.689650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2376/4752] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:34 2022] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:34.690269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.706506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2825-d2b6-4a35-afba-5d88913b30e3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.795149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.795846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.796324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.796782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.797609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.799805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.828818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2377/4753] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:34 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:34.832604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.849245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7682fb-3cde-499a-9d70-7b366ae73cbf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.863883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.864632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.864925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.865208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.865943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.879014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.895169 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2377/4754] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:34.896498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.910189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6059946-2f17-44af-b892-99dce5961d42 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.915324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.916115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.916412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.916919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.917646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.920493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a2d2-dbf0-4717-99f3-0ab834ad77ea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:34.934587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2378/4755] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:34.938741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:34.956673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab57d14-e48a-4fd1-b52d-a0432a17d49b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:34.961801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:34.962698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:34.963287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:34.964496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] PATH_INFO: `/v3/projects/bacdf43407bc4bfbbd2fe635a59386a1/users/8a41e7e91d6d4f5ca253e9325797d425/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:34.985221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacdf43407bc4bfbbd2fe635a59386a1, user_id=8a41e7e91d6d4f5ca253e9325797d425, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:34.988544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.008619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2378/4756] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:34 2022] PUT /identity/v3/projects/bacdf43407bc4bfbbd2fe635a59386a1/users/8a41e7e91d6d4f5ca253e9325797d425/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:35.027812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.027812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.027812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.064831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] MFA Rules not processed for user `8a41e7e91d6d4f5ca253e9325797d425`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:35.065911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:35.147477 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2379/4757] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:35.148747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.239217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea1182-0fe1-4e8a-b93b-2224a91bcdb0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.247832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.249403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.249820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.250714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.252281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.255397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.306379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.316766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2379/4758] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:35 2022] POST /identity/v3/projects => generated 395 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:35.322411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33b8ee-9665-49e2-83ff-9573e5e244b5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.429503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.430569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.431080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.431604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.433088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.436494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.477641 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2380/4759] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:35 2022] POST /identity/v3/users => generated 304 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:35.482623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.498060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c6f3-14ce-4a23-8859-e3eb3987813a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.517536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.518164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.518434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.518715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.519502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.521227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.537174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2380/4760] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:35.541412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.556922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1165c7-6da2-4ad5-9fa1-f040f0f691ef admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.570591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.571576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.571785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.572059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] PATH_INFO: `/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a/users/282b9564f65041c1873a9f831c592c74/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.598740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667c0d04dd7a4c25adb295f72f2fb85a, user_id=282b9564f65041c1873a9f831c592c74, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.602485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.625103 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2381/4761] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:35 2022] PUT /identity/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a/users/282b9564f65041c1873a9f831c592c74/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:35.631309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.668623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6079a5a-4ac0-4265-8ab7-3213046fb1b2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.763044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.764493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.765783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.766047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.767151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.769065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b85f-625f-4bbc-8efd-2be4f0295898 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.789018 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2381/4762] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:35.790506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.805315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd9caf-5cec-493d-8368-3d04cc305190 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:35.814158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:35.827240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.827632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.827823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] PATH_INFO: `/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a/users/282b9564f65041c1873a9f831c592c74/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.847965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=667c0d04dd7a4c25adb295f72f2fb85a, user_id=282b9564f65041c1873a9f831c592c74, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:35.850681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:35.890206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2382/4763] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:35 2022] PUT /identity/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a/users/282b9564f65041c1873a9f831c592c74/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:35.891786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:35.892541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:35.893041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:35.902486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:35.905403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:35.959625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] MFA Rules not processed for user `282b9564f65041c1873a9f831c592c74`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:35.965193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:36.075239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca37-e557-4cc1-a620-dc43f10f7c9a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.079221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.080130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.080535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.081037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.083322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:36.086858 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2382/4764] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:36.091672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.182609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a6520-c8df-4e6a-9f44-6ab6d52916c1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.187198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a41e7e91d6d4f5ca253e9325797d425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bacdf43407bc4bfbbd2fe635a59386a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.187871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.188162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.188448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.189280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.196604 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Apr 02 21:05:36.203101 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2383/4765] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:36 2022] POST /identity/v3/projects => generated 136 bytes in 112 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:05:36.204015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.207469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.209946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.216013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae249f9-6549-46a3-bec8-28c71e045bfc tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.220864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.221531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.221822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.222471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.223319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.225537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.233744 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invalid input for field 'name': '' is too short Apr 02 21:05:36.233744 ncdv-master-1 devstack@keystone.service[97316]: Failed validating 'minLength' in schema['properties']['name']: Apr 02 21:05:36.233744 ncdv-master-1 devstack@keystone.service[97316]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 02 21:05:36.233744 ncdv-master-1 devstack@keystone.service[97316]: On instance['name']: Apr 02 21:05:36.233744 ncdv-master-1 devstack@keystone.service[97316]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 02 21:05:36.239258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2384/4767] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:36 2022] POST /identity/v3/projects => generated 283 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:36.240138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.241961 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2383/4767] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:36.253542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097bcfd-079e-4a12-886a-d9bd65e3e1dd tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.265077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.265941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.267773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.268063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.268967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.277351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.301572 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 02 21:05:36.301572 ncdv-master-1 devstack@keystone.service[97316]: Failed validating 'maxLength' in schema['properties']['name']: Apr 02 21:05:36.301572 ncdv-master-1 devstack@keystone.service[97316]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 02 21:05:36.301572 ncdv-master-1 devstack@keystone.service[97316]: On instance['name']: Apr 02 21:05:36.301572 ncdv-master-1 devstack@keystone.service[97316]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 02 21:05:36.309633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2385/4768] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:36 2022] POST /identity/v3/projects => generated 412 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:05:36.310703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.336901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9197-011e-4adf-b9e0-ded1e2210ac0 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.363631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.364680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.365061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.365418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects/5d4bcb3146cc4a22b346b2327d935d06` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.377116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d4bcb3146cc4a22b346b2327d935d06)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.379861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.380446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.388070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:36.403323 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Could not find project: 5d4bcb3146cc4a22b346b2327d935d06.: keystone.exception.ProjectNotFound: Could not find project: 5d4bcb3146cc4a22b346b2327d935d06. Apr 02 21:05:36.412639 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2384/4769] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:36 2022] DELETE /identity/v3/projects/5d4bcb3146cc4a22b346b2327d935d06 => generated 113 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:05:36.413970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.449787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1501003-041d-4225-bac8-5bd26d2024fe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.467382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a41e7e91d6d4f5ca253e9325797d425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bacdf43407bc4bfbbd2fe635a59386a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.469213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.470450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.470976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.474221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.505703 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Apr 02 21:05:36.513565 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2385/4770] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:05:36 2022] GET /identity/v3/projects => generated 135 bytes in 100 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:05:36.518864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.533650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc25295-2caf-43ac-b43a-bd4114e3aebe tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.536352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b8945-1b60-4060-98d3-a3cd8cdb265a tempest-ProjectsNegativeStaticTestJSON-1702907120 tempest-ProjectsNegativeStaticTestJSON-1702907120-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.539671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.540570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.541043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.542815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.543628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.544517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.544824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.545372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.546331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.548146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:36.548869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.566946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.569157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.597784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2386/4771] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:36.598322 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2386/4772] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:36 2022] POST /identity/v3/projects => generated 359 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:36.602838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.633615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7781f-f030-44ec-9434-98c472d46f95 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.718887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.719755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.720198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.720663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.721871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.724145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.747540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.sql.core [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1971762626' for key 'project.ixu_project_name_domain_id'") Apr 02 21:05:36.747540 ncdv-master-1 devstack@keystone.service[97316]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 02 21:05:36.747540 ncdv-master-1 devstack@keystone.service[97316]: [parameters: {'id': '3613a10035ee4d71b54423b570bfdc8e', 'name': 'tempest-project-dup-1971762626', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 02 21:05:36.747540 ncdv-master-1 devstack@keystone.service[97316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 02 21:05:36.754880 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1971762626, project id 3613a10035ee4d71b54423b570bfdc8e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1971762626, project id 3613a10035ee4d71b54423b570bfdc8e. Apr 02 21:05:36.756619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2387/4773] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:05:36 2022] POST /identity/v3/projects => generated 285 bytes in 154 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:05:36.761432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.777638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec8884-e4e3-4d6b-bcca-8c7432c36b62 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:36.789914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '282b9564f65041c1873a9f831c592c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '667c0d04dd7a4c25adb295f72f2fb85a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:36.790813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:36.791289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:36.791366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] PATH_INFO: `/v3/projects/8266acae41144c8890da67962c118425` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:36.792839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8266acae41144c8890da67962c118425)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:36.794948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:36.889808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8266acae41144c8890da67962c118425', 'request_id': 'req-0393cb98-453c-44c8-bc37-57fb0e12b589'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:36.899193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8266acae41144c8890da67962c118425', 'request_id': 'req-0393cb98-453c-44c8-bc37-57fb0e12b589'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:36.920567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8266acae41144c8890da67962c118425', 'request_id': 'req-0393cb98-453c-44c8-bc37-57fb0e12b589'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:36.940661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] The token cache is being invalidate because project 8266acae41144c8890da67962c118425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:36.940878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:36.942033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0393cb98-453c-44c8-bc37-57fb0e12b589 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:36.971774 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2387/4774] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:36 2022] DELETE /identity/v3/projects/8266acae41144c8890da67962c118425 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:36.973306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:36.975329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:37.101771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee7ef-1c02-44df-b7fa-92b38c9f0a17 tempest-ProjectsNegativeStaticTestJSON-643802854 tempest-ProjectsNegativeStaticTestJSON-643802854-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:37.213200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:37.214140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:37.214398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:37.214676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] PATH_INFO: `/v3/users/8a41e7e91d6d4f5ca253e9325797d425` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:37.215907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a41e7e91d6d4f5ca253e9325797d425)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:37.218685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:37.319285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a41e7e91d6d4f5ca253e9325797d425'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:37.342218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a41e7e91d6d4f5ca253e9325797d425'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:37.343281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a41e7e91d6d4f5ca253e9325797d425'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:37.364041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a41e7e91d6d4f5ca253e9325797d425'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:37.374165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a41e7e91d6d4f5ca253e9325797d425'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:37.391601 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2388/4775] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:36 2022] DELETE /identity/v3/users/8a41e7e91d6d4f5ca253e9325797d425 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:37.396249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:37.396836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:37.397270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:37.470746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:37.472991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:37.632261 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2388/4776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:37.667365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:37.669013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:37.795203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98775-6e15-4180-8b94-66f145616182 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:37.799419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:37.800220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:37.800549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:37.800898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:37.811324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:37.812908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:37.823645 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2389/4777] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:38.769673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:38.771149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:38.794651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9ac3e-2fe3-4179-9f30-d902f2b1b1d3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:38.804232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:38.805889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:38.806600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:38.808098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] PATH_INFO: `/v3/projects/bacdf43407bc4bfbbd2fe635a59386a1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:38.813708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacdf43407bc4bfbbd2fe635a59386a1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:38.815948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:38.908969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacdf43407bc4bfbbd2fe635a59386a1', 'request_id': 'req-08909998-e26b-4b82-a7d9-f23b0129cac3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:38.921819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacdf43407bc4bfbbd2fe635a59386a1', 'request_id': 'req-08909998-e26b-4b82-a7d9-f23b0129cac3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:38.940312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacdf43407bc4bfbbd2fe635a59386a1', 'request_id': 'req-08909998-e26b-4b82-a7d9-f23b0129cac3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:38.954385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] The token cache is being invalidate because project bacdf43407bc4bfbbd2fe635a59386a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:38.954789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:38.955718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-08909998-e26b-4b82-a7d9-f23b0129cac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:38.958045 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2389/4778] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:38 2022] DELETE /identity/v3/projects/bacdf43407bc4bfbbd2fe635a59386a1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:38.961755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:38.976894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c5bf0-0965-4de3-b651-515b8fb531cc service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:39.045176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:39.046492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:39.047553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:39.048232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] PATH_INFO: `/v3/users/282b9564f65041c1873a9f831c592c74` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:39.049991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282b9564f65041c1873a9f831c592c74)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:39.052656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:39.137457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282b9564f65041c1873a9f831c592c74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:39.172830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282b9564f65041c1873a9f831c592c74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:39.175470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282b9564f65041c1873a9f831c592c74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:39.195391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282b9564f65041c1873a9f831c592c74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:39.206933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282b9564f65041c1873a9f831c592c74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:39.216490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2390/4779] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:38 2022] DELETE /identity/v3/users/282b9564f65041c1873a9f831c592c74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:40.184143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.185321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.185794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.237665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:40.239000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.255529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:40.257532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.397032 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2390/4780] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:40.409091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:40.424166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.425873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83abb-b72d-43d2-adcb-3e7562e1bf93 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:40.434750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:40.436675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.437154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.437586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] PATH_INFO: `/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.439830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667c0d04dd7a4c25adb295f72f2fb85a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:40.442232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:40.522908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667c0d04dd7a4c25adb295f72f2fb85a', 'request_id': 'req-6774a322-99b3-48c3-9f5a-6f0179d8f556'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:40.532201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667c0d04dd7a4c25adb295f72f2fb85a', 'request_id': 'req-6774a322-99b3-48c3-9f5a-6f0179d8f556'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:40.543190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667c0d04dd7a4c25adb295f72f2fb85a', 'request_id': 'req-6774a322-99b3-48c3-9f5a-6f0179d8f556'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:40.560275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd0ca-9b59-42e2-a543-17d175923678 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:40.561782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] The token cache is being invalidate because project 667c0d04dd7a4c25adb295f72f2fb85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:40.562219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:40.564212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6774a322-99b3-48c3-9f5a-6f0179d8f556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:40.567322 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2391/4781] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:40 2022] DELETE /identity/v3/projects/667c0d04dd7a4c25adb295f72f2fb85a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:40.572218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a25c-cde1-4bfc-b19d-097cb0e21979 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.572536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a25c-cde1-4bfc-b19d-097cb0e21979 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.572940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2a25c-cde1-4bfc-b19d-097cb0e21979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.599418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8fb2a25c-cde1-4bfc-b19d-097cb0e21979 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:40.600691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8fb2a25c-cde1-4bfc-b19d-097cb0e21979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.667077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:40.670486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.671744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.673022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.678380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.683981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2392/4782] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:40.693293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.693689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.694076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.738829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:40.741764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:40.761724 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2393/4783] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:40.766935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:40.788445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663d1d-024e-4fa1-851d-f1b621b1e518 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:40.811056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:40.811580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:40.812547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.812947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.813331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.813960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:40.814976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:40.817187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:40.818742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:40.828955 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2391/4784] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:05:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:05:40.870410 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2394/4785] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:40.871817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:40.891866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777209c6-c82d-4125-ab0c-ca95208d7513 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:40.902328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:40.903025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:40.903312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:40.903590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:40.904674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:40.906595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:40.974817 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2392/4786] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:40 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:40.979084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:40.995042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed868c2-471e-4b85-bc87-26f74738bdd4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:41.146568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:41.147557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.148004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.148470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.149327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:41.152010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:41.219385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2395/4787] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:40 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:41.223921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:41.250621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6217-ba57-4c30-a6bf-d950a674ac02 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:41.266718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:41.268185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.270302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.271926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.274121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:41.279364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:41.317654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2393/4788] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:41.328635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:41.348809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15550f-3787-490e-a065-d5e507cf4c0f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:41.364521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:41.365654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.366063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.366453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.367536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:41.380655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40704745-3f69-456a-a90f-9a1470944da4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:41.422177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2396/4789] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:41.424150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:41.444679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61667d62-31e3-4385-9120-29394bd9ede6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:41.464119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:41.465161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.465454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.465741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] PATH_INFO: `/v3/projects/34803e64d24747f086fd3b580d50d975/users/46c309dc8d0b4b16afe934e1d7830e65/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.508721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34803e64d24747f086fd3b580d50d975, user_id=46c309dc8d0b4b16afe934e1d7830e65, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:41.513335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:41.541590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2394/4790] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:41 2022] PUT /identity/v3/projects/34803e64d24747f086fd3b580d50d975/users/46c309dc8d0b4b16afe934e1d7830e65/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:41.553183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.553486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.553818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.611667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] MFA Rules not processed for user `46c309dc8d0b4b16afe934e1d7830e65`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:41.613070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:41.763460 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2397/4791] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:41.765522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:41.900651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152082f-f64c-421d-8193-c93ba6c3a40e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:41.908798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:41.909812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:41.910098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:41.910378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:41.911189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:41.913292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:41.960393 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2395/4792] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:41 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:41.965331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:41.982343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed1f46-4e32-46ef-9d6a-e10dd3a6e3c9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:42.125536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:42.126438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.126837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.127233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.128058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:42.132020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:42.216708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:42.233109 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2398/4793] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:41 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:42.233942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553951-2b5a-479b-98d6-38b1fe197332 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:42.252374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:42.253095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.253380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.253659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.261599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:42.266267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:42.303900 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2396/4794] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:42.305028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:42.341951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353323-d05e-46b0-b55b-3e5e787a3741 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:42.358222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:42.359501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.361622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.362289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] PATH_INFO: `/v3/projects/25550d2387a94520babfb35fc231a552/users/a739c59ebe0c40f4b49c4ad867986ae7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.431565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25550d2387a94520babfb35fc231a552, user_id=a739c59ebe0c40f4b49c4ad867986ae7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:42.435295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:42.489546 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2399/4795] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:42 2022] PUT /identity/v3/projects/25550d2387a94520babfb35fc231a552/users/a739c59ebe0c40f4b49c4ad867986ae7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:42.490655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:42.508475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7d808-f4a3-489f-adbd-c3e6d553adea admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:42.669104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:42.670684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.671201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.671789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.673342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:42.679277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaee64f-d7b4-49af-bece-ef81910f9bc6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:42.708094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2397/4796] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:42.712206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:42.731596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c9be4-d17c-42bc-91d2-b4042838ed9e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:42.742531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:42.743864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.744678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.745274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] PATH_INFO: `/v3/projects/25550d2387a94520babfb35fc231a552/users/a739c59ebe0c40f4b49c4ad867986ae7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.747973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] RBAC: Authorizing `identity:create_grant(project_id=25550d2387a94520babfb35fc231a552, user_id=a739c59ebe0c40f4b49c4ad867986ae7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:42.751985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:42.790485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:42.791128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:42.792185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:42.793624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2400/4797] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:42 2022] PUT /identity/v3/projects/25550d2387a94520babfb35fc231a552/users/a739c59ebe0c40f4b49c4ad867986ae7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:42.853286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] MFA Rules not processed for user `a739c59ebe0c40f4b49c4ad867986ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:42.855157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:43.039245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2398/4798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:43.046069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.071600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a710-3641-459c-b102-bd15c562afef admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.084935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.085354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.085640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.086960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.087551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.090070 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:43.090070 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:43.090070 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:43.093812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.176825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.177720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2401/4799] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:05:43 2022] POST /identity/v3/regions => generated 223 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:43.193383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec975ad9-f0f1-4421-a232-91bdf92d726d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.229483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.230551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.231058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.231748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.232873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.234280 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:43.234280 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:43.234280 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:43.239002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.275548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2399/4800] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:05:43 2022] POST /identity/v3/regions => generated 223 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:43.281314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.302561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636449-a1e1-44ac-841f-21d1d56151b6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.323235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.324974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.325512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.326067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/4f1515c7-a460-4aad-9508-37cfda9f6a67` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.327020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:create_region(region_id=4f1515c7-a460-4aad-9508-37cfda9f6a67)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.329228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.357300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2402/4801] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Apr 2 21:05:43 2022] PUT /identity/v3/regions/4f1515c7-a460-4aad-9508-37cfda9f6a67 => generated 232 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:43.361578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.380551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c1a2e-5460-4797-9321-38bcba5fcbad tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.412176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.413865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.414381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.415366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/4f1515c7-a460-4aad-9508-37cfda9f6a67` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.416269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4f1515c7-a460-4aad-9508-37cfda9f6a67)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.418596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.445960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2400/4802] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:05:43 2022] DELETE /identity/v3/regions/4f1515c7-a460-4aad-9508-37cfda9f6a67 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:43.451599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.491160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83ed9d-c94c-47f2-bca2-20e82daca3a4 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.514466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.515471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.515965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.516386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.518113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.520350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.539014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.541676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:43.570842 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2403/4803] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:05:43 2022] POST /identity/v3/regions => generated 254 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:43.582042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.635212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec046df-7922-463b-ae9e-c3bb289b7352 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.666067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.667921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.669284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.672200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/a33be48b41314179840bae06478572e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.675418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:update_region(region_id=a33be48b41314179840bae06478572e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.676804 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:43.676804 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:43.676804 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:43.678325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.730915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2404/4804] 10.222.0.18 () {60 vars in 1249 bytes} [Sat Apr 2 21:05:43 2022] PATCH /identity/v3/regions/a33be48b41314179840bae06478572e4 => generated 254 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:43.733947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5d4e2-8a7d-43ed-8a4c-21044fefa435 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.737739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.770224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.771159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.771700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.771700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] PATH_INFO: `/v3/users/437b151556e04bdfa22a80b72f34c088` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.773854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=437b151556e04bdfa22a80b72f34c088)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.775953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.789442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e4d6-5302-40f7-8481-6204ebb20565 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.805177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.806498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.807500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.808379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/a33be48b41314179840bae06478572e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.809229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:get_region(region_id=a33be48b41314179840bae06478572e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.810466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.825364 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2405/4805] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:05:43 2022] GET /identity/v3/regions/a33be48b41314179840bae06478572e4 => generated 254 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:43.830497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.845336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc26934-dc43-4df9-b78f-0de07a755f65 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:43.872812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:43.874639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:43.875097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:43.875716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/a33be48b41314179840bae06478572e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:43.876757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a33be48b41314179840bae06478572e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:43.881254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:43.882865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437b151556e04bdfa22a80b72f34c088'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:43.895753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437b151556e04bdfa22a80b72f34c088'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:43.896494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437b151556e04bdfa22a80b72f34c088'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:43.898871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437b151556e04bdfa22a80b72f34c088'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:43.912844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437b151556e04bdfa22a80b72f34c088'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:43.934769 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2406/4806] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:43 2022] DELETE /identity/v3/regions/a33be48b41314179840bae06478572e4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:43.947484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:43.957061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:43.982045 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2401/4807] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:43 2022] DELETE /identity/v3/users/437b151556e04bdfa22a80b72f34c088 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:44.042292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a172ed3-90d9-4296-ac18-bdabded75dfd tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.194940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.195818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.196206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.196749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.197583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.199011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.217621 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2407/4808] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 21:05:43 2022] GET /identity/v3/regions => generated 668 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:44.219746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.242597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6021c6-8786-414d-8a04-bc9ffa0db92b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.266122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.267305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.267754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.268200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/a33be48b41314179840bae06478572e4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.269096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a33be48b41314179840bae06478572e4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.271413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.294740 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Could not find region: a33be48b41314179840bae06478572e4.: keystone.exception.RegionNotFound: Could not find region: a33be48b41314179840bae06478572e4. Apr 02 21:05:44.301349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2402/4809] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:44 2022] DELETE /identity/v3/regions/a33be48b41314179840bae06478572e4 => generated 112 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:05:44.301770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.318007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000e25-24b6-4f4b-9483-b6bed78d1957 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.338114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.339613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.339993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.340284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.341346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.342695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.359233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2408/4810] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 21:05:44 2022] GET /identity/v3/regions => generated 668 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:44.361187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.379737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862558-8399-4c0b-b653-5fe4c1d81967 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.386448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.387129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.387413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.387690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.388634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.392116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.430813 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2403/4811] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:05:44 2022] POST /identity/v3/regions => generated 254 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:44.435400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.473509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8788ae0-8b16-4f94-b93a-b843952fa831 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.497504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.498734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.499718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.500433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.501620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Adding query filter params (parent_region_id=e5aad25354a14e7c8efd4454fb5f948a) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:44.502204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.503880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.513222 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2409/4812] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:05:44 2022] GET /identity/v3/regions?parent_region_id=e5aad25354a14e7c8efd4454fb5f948a => generated 400 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:44.517818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.534681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bab61-b27c-435c-a60a-2637617c82f6 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.542935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.544362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.544984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.545485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/cc0bed0443794b34b26815d671c068dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.546497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cc0bed0443794b34b26815d671c068dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.548828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.594757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2404/4813] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:44 2022] DELETE /identity/v3/regions/cc0bed0443794b34b26815d671c068dc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:44.600391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.631896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6c06-29c0-45e5-9ce9-a50a7ea4b619 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.644689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.647002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:44.709591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.710722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.711184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.712275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/53e24d8d65914faabaf18252291e07cd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.712647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=53e24d8d65914faabaf18252291e07cd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.715951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.765472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac3d3a-00e2-4a76-b815-9a1c74a9e48b tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.772057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:44.773286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.773730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.774169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] PATH_INFO: `/v3/projects/6ae16de34fd342cda85aa2bd981452c4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.775551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae16de34fd342cda85aa2bd981452c4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:44.779392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:44.819324 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2410/4814] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:44 2022] DELETE /identity/v3/regions/53e24d8d65914faabaf18252291e07cd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:44.824620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:44.846041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae16de34fd342cda85aa2bd981452c4', 'request_id': 'req-9ff10dd6-65d3-43c4-93d7-01777f415382'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:44.855359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae16de34fd342cda85aa2bd981452c4', 'request_id': 'req-9ff10dd6-65d3-43c4-93d7-01777f415382'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:44.867607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae16de34fd342cda85aa2bd981452c4', 'request_id': 'req-9ff10dd6-65d3-43c4-93d7-01777f415382'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:44.885723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] The token cache is being invalidate because project 6ae16de34fd342cda85aa2bd981452c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:44.886019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:44.887012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ff10dd6-65d3-43c4-93d7-01777f415382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:44.892521 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2405/4815] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:44 2022] DELETE /identity/v3/projects/6ae16de34fd342cda85aa2bd981452c4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:44.896149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7b2f-d7a2-44d2-ae61-3a1359047e01 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:44.896883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7b2f-d7a2-44d2-ae61-3a1359047e01 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:44.897234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7b2f-d7a2-44d2-ae61-3a1359047e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:44.916559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad55df1-5069-4bf8-a804-e65cd69824b1 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:44.920914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ca1c7b2f-d7a2-44d2-ae61-3a1359047e01 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:44.922485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca1c7b2f-d7a2-44d2-ae61-3a1359047e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.015496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2406/4816] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:45.023217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.023529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.023872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.044996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:45.045772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.059735 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2407/4817] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:45.060924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.081951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78fafa-9507-4986-8927-0c94cfd5672d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.118721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.119364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.120118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.120596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.121589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:45.121883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.125904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.150406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a739c59ebe0c40f4b49c4ad867986ae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25550d2387a94520babfb35fc231a552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.151314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.151614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.151883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] PATH_INFO: `/v3/regions/e5aad25354a14e7c8efd4454fb5f948a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.152804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorizing `identity:delete_region(region_id=e5aad25354a14e7c8efd4454fb5f948a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.164138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.169366 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2408/4818] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:45.173425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.198818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701e43d-6a0d-472f-bf89-91d759f169c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.205530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.206614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.209070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.228656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2411/4819] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:44 2022] DELETE /identity/v3/regions/e5aad25354a14e7c8efd4454fb5f948a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:45.231975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.232937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.233136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.235313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.235673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.275880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2409/4820] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:45 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:45.281051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.284162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc6ce4-e91a-4bc9-8cee-b422f5f18af5 tempest-RegionsTestJSON-2135371008 tempest-RegionsTestJSON-2135371008-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.400545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.401382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.402012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.402472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] PATH_INFO: `/v3/users/46c309dc8d0b4b16afe934e1d7830e65` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.405216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c309dc8d0b4b16afe934e1d7830e65)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.407359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.478225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e947-aa1e-4d03-b106-003b52369f57 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.503904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.504637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.504914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.505190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.506026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.507966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.523429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c309dc8d0b4b16afe934e1d7830e65'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:45.548678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c309dc8d0b4b16afe934e1d7830e65'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:45.551970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c309dc8d0b4b16afe934e1d7830e65'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:45.568632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c309dc8d0b4b16afe934e1d7830e65'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:45.572048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2410/4821] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:45 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:45.574595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.577383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.598602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010f1166-c4f9-42f6-b462-a76643b8e9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c309dc8d0b4b16afe934e1d7830e65'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:45.615669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43eb6f9-e188-41d8-9785-c8a4db93d0f1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.618839 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2412/4822] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:45 2022] DELETE /identity/v3/users/46c309dc8d0b4b16afe934e1d7830e65 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:45.624164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.624479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.624807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.687144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:45.687144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.802869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.803555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.803842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.806917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.807852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.809512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.836549 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2411/4823] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:45.839492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.843935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2413/4824] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:05:45.855606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.858674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:45.863038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea02e0c-bf03-48fb-a705-1da8d8dc80e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.881501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.882082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.882520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.882669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.883421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.885105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:45.897681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2412/4825] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:45.902253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:45.928141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36aa69-ef80-4dda-9025-3b7d25f04f86 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:45.942888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:45.943873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:45.944187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:45.944444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] PATH_INFO: `/v3/projects/76098fb9c22b4f84bb0afb2bbe66e858/users/e5d1c36098a14436a0a10f4fb9937bf1/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:45.980993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76098fb9c22b4f84bb0afb2bbe66e858, user_id=e5d1c36098a14436a0a10f4fb9937bf1, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:45.984084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec0663-0ca2-49fb-b5bb-6ff088c03bc4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:46.019483 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2413/4826] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:45 2022] PUT /identity/v3/projects/76098fb9c22b4f84bb0afb2bbe66e858/users/e5d1c36098a14436a0a10f4fb9937bf1/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:46.021522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a31316-0221-4802-9eef-c2e0bedf63a9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:46.024405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:46.025047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:46.025406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:46.059955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:46.061261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:46.128657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:46.129437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:46.129919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:46.130373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:46.245823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2414/4827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:46.265223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:46.287174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf6191-8f49-4d3e-bf0c-b8734e40e540 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:46.288891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:46.294671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:46.324993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:46.325806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:46.326104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:46.326482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:46.356594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2414/4828] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:46.392597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:46.394387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:46.438138 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2415/4829] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:47.387807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:47.390821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:47.437264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4b9a5-3ea8-4a72-909c-3867948f71f7 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:47.476673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:47.477957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:47.478473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:47.479545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] PATH_INFO: `/v3/projects/34803e64d24747f086fd3b580d50d975` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:47.485448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34803e64d24747f086fd3b580d50d975)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:47.490293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:47.596486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34803e64d24747f086fd3b580d50d975', 'request_id': 'req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.606172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34803e64d24747f086fd3b580d50d975', 'request_id': 'req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.618875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34803e64d24747f086fd3b580d50d975', 'request_id': 'req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.655203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] The token cache is being invalidate because project 34803e64d24747f086fd3b580d50d975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:47.658123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.662269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.670104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2415/4830] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:47 2022] DELETE /identity/v3/projects/34803e64d24747f086fd3b580d50d975 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:47.673887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:47.688789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc3d6e-2b31-4cac-9e3c-5a8b3d485c78 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:47.863696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:47.864785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:47.865071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:47.865351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] PATH_INFO: `/v3/users/a739c59ebe0c40f4b49c4ad867986ae7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:47.866763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a739c59ebe0c40f4b49c4ad867986ae7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:47.868909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:47.969532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a739c59ebe0c40f4b49c4ad867986ae7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.983443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a739c59ebe0c40f4b49c4ad867986ae7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.998523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a739c59ebe0c40f4b49c4ad867986ae7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:47.999883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a739c59ebe0c40f4b49c4ad867986ae7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:48.031047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5639345-5475-461a-9e1b-c1f02b9628d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a739c59ebe0c40f4b49c4ad867986ae7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:48.127006 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2416/4831] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:47 2022] DELETE /identity/v3/users/a739c59ebe0c40f4b49c4ad867986ae7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:49.091702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:49.094096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:49.124982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1bd6a-cb12-4810-af9d-e2a81b117f98 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:49.278885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:49.280168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:49.281984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:49.282448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] PATH_INFO: `/v3/projects/25550d2387a94520babfb35fc231a552` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:49.285196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] RBAC: Authorizing `identity:delete_project(project_id=25550d2387a94520babfb35fc231a552)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:49.288359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:49.454769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25550d2387a94520babfb35fc231a552', 'request_id': 'req-ba55e188-fe41-4069-b0e3-fa25da8f34da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:49.480060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25550d2387a94520babfb35fc231a552', 'request_id': 'req-ba55e188-fe41-4069-b0e3-fa25da8f34da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:49.505561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25550d2387a94520babfb35fc231a552', 'request_id': 'req-ba55e188-fe41-4069-b0e3-fa25da8f34da'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:49.532820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] The token cache is being invalidate because project 25550d2387a94520babfb35fc231a552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:49.533310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:49.538745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ba55e188-fe41-4069-b0e3-fa25da8f34da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:49.541792 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2416/4832] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:49 2022] DELETE /identity/v3/projects/25550d2387a94520babfb35fc231a552 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:49.546724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:49.547332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:49.547450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:49.603290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:49.605448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:49.780959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2417/4833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:49.793665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:49.800602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:49.801069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:49.883794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:49.893752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:49.944048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2417/4834] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:49.946946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:49.968427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d53f9-be38-40e5-b771-a3ea04a8ca05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:49.978842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:49.980694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:49.980994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:49.984490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:49.985904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:05:49.985904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:49.987510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.027067 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2418/4835] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:50.028085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:50.059137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281628f-e2eb-4529-8d51-1fa365706c42 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:50.090179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:50.091426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.091755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.092273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.095398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:50.101236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.174902 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2418/4836] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:50 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:50.180649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:50.205593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f465fe-3e25-44fb-b695-7a5323312402 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:50.421452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:50.422418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.422871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.423326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.424207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:50.426734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.477093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2419/4837] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:50 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:50.478469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:50.495020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35fed7-3060-4415-9939-dca51b524e7f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:50.509049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:50.509739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.510850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.511146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.511891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:50.515789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.540860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2419/4838] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:50.542050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:50.557430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c50c4-e85e-424b-8d99-858f68d3544c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:50.574744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:50.576047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.576541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.577011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.577917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:50.579776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301b00-9d47-4130-a527-509867b21da1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.592634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2420/4839] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:50.595869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:50.619194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187692c2-8b5e-4abd-93f1-8aeae0b9dc5e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:50.631934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:50.633343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.634759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.635342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] PATH_INFO: `/v3/projects/06d93563873d4065bde7cba8ddc16f6d/users/3684b0372f3b49f1a9e0c0e0229e7fe2/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.693723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d93563873d4065bde7cba8ddc16f6d, user_id=3684b0372f3b49f1a9e0c0e0229e7fe2, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:50.702703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:50.747208 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2420/4840] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:50 2022] PUT /identity/v3/projects/06d93563873d4065bde7cba8ddc16f6d/users/3684b0372f3b49f1a9e0c0e0229e7fe2/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:50.757391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:50.757962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:50.758406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:50.809244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] MFA Rules not processed for user `3684b0372f3b49f1a9e0c0e0229e7fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:50.810882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:50.897356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2421/4841] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:50.902043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.044114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8d132-c6ee-40da-b03c-fce38c7fe8ea admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.063576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.064268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.064715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.065007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.065706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.068106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.129000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2421/4842] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:50 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:51.130359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.169365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc27423-bbd9-4423-a489-0da0b243409d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.411717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.412402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.413102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.416916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.420706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.426062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.493111 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2422/4843] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:51 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:51.494833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.509370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f47df-d313-47e5-bd72-c5578d548a2f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.524554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.524554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.524554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.524966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.526785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.534685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.567410 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2422/4844] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:51.571597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.582912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38943-9c77-48e4-b3b3-6a47bdb8a0ec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.597463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.598380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.598704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.598937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] PATH_INFO: `/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f/users/68320a887afa46ebade35fb1fc2776ff/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.637038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beaf3f57b8944d5afa000c20fc24a9f, user_id=68320a887afa46ebade35fb1fc2776ff, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.639916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.668998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.669421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2423/4845] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:51 2022] PUT /identity/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f/users/68320a887afa46ebade35fb1fc2776ff/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:51.680771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ad59-2713-4f8f-a845-f779605a4280 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.795583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.796443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.796876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.797281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.798128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.801213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6ce95-da2e-4028-be07-628143cfea75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.821364 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2423/4846] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:51.822632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:51.833985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008ea9-a487-4605-aafe-a05f03fdf630 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:51.840708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:51.841977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.842675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.843098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] PATH_INFO: `/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f/users/68320a887afa46ebade35fb1fc2776ff/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.845987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6beaf3f57b8944d5afa000c20fc24a9f, user_id=68320a887afa46ebade35fb1fc2776ff, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:51.849224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:51.861517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2424/4847] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:51 2022] PUT /identity/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f/users/68320a887afa46ebade35fb1fc2776ff/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:51.873142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:51.873343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:51.873897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:51.911303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] MFA Rules not processed for user `68320a887afa46ebade35fb1fc2776ff`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:51.913048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:52.091351 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2424/4848] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:52.096414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.136577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065aaf4-0e85-45f2-8812-eea44ce34398 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.163664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.174382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.174835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.175434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.182301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.184299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.284499 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2425/4849] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:52 2022] POST /identity/v3/projects => generated 358 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:52.287463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.305735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bd725-09cb-4912-92dd-83679ea8aea3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.390912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.391900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.392695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.393159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.394053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.396205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.445116 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2425/4850] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:52 2022] POST /identity/v3/users => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:05:52.445920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.468486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55486352-c6ac-4b57-88ae-7f1f4da6681e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.481621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.482550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.482843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.483217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/6258c005429445a5bb37aae2e8c1315e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.499606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_user(user_id=6258c005429445a5bb37aae2e8c1315e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.502105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.506900 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2426/4851] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:05:52 2022] GET /identity/v3/users/6258c005429445a5bb37aae2e8c1315e => generated 373 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:52.511353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.528063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda650-e182-4b2a-907a-70afcadf7e5d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.533584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.534644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.535085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.535552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/6258c005429445a5bb37aae2e8c1315e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.537505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6258c005429445a5bb37aae2e8c1315e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.540393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.616240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6258c005429445a5bb37aae2e8c1315e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.629214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6258c005429445a5bb37aae2e8c1315e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.630029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6258c005429445a5bb37aae2e8c1315e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.637945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6258c005429445a5bb37aae2e8c1315e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.645124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6258c005429445a5bb37aae2e8c1315e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.651836 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2426/4852] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:52 2022] DELETE /identity/v3/users/6258c005429445a5bb37aae2e8c1315e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:52.655807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.658421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:52.672071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd72cb-39c0-425a-b098-a470f07c15f3 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.729846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.730730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.731019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.731300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/79e1f7b894eb434d90663caaa147f37f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.732583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79e1f7b894eb434d90663caaa147f37f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.734644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.790809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e1f7b894eb434d90663caaa147f37f', 'request_id': 'req-98a258ef-0277-4a74-acfc-ba9c9a8b4932'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.797189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e1f7b894eb434d90663caaa147f37f', 'request_id': 'req-98a258ef-0277-4a74-acfc-ba9c9a8b4932'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.807826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e1f7b894eb434d90663caaa147f37f', 'request_id': 'req-98a258ef-0277-4a74-acfc-ba9c9a8b4932'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.818578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] The token cache is being invalidate because project 79e1f7b894eb434d90663caaa147f37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:52.818993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.819893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:52.821708 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2427/4853] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:52 2022] DELETE /identity/v3/projects/79e1f7b894eb434d90663caaa147f37f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:52.827587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.837954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51fa24-e81c-44f7-aeaa-be5f6ebf7ad0 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:52.903976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:52.904783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:52.905128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:52.905581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:52.906346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:52.908493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:52.963207 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2427/4854] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:52 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:52.963329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:52.963329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:52.971911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a258ef-0277-4a74-acfc-ba9c9a8b4932 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.032654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.032654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.032960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.033213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.033872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.035752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.086650 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2428/4855] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:52 2022] POST /identity/v3/users => generated 411 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:53.091441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.105015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea556f5c-8c09-445c-bf8a-77a8f1173ff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.110524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.111425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.111841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.112225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.113497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.115431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.133566 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2428/4856] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:05:53 2022] POST /identity/v3/roles => generated 239 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:53.137861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.148742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a8304-4940-48b2-842e-c446f48ec864 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.153833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.154723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.155011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.155291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/f53ded62fca84981b19fe585f9837e1d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.178190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_user(user_id=f53ded62fca84981b19fe585f9837e1d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.180707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.183280 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2429/4857] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:05:53 2022] GET /identity/v3/users/f53ded62fca84981b19fe585f9837e1d => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:53.187240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.197652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2c10-3ebb-48b1-a7d7-1569c4c7184f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.202704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.203728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.204282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.204600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/roles/c0f87334e00c48b48a6ec8495da6f3b3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.206365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_role(role_id=c0f87334e00c48b48a6ec8495da6f3b3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.207599 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:53.207599 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:53.207599 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:53.208522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.212490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2429/4858] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:05:53 2022] GET /identity/v3/roles/c0f87334e00c48b48a6ec8495da6f3b3 => generated 239 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:53.214499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.225118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd2e3-e540-443e-a2ac-284c9c680667 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.231125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.231895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.232267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.232686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.233420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.235453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.269493 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2430/4859] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:53 2022] POST /identity/v3/projects => generated 358 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:53.270942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.281519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd290c-d314-4e99-86c9-4ffa10a6cc1d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.341954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.342838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.343184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.343450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/38b0353401734d9489a2941137c694c7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.344804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_project(project_id=38b0353401734d9489a2941137c694c7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.347015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.352033 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2430/4860] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:53 2022] GET /identity/v3/projects/38b0353401734d9489a2941137c694c7 => generated 358 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:53.354276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.366195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f960a-a773-4827-b014-c1ea09307c6c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.372173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.373120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.373407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.373977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/38b0353401734d9489a2941137c694c7/users/f53ded62fca84981b19fe585f9837e1d/roles/c0f87334e00c48b48a6ec8495da6f3b3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.376125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_grant(project_id=38b0353401734d9489a2941137c694c7, user_id=f53ded62fca84981b19fe585f9837e1d, role_id=c0f87334e00c48b48a6ec8495da6f3b3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.379039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.393851 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2431/4861] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:53 2022] PUT /identity/v3/projects/38b0353401734d9489a2941137c694c7/users/f53ded62fca84981b19fe585f9837e1d/roles/c0f87334e00c48b48a6ec8495da6f3b3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:53.397911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.408871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6aa3a-b716-495f-abf1-119041b14086 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.469141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.469820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.470110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.470394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.471106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.473449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.503469 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2431/4862] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:53 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:53.507343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.518249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb12e2-04b8-4818-bb03-6b47cd2a659e tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.575940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.576851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.577134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.577406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.578587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce7e43b3eb424bd28f7be11f5b4e16e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.580689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.582594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2432/4863] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:05:53 2022] GET /identity/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2 => generated 359 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:05:53.586783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.597957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1835b0-8a3b-4a0a-8a95-38ddec4a1885 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.604266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.605215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.605507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.605870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2/users/f53ded62fca84981b19fe585f9837e1d/roles/c0f87334e00c48b48a6ec8495da6f3b3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.608928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ce7e43b3eb424bd28f7be11f5b4e16e2, user_id=f53ded62fca84981b19fe585f9837e1d, role_id=c0f87334e00c48b48a6ec8495da6f3b3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.612011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.627073 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2432/4864] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:53 2022] PUT /identity/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2/users/f53ded62fca84981b19fe585f9837e1d/roles/c0f87334e00c48b48a6ec8495da6f3b3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:53.631855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.643272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d8e6-ae0e-4d57-9efc-723db4d7eff1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.709624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.710568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.711132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.711700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/f53ded62fca84981b19fe585f9837e1d/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.715192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=f53ded62fca84981b19fe585f9837e1d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.717487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.769509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2433/4865] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:05:53 2022] GET /identity/v3/users/f53ded62fca84981b19fe585f9837e1d/projects => generated 841 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:53.774133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.792781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96952c6b-d76f-4200-b0ed-7285e12e9eaa tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:53.807293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:53.807293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:53.807293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:53.807666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:53.807666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce7e43b3eb424bd28f7be11f5b4e16e2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:53.807666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:53.901899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7e43b3eb424bd28f7be11f5b4e16e2', 'request_id': 'req-f5a73b8b-46e1-4352-b928-aa2cc254485a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:53.909558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7e43b3eb424bd28f7be11f5b4e16e2', 'request_id': 'req-f5a73b8b-46e1-4352-b928-aa2cc254485a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:53.915305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7e43b3eb424bd28f7be11f5b4e16e2', 'request_id': 'req-f5a73b8b-46e1-4352-b928-aa2cc254485a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:53.932591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] The token cache is being invalidate because project ce7e43b3eb424bd28f7be11f5b4e16e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:53.933044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:53.933902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:53.935835 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2433/4866] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:53 2022] DELETE /identity/v3/projects/ce7e43b3eb424bd28f7be11f5b4e16e2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:53.939743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:53.942167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:53.958473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1bcef-6da4-4d99-9912-961061f7166d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:54.032993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:54.037405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.037405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.037405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/38b0353401734d9489a2941137c694c7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:54.037405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=38b0353401734d9489a2941137c694c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:54.038490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:54.094832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b0353401734d9489a2941137c694c7', 'request_id': 'req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.102712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b0353401734d9489a2941137c694c7', 'request_id': 'req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.116215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b0353401734d9489a2941137c694c7', 'request_id': 'req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.129698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] The token cache is being invalidate because project 38b0353401734d9489a2941137c694c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:54.129938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.130886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.133455 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2434/4867] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:53 2022] DELETE /identity/v3/projects/38b0353401734d9489a2941137c694c7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:54.137973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:54.151012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a73b8b-46e1-4352-b928-aa2cc254485a tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:54.216009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:54.216830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.217105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.217423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/roles/c0f87334e00c48b48a6ec8495da6f3b3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:54.218842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0f87334e00c48b48a6ec8495da6f3b3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:54.220441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:54.289498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invalidating the token cache because role c0f87334e00c48b48a6ec8495da6f3b3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:54.289825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.290511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.296247 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2434/4868] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:54 2022] DELETE /identity/v3/roles/c0f87334e00c48b48a6ec8495da6f3b3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:54.297492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:54.299311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:54.315398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d11d38-eaa4-42c8-a5f4-0b1c3e4133e6 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:54.397219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:54.398236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.398507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.398789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/f53ded62fca84981b19fe585f9837e1d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:54.400659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f53ded62fca84981b19fe585f9837e1d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:54.402626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:54.470806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53ded62fca84981b19fe585f9837e1d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.480949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53ded62fca84981b19fe585f9837e1d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.482071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53ded62fca84981b19fe585f9837e1d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.482853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53ded62fca84981b19fe585f9837e1d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.492941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53ded62fca84981b19fe585f9837e1d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.521833 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2435/4869] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:54 2022] DELETE /identity/v3/users/f53ded62fca84981b19fe585f9837e1d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:54.525766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:54.533500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:54.567075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d27e-bd2c-41de-9f19-c745d4125eff tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:54.640637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:54.641533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.641824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.642108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/411f2b31949f42d8a752b1489883785b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:54.643331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=411f2b31949f42d8a752b1489883785b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:54.645478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:54.716333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411f2b31949f42d8a752b1489883785b', 'request_id': 'req-c3a42a88-28a8-45b7-999e-b02287b0a4b5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.726313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411f2b31949f42d8a752b1489883785b', 'request_id': 'req-c3a42a88-28a8-45b7-999e-b02287b0a4b5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.734037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411f2b31949f42d8a752b1489883785b', 'request_id': 'req-c3a42a88-28a8-45b7-999e-b02287b0a4b5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.752949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] The token cache is being invalidate because project 411f2b31949f42d8a752b1489883785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:54.754164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.755017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3a42a88-28a8-45b7-999e-b02287b0a4b5 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.756804 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2435/4870] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:54 2022] DELETE /identity/v3/projects/411f2b31949f42d8a752b1489883785b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:54.762987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:54.764685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:54.784270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7af70-005e-446f-bf75-1c05d65e513c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:54.869270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:54.870173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.870461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.870742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:54.872033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:update_user(user_id=3684b0372f3b49f1a9e0c0e0229e7fe2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:54.873242 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:54.873242 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:05:54.873242 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:05:54.874468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:54.953364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.968043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invalidating the token cache because user 3684b0372f3b49f1a9e0c0e0229e7fe2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:54.968308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.969243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:54.976545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2436/4871] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 21:05:54 2022] PATCH /identity/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:54.982209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:54.982551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:54.982839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.051421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] MFA Rules not processed for user `3684b0372f3b49f1a9e0c0e0229e7fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:55.053630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:55.059135 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2436/4872] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:54 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:05:55.064177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:55.067646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:55.083814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc2102-920d-494f-9859-cce831ab9a45 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:55.090876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:55.092053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.092588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.093348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.094946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:update_user(user_id=3684b0372f3b49f1a9e0c0e0229e7fe2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:55.098253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:55.151804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.163392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invalidating the token cache because user 3684b0372f3b49f1a9e0c0e0229e7fe2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:55.165284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.167080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3629c18a-f44b-4e7d-b82c-38b1b3d43e08 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.173379 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2437/4873] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 21:05:55 2022] PATCH /identity/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2 => generated 297 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:55.177156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:55.192262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79094cee-d7bb-4428-b1f1-f0c450588e41 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:55.198871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:55.200821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.201601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.202177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.221335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:update_user(user_id=3684b0372f3b49f1a9e0c0e0229e7fe2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:55.222811 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:05:55.222811 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:05:55.222811 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:05:55.224614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:55.290438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.301366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invalidating the token cache because user 3684b0372f3b49f1a9e0c0e0229e7fe2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:55.301660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.303834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.306913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2437/4874] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 21:05:55 2022] PATCH /identity/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2 => generated 297 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:55.310989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.311284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.311564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.348416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] MFA Rules not processed for user `3684b0372f3b49f1a9e0c0e0229e7fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:55.349847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:55.353256 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2438/4875] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:55 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:55.357808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:55.359288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:55.374696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58559b1-8143-4ccd-8d07-0c9b4d74046f tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:55.380223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:55.381336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.381624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.381902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.383460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:update_user(user_id=3684b0372f3b49f1a9e0c0e0229e7fe2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:55.386438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:55.427213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.437262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invalidating the token cache because user 3684b0372f3b49f1a9e0c0e0229e7fe2 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:55.437606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.441729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.450578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:55.455676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2438/4876] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 21:05:55 2022] PATCH /identity/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2 => generated 297 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:55.467120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e59e3-8d0a-4517-abb5-c55068516e7e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:55.473374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:55.474074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.474359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.474636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.475329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:55.477263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4662c-c246-45ad-a718-0bef84d96cfc tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:55.515149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:55.520015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:55.521680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2439/4877] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:05:55 2022] POST /identity/v3/users => generated 265 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:55.536641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4fdb-b42a-430a-82ac-bc31bf070f70 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:55.545272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2edb68-c4f1-43a4-81b7-89f54a61f670 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:55.546185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2edb68-c4f1-43a4-81b7-89f54a61f670 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.546475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2edb68-c4f1-43a4-81b7-89f54a61f670 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.546753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2edb68-c4f1-43a4-81b7-89f54a61f670 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/0ede104eddcc409aa6c48d315f2a2bdd/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:55.652050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b2edb68-c4f1-43a4-81b7-89f54a61f670 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:55.676824 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2439/4878] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:05:55 2022] POST /identity/v3/users/0ede104eddcc409aa6c48d315f2a2bdd/password => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:55.983525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:55.984035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:55.984144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:56.032560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] MFA Rules not processed for user `2fed8f5059c44a8fa1a9526e81fa73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:56.041698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:56.175668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2440/4879] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:56.681917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:56.683694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:56.685552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:56.718771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] MFA Rules not processed for user `0ede104eddcc409aa6c48d315f2a2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:56.721593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:56.729202 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2440/4880] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:56 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:56.736533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:56.754686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc0e8c-a614-485c-a5ec-d6e65db2b8b5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:56.774066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:56.774912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:56.775358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:56.776237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:56.791861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:56.794384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:56.802523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2441/4881] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Apr 2 21:05:56 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:56.806618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:56.846879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b76e6f-aace-4fc4-a9f8-54b75d22393b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:56.861631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:56.862541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:56.862848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:56.863226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/0ede104eddcc409aa6c48d315f2a2bdd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:56.867407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ede104eddcc409aa6c48d315f2a2bdd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:56.869959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:56.950460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:56.967046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:56.967840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:56.983643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:56.993629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ede104eddcc409aa6c48d315f2a2bdd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.024044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2441/4882] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:56 2022] DELETE /identity/v3/users/0ede104eddcc409aa6c48d315f2a2bdd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:57.029605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.059016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c85b6-a045-48f3-985b-9ef000dae7ab tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.197672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.198454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.200029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.200587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.201597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.203858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:57.239855 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2442/4883] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:57 2022] POST /identity/v3/users => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:57.243282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.247098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:57.287548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1d49-ce0d-4905-ac0e-d6ff9af71f99 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.301075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.302216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.302659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.303362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.304391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.307558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:57.351677 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2442/4884] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:57 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:57.356134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.366917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfae51-db86-4055-b1e2-63aa38b2d1b1 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.463027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.464104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.464393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.464733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/404d1c17b009461f955ddc48e0c49a36` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.482210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:update_user(user_id=404d1c17b009461f955ddc48e0c49a36)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.484472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:57.536039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2443/4885] 10.222.0.18 () {60 vars in 1243 bytes} [Sat Apr 2 21:05:57 2022] PATCH /identity/v3/users/404d1c17b009461f955ddc48e0c49a36 => generated 523 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:57.541967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.556174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be7331-7f11-43ee-994f-bebd2f1b2b49 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.562296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.563850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.564676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.573530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/404d1c17b009461f955ddc48e0c49a36` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.609449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:get_user(user_id=404d1c17b009461f955ddc48e0c49a36)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.611926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:57.614126 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2443/4886] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:05:57 2022] GET /identity/v3/users/404d1c17b009461f955ddc48e0c49a36 => generated 389 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:05:57.618439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.631469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f03f-c451-488b-8782-0a14793c3838 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.637076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.638043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.638415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.638791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/projects/f7b25ca65f1c4a7787118e79a2048831` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.640238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7b25ca65f1c4a7787118e79a2048831)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.642307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:57.719141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b25ca65f1c4a7787118e79a2048831', 'request_id': 'req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.727887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b25ca65f1c4a7787118e79a2048831', 'request_id': 'req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.747394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b25ca65f1c4a7787118e79a2048831', 'request_id': 'req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.789671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] The token cache is being invalidate because project f7b25ca65f1c4a7787118e79a2048831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:05:57.790321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.792699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-99a4e7e7-1620-4cbb-b32f-be5cdc5dc344 tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:57.796562 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2444/4887] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:57 2022] DELETE /identity/v3/projects/f7b25ca65f1c4a7787118e79a2048831 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:57.800439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:57.806736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:57.831937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2ba7-b2ab-483b-b201-49e8031e460d tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:57.976603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68320a887afa46ebade35fb1fc2776ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6beaf3f57b8944d5afa000c20fc24a9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:57.977528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:57.977827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:57.978468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] PATH_INFO: `/v3/users/404d1c17b009461f955ddc48e0c49a36` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:57.979776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorizing `identity:delete_user(user_id=404d1c17b009461f955ddc48e0c49a36)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:57.981918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.012420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.012721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.013153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.038554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404d1c17b009461f955ddc48e0c49a36'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.042915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] MFA Rules not processed for user `e5d1c36098a14436a0a10f4fb9937bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:58.044570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.051808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404d1c17b009461f955ddc48e0c49a36'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.053992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404d1c17b009461f955ddc48e0c49a36'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.063678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404d1c17b009461f955ddc48e0c49a36'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.073089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404d1c17b009461f955ddc48e0c49a36'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.085071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2444/4888] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:57 2022] DELETE /identity/v3/users/404d1c17b009461f955ddc48e0c49a36 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:58.089572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.091550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.192757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2445/4889] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:05:58.197139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.199238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.260906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f9ae-92f6-443f-9fbc-bd48c5a16d8c tempest-UsersV3TestJSON-1885470187 tempest-UsersV3TestJSON-1885470187-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.273895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.275759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.276087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.280539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] PATH_INFO: `/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.323809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3684b0372f3b49f1a9e0c0e0229e7fe2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.323809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.430342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.430992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c2cc-5c26-4ca8-ab15-bf570c442c2f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.443793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.444505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.446439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.446727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.447469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.449765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.468268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.470589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.484687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.492821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c28ce69c-15f0-4cf4-8d8b-f483e491439c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3684b0372f3b49f1a9e0c0e0229e7fe2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:05:58.501288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2445/4890] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:05:58 2022] DELETE /identity/v3/users/3684b0372f3b49f1a9e0c0e0229e7fe2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:58.509253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2446/4891] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:05:58 2022] POST /identity/v3/projects => generated 387 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:58.511261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.511728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.512311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.517644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.521934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.549416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:05:58.550668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.685608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561ab5-ca3a-4dd2-b1c3-e35d125af906 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.690954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2446/4892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:05:58.700621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.701736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.701962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.702303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.702844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.705441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.713294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.720384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:58.765155 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2447/4893] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:05:58 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:05:58.771229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.787653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866456-5353-414d-b33e-e770e119c6e2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.795236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.795915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.797940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.798223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.799897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.804190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.823864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2448/4894] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:05:58.829665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.843266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e40c0-188d-4cd8-a330-2a8225065176 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.849195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.850410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.850410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.850710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] PATH_INFO: `/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899/users/21822f9161954586822cb38773536eb2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.852559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5ddc4-e71f-4034-8d77-384793227d21 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:58.858742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:58.859610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:58.859900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:58.860209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:58.873830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7bc59b4f3b4d8c8afd76b7da34f899, user_id=21822f9161954586822cb38773536eb2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.874545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:58.876558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.876719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:58.892607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2447/4895] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:05:58.901945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2449/4896] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:58 2022] PUT /identity/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899/users/21822f9161954586822cb38773536eb2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:05:58.903049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:58.917001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f584c0f-1452-4b8f-886d-82bd1fa98d37 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:59.039238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:59.041197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:59.041955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:59.042251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:59.042995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:59.045045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:59.065845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:59.075980 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2448/4897] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:05:59.083487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc8d-d579-4bda-b5c5-e28d3d4edf18 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:59.103666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:59.104782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:59.105069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:59.105347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] PATH_INFO: `/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899/users/21822f9161954586822cb38773536eb2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:59.108155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7bc59b4f3b4d8c8afd76b7da34f899, user_id=21822f9161954586822cb38773536eb2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:59.120590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:05:59.130031 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2450/4898] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:05:59 2022] PUT /identity/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899/users/21822f9161954586822cb38773536eb2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:05:59.801709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:05:59.803506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:05:59.829988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6119d96-272a-490a-8201-12f3c53f9c73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:05:59.933805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:05:59.935918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:05:59.936211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:05:59.937297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] PATH_INFO: `/v3/projects/06d93563873d4065bde7cba8ddc16f6d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:05:59.938708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d93563873d4065bde7cba8ddc16f6d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:05:59.942424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:00.025676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d93563873d4065bde7cba8ddc16f6d', 'request_id': 'req-fc657e61-c073-4b00-91ae-94a5f4fb16be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.038073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d93563873d4065bde7cba8ddc16f6d', 'request_id': 'req-fc657e61-c073-4b00-91ae-94a5f4fb16be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.059463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d93563873d4065bde7cba8ddc16f6d', 'request_id': 'req-fc657e61-c073-4b00-91ae-94a5f4fb16be'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.083295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] The token cache is being invalidate because project 06d93563873d4065bde7cba8ddc16f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:00.084177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.085597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.103310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2449/4899] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:05:59 2022] DELETE /identity/v3/projects/06d93563873d4065bde7cba8ddc16f6d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:00.104015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:00.106293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:00.124585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31fac-cb9a-4a34-b723-03936ed5d052 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:00.293821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:00.294724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:00.295016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:00.295301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] PATH_INFO: `/v3/users/68320a887afa46ebade35fb1fc2776ff` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:00.300062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68320a887afa46ebade35fb1fc2776ff)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:00.302888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:00.390310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68320a887afa46ebade35fb1fc2776ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.403790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68320a887afa46ebade35fb1fc2776ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.406915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68320a887afa46ebade35fb1fc2776ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.407810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68320a887afa46ebade35fb1fc2776ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.421122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6b258388-d4c8-4f11-8d57-cd9d2bce834c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68320a887afa46ebade35fb1fc2776ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:00.459726 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2451/4900] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:00 2022] DELETE /identity/v3/users/68320a887afa46ebade35fb1fc2776ff => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:02.453735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:02.476678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657e61-c073-4b00-91ae-94a5f4fb16be admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:02.629747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:02.630795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:02.631079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:02.631359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] PATH_INFO: `/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:02.634409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6beaf3f57b8944d5afa000c20fc24a9f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:02.638849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:02.739171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6beaf3f57b8944d5afa000c20fc24a9f', 'request_id': 'req-2a90bc30-46c9-41d1-b639-7d636891a1e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:02.752502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6beaf3f57b8944d5afa000c20fc24a9f', 'request_id': 'req-2a90bc30-46c9-41d1-b639-7d636891a1e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:02.764735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6beaf3f57b8944d5afa000c20fc24a9f', 'request_id': 'req-2a90bc30-46c9-41d1-b639-7d636891a1e2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:02.793969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] The token cache is being invalidate because project 6beaf3f57b8944d5afa000c20fc24a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:02.794545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:02.795367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a90bc30-46c9-41d1-b639-7d636891a1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:02.803479 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2450/4901] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:02 2022] DELETE /identity/v3/projects/6beaf3f57b8944d5afa000c20fc24a9f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:02.804143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:02.804815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:02.805910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:02.858971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:02.861661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:03.043134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.043432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.043732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.062176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2452/4902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:03.084996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:03.086520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:03.117079 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2451/4903] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:03.122249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.139555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bb4b-15af-49ce-9014-e47e1fc02d4f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.160681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.162004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.162546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.163100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.164232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:03.164877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.166971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.205535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.218589 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2453/4904] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:06:03.221482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb9d86-eec2-482b-8b87-b380d6828869 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.235061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.236167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.236648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.237082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.237937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.241543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.327721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.335561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2452/4905] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:03 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:03.344658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821253-85a7-4510-9a0d-01a6377fa2fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.538381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.541218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.542896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.544303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.545383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.548007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.596950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2454/4906] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:03 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:06:03.602218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.614777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d57562-a640-4784-82f6-67c243d4c9d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.629921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.630619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.637880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.638244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.639032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.642899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.689222 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2453/4907] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:03.693711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.711479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5cc4c-bf86-4cdd-9bc9-bd2691be35a2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.725516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.726660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.727055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.727489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.729040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.735895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14399c5-196f-4c2e-85f4-dc2755775f32 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.783652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2455/4908] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:03.788218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:03.806225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b37ff-20b1-4775-a329-f6f828e372da admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:03.825206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:03.826135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.826423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.826705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] PATH_INFO: `/v3/projects/5546656f244f4690b75cbd2362539ad5/users/b1242504da684cacb5914f7178644d49/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.861060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5546656f244f4690b75cbd2362539ad5, user_id=b1242504da684cacb5914f7178644d49, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:03.863753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:03.889111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2454/4909] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:03 2022] PUT /identity/v3/projects/5546656f244f4690b75cbd2362539ad5/users/b1242504da684cacb5914f7178644d49/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:03.899437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:03.900629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:03.900750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:03.944739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] MFA Rules not processed for user `b1242504da684cacb5914f7178644d49`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:03.945959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:04.128486 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2456/4910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:04.133831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:04.149550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a38098-da6b-45c0-8536-ac5a7edf00b0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:04.170822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1242504da684cacb5914f7178644d49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5546656f244f4690b75cbd2362539ad5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:04.171702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.172001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.172372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] PATH_INFO: `/v3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.176968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2455/4911] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/v3 => generated 255 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:06:04.181338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:04.199815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666cd9-6adc-4b66-b0b6-cb95cbc3532f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:04.213943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785c4db-234b-40cb-baeb-3015ce68a18e tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1242504da684cacb5914f7178644d49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5546656f244f4690b75cbd2362539ad5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:04.214656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c4db-234b-40cb-baeb-3015ce68a18e tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.214948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c4db-234b-40cb-baeb-3015ce68a18e tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.215235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c4db-234b-40cb-baeb-3015ce68a18e tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] PATH_INFO: `/v3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.217162 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2457/4912] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:06:04.221621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:04.231679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1f51-8e86-4962-b10e-cfa716ded8c4 tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:04.245240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9060-58be-4320-a3dc-535ba046b6cb tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1242504da684cacb5914f7178644d49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5546656f244f4690b75cbd2362539ad5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:04.281305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9060-58be-4320-a3dc-535ba046b6cb tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.281648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9060-58be-4320-a3dc-535ba046b6cb tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.281891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9060-58be-4320-a3dc-535ba046b6cb tempest-TestApiDiscovery-2070874760 tempest-TestApiDiscovery-2070874760-project] PATH_INFO: `/v3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.283466 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2456/4913] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/v3 => generated 255 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:06:04.289166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9b2e-e1c1-4556-9f67-e2157127362f None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.289502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9b2e-e1c1-4556-9f67-e2157127362f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.289793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9b2e-e1c1-4556-9f67-e2157127362f None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.291681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2458/4914] 10.222.0.18 () {56 vars in 894 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:06:04.302137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b80c1-5752-4220-8364-47bccd3c5e1d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.302435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b80c1-5752-4220-8364-47bccd3c5e1d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.302721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b80c1-5752-4220-8364-47bccd3c5e1d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.309817 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2457/4915] 10.222.0.18 () {56 vars in 894 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:06:04.310055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9b2e-e1c1-4556-9f67-e2157127362f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:04.446772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9b2e-e1c1-4556-9f67-e2157127362f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:04.455967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:04.456901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.457188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.457470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] PATH_INFO: `/v3/users/b1242504da684cacb5914f7178644d49` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.458727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1242504da684cacb5914f7178644d49)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:04.461969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:04.553176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1242504da684cacb5914f7178644d49'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:04.579667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1242504da684cacb5914f7178644d49'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:04.582040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1242504da684cacb5914f7178644d49'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:04.582876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1242504da684cacb5914f7178644d49'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:04.597379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1242504da684cacb5914f7178644d49'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:04.637867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2459/4916] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:04 2022] DELETE /identity/v3/users/b1242504da684cacb5914f7178644d49 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:04.642098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.642612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.642897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.669414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:04.670658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:04.754894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2458/4917] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:04.771294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:04.773049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:04.964088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67a5c6-b6c0-492e-8abb-8b9924e1bd3a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:04.970251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:04.970923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:04.971254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:04.971551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:04.988283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:04.989428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c05d5-5c14-4f0e-a672-74725fb904ad service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:05.003174 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2460/4918] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:06.028373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:06.031810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:06.069147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940402e1-9d59-4cf2-a840-fcad54e19db7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:06.084883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:06.087442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.088754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.089038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] PATH_INFO: `/v3/projects/5546656f244f4690b75cbd2362539ad5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.101568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5546656f244f4690b75cbd2362539ad5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:06.106051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:06.221837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5546656f244f4690b75cbd2362539ad5', 'request_id': 'req-88e67271-9907-403d-8be6-54b2a962dba5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:06.241308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5546656f244f4690b75cbd2362539ad5', 'request_id': 'req-88e67271-9907-403d-8be6-54b2a962dba5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:06.256714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5546656f244f4690b75cbd2362539ad5', 'request_id': 'req-88e67271-9907-403d-8be6-54b2a962dba5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:06.279133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] The token cache is being invalidate because project 5546656f244f4690b75cbd2362539ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:06.279928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:06.280863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-88e67271-9907-403d-8be6-54b2a962dba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:06.283701 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2459/4919] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:06 2022] DELETE /identity/v3/projects/5546656f244f4690b75cbd2362539ad5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:06.292626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9f2e-d820-4007-907b-bafe59130b0d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.293441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9f2e-d820-4007-907b-bafe59130b0d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.294173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9f2e-d820-4007-907b-bafe59130b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.335724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-149e9f2e-d820-4007-907b-bafe59130b0d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:06.340294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.340623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.340905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.351394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-149e9f2e-d820-4007-907b-bafe59130b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:06.381298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:06.391712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:06.493612 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2461/4920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:06.508441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531742c-c856-429a-be73-78d383493917 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.513073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531742c-c856-429a-be73-78d383493917 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.514601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531742c-c856-429a-be73-78d383493917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.558646 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2460/4921] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:06.564625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8531742c-c856-429a-be73-78d383493917 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:06.567572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8531742c-c856-429a-be73-78d383493917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:06.582869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:06.585502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:06.607080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2462/4922] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:06.610943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531742c-c856-429a-be73-78d383493917 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:06.630462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531742c-c856-429a-be73-78d383493917 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:06.647039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:06.649894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.651549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.652283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.653307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:06.654048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:06.659655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:06.690467 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2463/4923] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:06:06.692072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:06.726302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb183-5fd6-4a0c-b1d6-691fe5356191 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:06.738467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:06.739531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.740680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.742196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.745009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:06.750176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:06.790982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddcd6d-f45b-4691-97c9-8029d3f73da5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:06.809775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:06.811936 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2464/4924] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:06 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:06.817345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.818075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.818471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.819538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:06.837944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:06.843633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:06.867439 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2461/4925] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:06:06.956339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78ea22-4ff5-48e1-b2b3-ed0e79653c12 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:06.963589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:06.964495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:06.966573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:06.967118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:06.967837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:06.973553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:07.019284 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2465/4926] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:06 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:07.020728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:07.050339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bafa2-f396-44e0-a932-b7c3a170746a service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:07.067581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:07.068745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:07.069074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:07.069361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:07.077008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:07.078735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:07.118476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2462/4927] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:07.120438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:07.160318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa2eb-2950-4b9b-ad02-6a17fc13f036 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:07.177064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:07.178596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:07.182223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:07.182841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:07.186059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:07.189925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a391d3-901f-44b8-a7b5-b0b71117c67e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:07.237751 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2466/4928] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:07.241462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:07.260619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034707-8d8f-4b3d-93dd-85d78cabc956 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:07.275332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:07.276796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:07.277273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:07.278389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] PATH_INFO: `/v3/projects/be81ba50b2ca435087fa9a3bf8f9734f/users/5437146a63f7436cabca490ac783a68e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:07.321385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be81ba50b2ca435087fa9a3bf8f9734f, user_id=5437146a63f7436cabca490ac783a68e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:07.329376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:07.355494 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2463/4929] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:07 2022] PUT /identity/v3/projects/be81ba50b2ca435087fa9a3bf8f9734f/users/5437146a63f7436cabca490ac783a68e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:07.365724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:07.366239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:07.366456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:07.419039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] MFA Rules not processed for user `5437146a63f7436cabca490ac783a68e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:07.420314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:07.581165 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2467/4930] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:06:07.586359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:07.741490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec3572-4911-4872-a29b-ecb9753c8654 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:07.761702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:07.762756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:07.763498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:07.764190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:07.765252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:07.767457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:07.836374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2464/4931] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:07 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:07.840042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:07.856900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c7ea7-e468-41e1-a370-98d8d9239d8d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:08.053380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:08.056725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.058347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.058908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.060013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:08.062331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:08.105158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2468/4932] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:07 2022] POST /identity/v3/users => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:08.109019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:08.126756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae2c2b-9f8f-44aa-9304-94cf49fa1c7c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:08.141644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:08.142339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.142626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.142907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.143797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:08.145593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:08.178704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2465/4933] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:08.181635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:08.213521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e7828-5153-4b33-94c0-517876a7af0d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:08.238036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:08.238958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.239421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.239712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] PATH_INFO: `/v3/projects/3280df9d683747f6b6be45efed867f5a/users/43b36306b05648ea92351bc58e948a78/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.272388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3280df9d683747f6b6be45efed867f5a, user_id=43b36306b05648ea92351bc58e948a78, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:08.281992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:08.317862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2469/4934] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:08 2022] PUT /identity/v3/projects/3280df9d683747f6b6be45efed867f5a/users/43b36306b05648ea92351bc58e948a78/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:08.318886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:08.333724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a1c9-155a-4727-8089-7fa0880b3c29 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:08.476509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:08.477494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.477941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.490840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.495418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:08.511939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfc7eb-d73c-40a1-a968-9a3710797db7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:08.562149 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2466/4935] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:08.567117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:08.582698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f611-9d15-47f3-8b45-d7767345a06a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:08.589504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:08.591128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.591610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.593587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] PATH_INFO: `/v3/projects/3280df9d683747f6b6be45efed867f5a/users/43b36306b05648ea92351bc58e948a78/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.597103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3280df9d683747f6b6be45efed867f5a, user_id=43b36306b05648ea92351bc58e948a78, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:08.602456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:08.636847 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2470/4936] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:08 2022] PUT /identity/v3/projects/3280df9d683747f6b6be45efed867f5a/users/43b36306b05648ea92351bc58e948a78/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:08.652509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3347f-d01d-44bf-b2b8-5241d5274e1a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:08.653157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3347f-d01d-44bf-b2b8-5241d5274e1a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:08.653636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3347f-d01d-44bf-b2b8-5241d5274e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:08.747154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f3b3347f-d01d-44bf-b2b8-5241d5274e1a None None] MFA Rules not processed for user `43b36306b05648ea92351bc58e948a78`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:08.757914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f3b3347f-d01d-44bf-b2b8-5241d5274e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:08.918794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2467/4937] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:08.959446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:08.962116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:09.106674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c2ed-1245-489a-a58b-90e623536947 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:09.112448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:09.115190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:09.116107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:09.116803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:09.257657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:09.259562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:09.271807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2471/4938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:10.378793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:10.379758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:10.379758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:10.426868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] MFA Rules not processed for user `21822f9161954586822cb38773536eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:10.429261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:10.568049 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2468/4939] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:10.582102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:10.583870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:10.687189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc7920-e7d6-4ce1-a69d-630a6079be78 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:10.700704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:10.701519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:10.701931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:10.702317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:10.705177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:10.777085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:10.779328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:10.791705 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2472/4940] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:13.918013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:13.919542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:14.069428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd8c0-b309-4db1-b4f4-2d1ac872532a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:14.081040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:14.082449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:14.082912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:14.083352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] PATH_INFO: `/v3/users/b3fba445dba44b79a1e912e2cf10c905` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:14.085618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fba445dba44b79a1e912e2cf10c905)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:14.092711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:14.197441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fba445dba44b79a1e912e2cf10c905'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:14.226714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fba445dba44b79a1e912e2cf10c905'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:14.227760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fba445dba44b79a1e912e2cf10c905'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:14.238432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fba445dba44b79a1e912e2cf10c905'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:14.249079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fba445dba44b79a1e912e2cf10c905'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:14.264219 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2469/4941] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:13 2022] DELETE /identity/v3/users/b3fba445dba44b79a1e912e2cf10c905 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:14.436667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:14.475671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f726e-d08c-46e6-aeac-72bd4b721685 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:14.622151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:14.638144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:14.638783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:14.639194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:14.646520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:14.823126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:14.825679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846d7c-f1c4-43a9-9213-574245d08fb3 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:14.836586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:14.840234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2473/4942] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:14.841237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:14.972234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcec91-8d39-467b-a1ba-d60bfc3679fb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:14.979444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:14.980348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:14.980691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:14.980972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] PATH_INFO: `/v3/projects/a5aab95c86ad418185090595372fd48c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:14.982480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5aab95c86ad418185090595372fd48c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:14.985871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:15.080499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5aab95c86ad418185090595372fd48c', 'request_id': 'req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:15.088360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5aab95c86ad418185090595372fd48c', 'request_id': 'req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:15.098968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5aab95c86ad418185090595372fd48c', 'request_id': 'req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:15.136248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] The token cache is being invalidate because project a5aab95c86ad418185090595372fd48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:15.137790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:15.140718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4ea1dd1f-2cb8-4b40-a365-9788f0f46587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:15.144722 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2470/4943] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:14 2022] DELETE /identity/v3/projects/a5aab95c86ad418185090595372fd48c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:15.149962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.150565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.151270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.192280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:15.193570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:15.350613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2474/4944] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:15.358676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.359287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.359729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.404110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:15.405849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:15.425771 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2471/4945] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:15.426608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:15.439869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2f5a7-2c33-4305-9e34-e616ab8d5f9b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:15.450878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:15.451573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.451862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.452139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.455079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:15.455398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:15.457979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:15.510467 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2475/4946] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:06:15.511933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:15.526569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da30803-6b01-4fa3-bf9f-60bd61fb93e8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:15.548602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:15.549297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.549638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.549923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.550616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:15.557192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:15.628338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2472/4947] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:15 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:15.632185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:15.647693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c3096-d536-4699-91e0-47950fa3fb91 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:15.810253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:15.811485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.812106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.812896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.813856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:15.816222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:15.862818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2476/4948] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:15 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:15.867540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:15.903464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc889-e064-4f62-9fb8-82ea748aa130 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:15.917248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:15.917944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:15.918229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:15.918504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:15.919291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:15.921046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:15.951787 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2473/4949] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:15.952694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:15.981866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6d44-dee9-4d71-b928-0338e851da58 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:16.001032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:16.002021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:16.002494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:16.002930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:16.003838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:16.005748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed4c95-471a-459c-ace7-e43fc931523e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:16.036740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2477/4950] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:16.047811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:16.069382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f915-7e9e-4948-a562-9e8e0e99ef82 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:16.078608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:16.079815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:16.080258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:16.080726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] PATH_INFO: `/v3/projects/9d575ad1b73d40c4a8a1c7e0455886ce/users/8c887a3020eb4d0fbf93b55a1aba87a8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:16.131026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d575ad1b73d40c4a8a1c7e0455886ce, user_id=8c887a3020eb4d0fbf93b55a1aba87a8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:16.134920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:16.160096 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2474/4951] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:16 2022] PUT /identity/v3/projects/9d575ad1b73d40c4a8a1c7e0455886ce/users/8c887a3020eb4d0fbf93b55a1aba87a8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:16.167190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:16.167392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:16.167701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:16.197558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:16.198856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:16.326461 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2478/4952] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:06:16.333022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:16.335096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:16.434500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1ba9-624b-4942-96f1-92eaf2271b75 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:16.457153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:16.459860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:16.460498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:16.461048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:16.475591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:16.484351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aa985-ec9c-4ace-af77-0bca2a73f66b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:16.499194 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2475/4953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:19.729166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:19.730743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:19.749377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1442-07ae-4827-872d-907ecd109bce None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:19.775801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:19.776976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:19.777377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:19.777838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] PATH_INFO: `/v3/users/5437146a63f7436cabca490ac783a68e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:19.780317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5437146a63f7436cabca490ac783a68e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:19.785307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:19.895141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5437146a63f7436cabca490ac783a68e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:19.910312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5437146a63f7436cabca490ac783a68e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:19.911174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5437146a63f7436cabca490ac783a68e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:19.912016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5437146a63f7436cabca490ac783a68e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:19.927513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5437146a63f7436cabca490ac783a68e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:19.957686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2479/4954] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:19 2022] DELETE /identity/v3/users/5437146a63f7436cabca490ac783a68e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:19.965445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:19.966021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:19.967546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:20.000977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:20.002356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:20.092362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2476/4955] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:20.102839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:20.105117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:20.175307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e601d-3d83-4192-9e89-93d55d914850 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:20.180902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:20.180902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:20.180902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:20.181302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:20.193426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:20.195073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:20.206903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2480/4956] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:20.451675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:20.455682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:20.481308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b52dfe-84e5-46e5-b9b4-4f7e7616f9d7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:20.487161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:20.488041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:20.488322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:20.488648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] PATH_INFO: `/v3/projects/be81ba50b2ca435087fa9a3bf8f9734f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:20.489934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be81ba50b2ca435087fa9a3bf8f9734f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:20.492151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:20.542604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be81ba50b2ca435087fa9a3bf8f9734f', 'request_id': 'req-ced62a61-a205-4736-a3ef-1dffb3a8b85c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.549016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be81ba50b2ca435087fa9a3bf8f9734f', 'request_id': 'req-ced62a61-a205-4736-a3ef-1dffb3a8b85c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.554855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be81ba50b2ca435087fa9a3bf8f9734f', 'request_id': 'req-ced62a61-a205-4736-a3ef-1dffb3a8b85c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.567995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] The token cache is being invalidate because project be81ba50b2ca435087fa9a3bf8f9734f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:20.568409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.569330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.571093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2477/4957] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:20 2022] DELETE /identity/v3/projects/be81ba50b2ca435087fa9a3bf8f9734f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:20.575307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:20.585649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce14e28-4bcb-423b-9c45-a60090eddda0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:20.650203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:20.651092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:20.651372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:20.651644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] PATH_INFO: `/v3/users/43b36306b05648ea92351bc58e948a78` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:20.652904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b36306b05648ea92351bc58e948a78)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:20.654872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:20.715213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b36306b05648ea92351bc58e948a78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.723631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b36306b05648ea92351bc58e948a78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.724735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b36306b05648ea92351bc58e948a78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.725555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b36306b05648ea92351bc58e948a78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.733229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7200df7-4fe8-4269-b268-dde00bf7f5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b36306b05648ea92351bc58e948a78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:20.757627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2481/4958] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:20 2022] DELETE /identity/v3/users/43b36306b05648ea92351bc58e948a78 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:21.467425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:21.470711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:21.504370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced62a61-a205-4736-a3ef-1dffb3a8b85c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:21.626680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:21.628019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:21.628747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:21.630330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] PATH_INFO: `/v3/projects/3280df9d683747f6b6be45efed867f5a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:21.631929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3280df9d683747f6b6be45efed867f5a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:21.634709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:21.744947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3280df9d683747f6b6be45efed867f5a', 'request_id': 'req-77424851-0f96-45c1-9431-2f904a8e55d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:21.754822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3280df9d683747f6b6be45efed867f5a', 'request_id': 'req-77424851-0f96-45c1-9431-2f904a8e55d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:21.764863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3280df9d683747f6b6be45efed867f5a', 'request_id': 'req-77424851-0f96-45c1-9431-2f904a8e55d4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:21.802424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] The token cache is being invalidate because project 3280df9d683747f6b6be45efed867f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:21.803062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:21.807691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-77424851-0f96-45c1-9431-2f904a8e55d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:21.813696 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2478/4959] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:21 2022] DELETE /identity/v3/projects/3280df9d683747f6b6be45efed867f5a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:21.819713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:21.821061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:21.823317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:21.885342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:21.888956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:22.033513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2482/4960] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:22.043985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.045647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.046315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.117210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:22.123505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:22.155737 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2479/4961] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:22.161293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.177766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430ed9-257e-4604-90cd-46f2c66ba7f9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.183096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.183778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.184061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.184343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.185143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:22.185447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.187724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.207186 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2483/4962] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:06:22.208275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.227118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8f445-a74e-40e1-89fe-7041ccdac7d7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.240262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.242197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.242498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.242780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.243542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.247744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.319311 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2480/4963] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:22 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:06:22.323908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.347047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d301-53e2-4252-be99-3db0b8311e61 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.434608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.436692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.437151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.438957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.439867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.442471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.493741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.494543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2484/4964] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:22 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:06:22.514397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5911-24a1-4e02-8a78-7c6dcc32cbc2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.521200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.521951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.522239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.522516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.524740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.527213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.549537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2481/4965] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:22.550833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.567914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec1a67-9337-466e-928a-260bd19c82d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.575165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.578963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.579475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.579977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.581799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.586769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9145-8223-47ee-8d0e-fa0de418dd63 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.610659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.624827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2485/4966] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:22.625213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624be0b-2051-4407-a898-4a970e507c51 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:22.634417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:22.635512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.635798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.636073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] PATH_INFO: `/v3/projects/579dee8218df4553a23f900f07ee2b91/users/620b8c86cf4c4005886acdb52bcb51d5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.665982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=579dee8218df4553a23f900f07ee2b91, user_id=620b8c86cf4c4005886acdb52bcb51d5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:22.670377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:22.696936 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2482/4967] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:22 2022] PUT /identity/v3/projects/579dee8218df4553a23f900f07ee2b91/users/620b8c86cf4c4005886acdb52bcb51d5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:22.704615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950227c2-481a-4fbd-bc95-8ecf6103bdcb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:22.704915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950227c2-481a-4fbd-bc95-8ecf6103bdcb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:22.705525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950227c2-481a-4fbd-bc95-8ecf6103bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:22.751890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-950227c2-481a-4fbd-bc95-8ecf6103bdcb None None] MFA Rules not processed for user `620b8c86cf4c4005886acdb52bcb51d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:22.753938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-950227c2-481a-4fbd-bc95-8ecf6103bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:22.854545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2486/4968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:06:22.896286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:22.902309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:23.015995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55af0d-30e1-44df-92a7-e69af5bb5e0d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:23.025320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:23.026354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:23.026848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:23.027305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:23.052447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:23.054593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebec5a-92e2-464a-b521-74cc9d5de8a1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:23.077181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2483/4969] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:25.706178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:25.707264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:25.707874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:25.751830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] MFA Rules not processed for user `5331b96019b4418a8aa6a1facd9e1c06`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:25.753288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:25.935303 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2487/4970] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:28.433751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66c4c-27e4-418e-bfc6-b6fd1479490f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:28.434174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66c4c-27e4-418e-bfc6-b6fd1479490f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:28.434361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66c4c-27e4-418e-bfc6-b6fd1479490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:28.486212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8fe66c4c-27e4-418e-bfc6-b6fd1479490f None None] MFA Rules not processed for user `8c887a3020eb4d0fbf93b55a1aba87a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:28.489232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8fe66c4c-27e4-418e-bfc6-b6fd1479490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:28.636342 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2484/4971] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:28.649929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:28.651546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:28.865605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac078-9242-4c70-b691-4199ea2104e3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:28.916235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:28.921067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:28.925113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:28.927489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:28.967731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:28.971945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c20ec-4179-4ab7-9e6b-2d5937c806cb service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:29.015197 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2488/4972] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:33.433219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709ec-7bc7-41e8-b996-43d783f129e7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:33.435720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709ec-7bc7-41e8-b996-43d783f129e7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:33.436289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578709ec-7bc7-41e8-b996-43d783f129e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:33.474835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-578709ec-7bc7-41e8-b996-43d783f129e7 None None] MFA Rules not processed for user `e5d1c36098a14436a0a10f4fb9937bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:33.476762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-578709ec-7bc7-41e8-b996-43d783f129e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:33.647359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2485/4973] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:33.658919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:33.658919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:33.658919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:33.686704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] MFA Rules not processed for user `e5d1c36098a14436a0a10f4fb9937bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:33.688655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:33.702688 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2489/4974] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:34.216145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:34.216721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:34.217194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:34.238439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] MFA Rules not processed for user `8c887a3020eb4d0fbf93b55a1aba87a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:34.239910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:34.252879 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2486/4975] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:37.305672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:37.307196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:37.322951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65951a44-ec17-4731-959d-6a0a9213ae55 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:37.331070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:37.331844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:37.332197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:37.333235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:37.336180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:37.358371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:37.360357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:37.426137 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2490/4976] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:38.526418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:38.542066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f79edf-62af-4641-a2b2-d4983cd2e955 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:38.546146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:38.547002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:38.548276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:38.548778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:38.551213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:38.573597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:38.576703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:38.594985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2487/4977] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:39.965121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:39.980335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b236c-c072-4f51-9d6c-2bf60ad0653c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:39.996737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:39.997497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:39.997788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:39.998063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:40.005614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:40.046145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:40.047777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a595f16-2b18-46ef-88b2-6878cdb14317 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:40.078781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2491/4978] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:40.457682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:40.564352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e4f70-d92e-484c-8357-b6a2eaa203a1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:40.570242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:40.571155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:40.571641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:40.572140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] PATH_INFO: `/v3/users/620b8c86cf4c4005886acdb52bcb51d5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:40.573748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620b8c86cf4c4005886acdb52bcb51d5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:40.576439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:40.647365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620b8c86cf4c4005886acdb52bcb51d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:40.665192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620b8c86cf4c4005886acdb52bcb51d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:40.666247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620b8c86cf4c4005886acdb52bcb51d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:40.677723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620b8c86cf4c4005886acdb52bcb51d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:40.688766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620b8c86cf4c4005886acdb52bcb51d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:40.696822 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2488/4979] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:40 2022] DELETE /identity/v3/users/620b8c86cf4c4005886acdb52bcb51d5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:40.701180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:40.701895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:40.702654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:40.745576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:40.748404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:40.833909 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2492/4980] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:06:40.859271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:40.866487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:40.951517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d575428-d9a0-4fc7-a18f-606119d60b08 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:40.955938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:40.956671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:40.956963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:40.957294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:40.970275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:40.971972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d071a1-5dfa-4e2f-a925-1e4baa006212 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:40.985768 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2489/4981] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:41.798923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:41.801112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:41.822701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1700-b835-4b6b-8682-5537d0605138 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:41.830095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:41.831265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:41.832241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:41.832709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] PATH_INFO: `/v3/projects/579dee8218df4553a23f900f07ee2b91` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:41.840046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579dee8218df4553a23f900f07ee2b91)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:41.843433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:41.903519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579dee8218df4553a23f900f07ee2b91', 'request_id': 'req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:41.909909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579dee8218df4553a23f900f07ee2b91', 'request_id': 'req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:41.916990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579dee8218df4553a23f900f07ee2b91', 'request_id': 'req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:41.928799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] The token cache is being invalidate because project 579dee8218df4553a23f900f07ee2b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:41.929102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:41.929761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af2c4d73-9b8e-428a-a7af-7f8d7f7278d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:41.931632 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2493/4982] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:41 2022] DELETE /identity/v3/projects/579dee8218df4553a23f900f07ee2b91 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:41.936399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:41.936921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:41.937020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:41.960522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:41.962302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:42.032670 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2490/4983] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:42.037966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.038369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.038783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.059100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:42.060876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:42.078118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2494/4984] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:42.079025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.088733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e80d0-aa92-4cfb-9119-aae4e736afd1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.094171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.095045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.095524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.095809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.096577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:42.096888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.098643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.111134 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2491/4985] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:06:42.116138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.133064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab480-898a-4ba3-89d8-7b0e643ae99a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.147828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.148573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.148905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.149330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.150087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.152075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.188631 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2495/4986] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:42 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:42.189905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.206872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b60c-9889-4e96-800a-655f3610a8ae admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.281947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.282642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.282986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.283211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.283899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.285945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.317687 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2492/4987] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:42 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:42.321674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.333186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592804-ef09-4641-b90d-ee73bc52fc26 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.338291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.339440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.339982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.340523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.341534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.343375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.357639 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2496/4988] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:42.361619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.376818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547f26a-7f12-4481-b5dd-943e3c78e8a6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.382561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.383768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.384232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.384927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.386111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.391619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109e654-adf5-4a4c-bf04-a06f382258e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.404076 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2493/4989] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:42.408092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.419451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15734-1ef1-4a00-adb4-35f2b54ee375 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.424405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.425501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.425791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.426071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] PATH_INFO: `/v3/projects/efdf4d4cf65e4dbb9adc52b8c0bba01c/users/3f74cb5a8b8f45318dd09b8bedaa6433/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.447605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdf4d4cf65e4dbb9adc52b8c0bba01c, user_id=3f74cb5a8b8f45318dd09b8bedaa6433, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.450763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.466945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2497/4990] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:42 2022] PUT /identity/v3/projects/efdf4d4cf65e4dbb9adc52b8c0bba01c/users/3f74cb5a8b8f45318dd09b8bedaa6433/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:06:42.478083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.478184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.478440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.514003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] MFA Rules not processed for user `3f74cb5a8b8f45318dd09b8bedaa6433`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:42.515742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:42.593314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2494/4991] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:42.604126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:42.605829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:42.679394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d09ba-6fae-4e9c-8999-26691d1e9496 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:42.684427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:42.685383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:42.685878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:42.686275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:42.696827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:42.698534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:42.730997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2498/4992] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:52.895044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:52.897066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:53.031723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff46cf0-8eb3-45b6-9227-339fff5a6b40 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:53.037249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:53.038212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:53.038668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:53.039707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] PATH_INFO: `/v3/users/5331b96019b4418a8aa6a1facd9e1c06` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:53.041558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5331b96019b4418a8aa6a1facd9e1c06)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:53.043568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:53.112837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5331b96019b4418a8aa6a1facd9e1c06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.146521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5331b96019b4418a8aa6a1facd9e1c06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.147643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5331b96019b4418a8aa6a1facd9e1c06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.180678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5331b96019b4418a8aa6a1facd9e1c06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.195371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34282ae4-ba5d-4da8-9352-deca28df49f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5331b96019b4418a8aa6a1facd9e1c06'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.211867 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2495/4993] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:06:52 2022] DELETE /identity/v3/users/5331b96019b4418a8aa6a1facd9e1c06 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:53.690695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:53.712111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfe18-796c-4204-a50b-5ae7991ce573 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:53.810579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:53.811891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:53.812236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:53.812767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] PATH_INFO: `/v3/projects/7f1a5e5adf8141058ce50ee9295e57cc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:53.814160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1a5e5adf8141058ce50ee9295e57cc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:53.816537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:53.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1a5e5adf8141058ce50ee9295e57cc', 'request_id': 'req-b7ac37dd-5864-4f8e-8468-6331aaafe5af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.910024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1a5e5adf8141058ce50ee9295e57cc', 'request_id': 'req-b7ac37dd-5864-4f8e-8468-6331aaafe5af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.926683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1a5e5adf8141058ce50ee9295e57cc', 'request_id': 'req-b7ac37dd-5864-4f8e-8468-6331aaafe5af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.947834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] The token cache is being invalidate because project 7f1a5e5adf8141058ce50ee9295e57cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:06:53.948066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.948805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b7ac37dd-5864-4f8e-8468-6331aaafe5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:06:53.952399 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2499/4994] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:06:53 2022] DELETE /identity/v3/projects/7f1a5e5adf8141058ce50ee9295e57cc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:06:53.959889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:53.961919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:53.962459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:53.986664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:53.990539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:54.097426 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2496/4995] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:54.106664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.107874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.108260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.156430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:54.166827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:54.211463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2500/4996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:54.215805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.234945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eb533-8709-40f4-977c-72d2ee317ac5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.241426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.242896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.243499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.243783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.244558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:06:54.244870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.246707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.265309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2497/4997] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:06:54.269995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.297558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798464d-594d-4b1f-b47d-2f5f07dc2e04 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.304341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.306012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.306294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.306577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.307897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.314106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.353064 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2501/4998] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:06:54 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:06:54.358038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.372019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba4354-b2d1-4445-922d-ebcbfa02f82a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.473098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.473981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.475874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.476167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.477683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.480303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.516548 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2498/4999] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:06:54 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:06:54.519468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.536013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ae904-a4d6-4347-b9f3-39f80ece41d2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.543810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.544744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.545207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.545790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.546892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.548923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.563881 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2502/5000] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:54.583168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.594994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b29b6-2177-40bf-b21e-a08bd679ba4a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.601171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.603226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.603697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.604209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.605179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.607173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490b98-4113-4f94-bdde-5524e2174df1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.624182 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2499/5001] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:06:54.628561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.642844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704d67-fbca-41d9-a585-84d4b4cd2576 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.649691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.651051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.651379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.651765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] PATH_INFO: `/v3/projects/6a2dc7aaed2f489fa941c447aa5e3aa7/users/d20c714151f14238a665d9760bec1d66/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.673912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2dc7aaed2f489fa941c447aa5e3aa7, user_id=d20c714151f14238a665d9760bec1d66, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.676839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:54.695734 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2503/5002] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:06:54 2022] PUT /identity/v3/projects/6a2dc7aaed2f489fa941c447aa5e3aa7/users/d20c714151f14238a665d9760bec1d66/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:06:54.700733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.701206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.701732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.721478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:54.722833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:54.808914 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2500/5003] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:06:54.871416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:54.876816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:54.944859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a50e-cec3-4aa2-95d6-2d1b308f1693 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:54.949204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:54.950272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:54.959263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:54.959748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:54.977998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:54.981072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:55.007873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2504/5004] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:55.713679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:55.717081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:55.877819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db751fa1-43bc-4756-bdb6-554041e61177 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:55.885144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:55.886333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:55.886796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:55.887316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:55.889742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:55.906531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:55.909102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bef9c8-a1ea-4dbf-9697-8552aea4d2df service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:55.931489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2501/5005] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:56.098405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:56.111968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52faa0-f559-4f85-872d-ff326879d072 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:56.134617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:56.135766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:56.136342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:56.136819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:56.141041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:56.169784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:56.173524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8792a-3521-44c9-9698-ec0e22a92fa5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:56.197177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2505/5006] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:57.896765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:57.897289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:57.897289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:57.936107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] MFA Rules not processed for user `d20c714151f14238a665d9760bec1d66`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:57.937941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:58.041677 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2502/5007] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:58.053588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:58.054145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:58.054145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:58.085190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] MFA Rules not processed for user `d20c714151f14238a665d9760bec1d66`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:06:58.088352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:58.100819 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2506/5008] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:06:58.116789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:58.136083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dca03-2bcc-4a8b-b798-e3b5f188f65f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:58.143028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:58.143697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:58.143984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:58.144262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:58.155548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:58.157635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:58.171546 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2503/5009] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:06:59.203135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:06:59.206341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:59.353749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec5e9-cd80-42a8-8a0a-df5c5ea59301 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:06:59.363471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:06:59.364560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:06:59.365109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:06:59.365536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:06:59.368724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:06:59.386391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:06:59.388910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e44f2-a7e5-44dd-905b-8edac976ac4f service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:06:59.408768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2507/5010] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:10.094264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:10.096179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.112408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ccc11-973c-49b7-8589-cecb4109edc9 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:10.117050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:10.117931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.118222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.118507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] PATH_INFO: `/v3/users/3f74cb5a8b8f45318dd09b8bedaa6433` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.119694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f74cb5a8b8f45318dd09b8bedaa6433)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:10.121642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:10.176798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f74cb5a8b8f45318dd09b8bedaa6433'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.193646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f74cb5a8b8f45318dd09b8bedaa6433'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.194528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f74cb5a8b8f45318dd09b8bedaa6433'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.205192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f74cb5a8b8f45318dd09b8bedaa6433'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.216946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f74cb5a8b8f45318dd09b8bedaa6433'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.225618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2504/5011] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:10 2022] DELETE /identity/v3/users/3f74cb5a8b8f45318dd09b8bedaa6433 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:10.230574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.231768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.232106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.251885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:10.253602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.320217 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2508/5012] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:10.330193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:10.331713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.391400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016838-28f8-462c-8000-599c2b0a8ec2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:10.395069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:10.395726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.396010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.396289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.406228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:10.407704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce2012-a52f-4dd0-8d73-fd79f567a8af service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:10.417706 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2505/5013] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:10.602538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:10.604976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.626684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5bcb1-f89a-493b-9e1a-f800101dbf66 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:10.639580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:10.640472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.641009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.641500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] PATH_INFO: `/v3/projects/efdf4d4cf65e4dbb9adc52b8c0bba01c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.652965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdf4d4cf65e4dbb9adc52b8c0bba01c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:10.654952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:10.713726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdf4d4cf65e4dbb9adc52b8c0bba01c', 'request_id': 'req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.720915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdf4d4cf65e4dbb9adc52b8c0bba01c', 'request_id': 'req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.746942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdf4d4cf65e4dbb9adc52b8c0bba01c', 'request_id': 'req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.770206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] The token cache is being invalidate because project efdf4d4cf65e4dbb9adc52b8c0bba01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:10.771638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.773147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3eb6e70-f433-4f7a-b8c3-cf39a01ee1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:10.775561 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2509/5014] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:10 2022] DELETE /identity/v3/projects/efdf4d4cf65e4dbb9adc52b8c0bba01c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:10.780260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.780590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.780876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.808088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:10.810762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.903749 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2506/5015] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:10.905968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.906474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.906766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.926827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:10.928014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:10.937427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2510/5016] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:10.941842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:10.951824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5e7c-687d-4999-b581-a3bf034fb15f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:10.956371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:10.957059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.957346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.957624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.958343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:10.958653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:10.960288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:10.971596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2507/5017] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:10.975705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:10.985620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29920e2-48fa-4e17-a5ab-a94e0b1a2a7c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:10.990264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:10.990914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:10.991198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:10.991503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:10.992856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:10.994757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.019144 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2511/5018] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:10 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:11.023273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.033329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f0e44-28a1-418a-bed5-28e2ab1755bd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.094118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.094785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.095352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.095352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.096020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.097962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.118116 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2508/5019] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:11 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:11.122326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.132757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516ea86-9ba9-48b4-9199-e8e2f1e8be56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.137394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.138054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.138340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.138648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.139371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.140990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.152143 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2512/5020] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:11.155909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.166257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e24-adc6-4ba4-a034-efa9f1e4fc0b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.170861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.171539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.171938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.172232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.173073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.174928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec1243-99b7-4294-aed0-c8363b9d6e70 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.186239 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2509/5021] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:11.190676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.200727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694238c-4f8e-4225-84d0-02fa0694bcdf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.205427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.206296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.206580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.206855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] PATH_INFO: `/v3/projects/0a7469c380ae4cd2ae0028b72695e138/users/5ea5462daff849be91d24e869f5af732/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.221309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7469c380ae4cd2ae0028b72695e138, user_id=5ea5462daff849be91d24e869f5af732, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.224066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.237099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2513/5022] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:11 2022] PUT /identity/v3/projects/0a7469c380ae4cd2ae0028b72695e138/users/5ea5462daff849be91d24e869f5af732/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:11.247221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.247512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.247786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.273543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] MFA Rules not processed for user `5ea5462daff849be91d24e869f5af732`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:11.274726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:11.336118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2510/5023] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:11.340757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.399722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2170f0d-392e-41c7-af17-b072274a1329 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.404418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.405096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.405377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.405650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.406322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.408206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.433554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2514/5024] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:11 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:11.437557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.448440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd4bf8-b315-4e4a-87f1-e193c3cbacc6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.503547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.504145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.504428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.504745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.505434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.507383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.530475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2511/5025] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:11 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:11.534493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.545299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c26-4d85-4aa7-802d-e9d78a48f3de admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.549897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.550560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.550844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.551125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.551869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.553486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.564034 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2515/5026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:11.568225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.578002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ae663-b8b1-4384-8928-41eca57cf177 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.582643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.583512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.583813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.584216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] PATH_INFO: `/v3/projects/c91cc18295f14078bffd52deaaa2c7a4/users/b736074e4fdd4ebfa5fab88db94bec8e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.598872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91cc18295f14078bffd52deaaa2c7a4, user_id=b736074e4fdd4ebfa5fab88db94bec8e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.602139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.614137 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2512/5027] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:11 2022] PUT /identity/v3/projects/c91cc18295f14078bffd52deaaa2c7a4/users/b736074e4fdd4ebfa5fab88db94bec8e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:11.618116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.627970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a3db-4a00-4c89-a05c-ccabd10ad2e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.682824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.683506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.683769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.684043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.684800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.686373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19954-4f48-405d-864b-afc62b460eb2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.696943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2516/5028] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:11.700732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.711497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94b4c-3543-4656-aadd-f4d58d96a784 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.716425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.717362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.717650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.717932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] PATH_INFO: `/v3/projects/c91cc18295f14078bffd52deaaa2c7a4/users/b736074e4fdd4ebfa5fab88db94bec8e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.719922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91cc18295f14078bffd52deaaa2c7a4, user_id=b736074e4fdd4ebfa5fab88db94bec8e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.722754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.735150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2513/5029] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:11 2022] PUT /identity/v3/projects/c91cc18295f14078bffd52deaaa2c7a4/users/b736074e4fdd4ebfa5fab88db94bec8e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:11.746758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.747059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.747349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.775680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] MFA Rules not processed for user `b736074e4fdd4ebfa5fab88db94bec8e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:11.776925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:11.850893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2517/5030] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:11.864877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:11.866954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:11.931441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02836-f7b8-4d91-aad5-b4fc6d91b1b6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:11.936132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:11.936852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:11.937183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:11.937497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:11.949179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:11.950800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:11.963488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2514/5031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:12.067064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:12.080592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec4b6-b5e2-4e39-b6eb-c1ff12881f0e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:12.084388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:12.085077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:12.085620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:12.085750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:12.152163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:12.153676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92ce2d-48e5-4d61-987d-3eb50279e2da service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:12.164097 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2518/5032] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:17.230386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:17.359693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ac8c8-abc1-4ff1-a2a5-1a3cc6e30f88 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:17.365908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:17.367491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:17.367781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:17.368157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] PATH_INFO: `/v3/users/5ea5462daff849be91d24e869f5af732` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:17.370100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea5462daff849be91d24e869f5af732)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:17.373093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:17.437339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea5462daff849be91d24e869f5af732'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:17.457829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea5462daff849be91d24e869f5af732'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:17.458709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea5462daff849be91d24e869f5af732'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:17.467834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea5462daff849be91d24e869f5af732'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:17.476339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea5462daff849be91d24e869f5af732'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:17.484852 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2515/5033] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:17 2022] DELETE /identity/v3/users/5ea5462daff849be91d24e869f5af732 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:17.489817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:17.490687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:17.490687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:17.509270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:17.510756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:17.596627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2519/5034] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:17.604045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:17.605741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:17.697577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5de09-7a67-4ce5-8466-53231f790df6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:17.702817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:17.703588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:17.704005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:17.704285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:17.716574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:17.718788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:17.735312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2516/5035] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:18.085826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:18.100442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607795a-760d-4d3e-83e1-f248574486ce None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:18.106523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:18.107599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:18.108119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:18.108255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:18.108503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:18.109008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:18.113243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:18.124102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e66b4-bd33-4c3d-af6b-cde59041d582 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:18.128074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:18.129458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:18.130142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:18.130271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:18.130625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:18.130978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:18.142033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:18.143722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:18.144496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2520/5036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:18.157950 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2517/5037] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:18.289612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:18.291215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:18.311041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6d9f4-8417-4eb6-87e6-31216c7dce62 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:18.318887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:18.320228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:18.320839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:18.321263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] PATH_INFO: `/v3/projects/0a7469c380ae4cd2ae0028b72695e138` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:18.323308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7469c380ae4cd2ae0028b72695e138)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:18.326317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:18.405151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7469c380ae4cd2ae0028b72695e138', 'request_id': 'req-9fc46949-5032-4094-a512-aeeeca4e8a97'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.415157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7469c380ae4cd2ae0028b72695e138', 'request_id': 'req-9fc46949-5032-4094-a512-aeeeca4e8a97'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.424724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7469c380ae4cd2ae0028b72695e138', 'request_id': 'req-9fc46949-5032-4094-a512-aeeeca4e8a97'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.443992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] The token cache is being invalidate because project 0a7469c380ae4cd2ae0028b72695e138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:18.443992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.443992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.448039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2521/5038] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:18 2022] DELETE /identity/v3/projects/0a7469c380ae4cd2ae0028b72695e138 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:18.455018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:18.472303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daace4-497b-4387-98c4-bb954982f4f7 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:18.564622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:18.566175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:18.567288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:18.567959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] PATH_INFO: `/v3/users/b736074e4fdd4ebfa5fab88db94bec8e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:18.571151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b736074e4fdd4ebfa5fab88db94bec8e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:18.574158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:18.659887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b736074e4fdd4ebfa5fab88db94bec8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.673497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b736074e4fdd4ebfa5fab88db94bec8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.674781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b736074e4fdd4ebfa5fab88db94bec8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.684388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b736074e4fdd4ebfa5fab88db94bec8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.693400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-941b9b14-fd2d-47c6-bd33-3cdf2b3f36c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b736074e4fdd4ebfa5fab88db94bec8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:18.704060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2518/5039] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:18 2022] DELETE /identity/v3/users/b736074e4fdd4ebfa5fab88db94bec8e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:19.026585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.028431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:19.050636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc46949-5032-4094-a512-aeeeca4e8a97 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.124570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.125409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.125690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.125959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] PATH_INFO: `/v3/projects/c91cc18295f14078bffd52deaaa2c7a4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.127144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91cc18295f14078bffd52deaaa2c7a4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.129321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.189272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91cc18295f14078bffd52deaaa2c7a4', 'request_id': 'req-11086f0c-1256-4022-b6a0-41efeadb8b71'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:19.198644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91cc18295f14078bffd52deaaa2c7a4', 'request_id': 'req-11086f0c-1256-4022-b6a0-41efeadb8b71'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:19.211297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91cc18295f14078bffd52deaaa2c7a4', 'request_id': 'req-11086f0c-1256-4022-b6a0-41efeadb8b71'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:19.224199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] The token cache is being invalidate because project c91cc18295f14078bffd52deaaa2c7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:19.224645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:19.225419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-11086f0c-1256-4022-b6a0-41efeadb8b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:19.227911 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2522/5040] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:19 2022] DELETE /identity/v3/projects/c91cc18295f14078bffd52deaaa2c7a4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:19.233962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.240845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.242174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.268413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:19.269697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:19.339037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2519/5041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:19.347069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.347358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.347633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.369358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:19.370647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:19.379929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2523/5042] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:19.384155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.396953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6cf58-d200-43ff-b92c-6c6e4e8a578b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.402551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.403316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.403606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.403889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.404654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:19.405072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.407070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.421955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2520/5043] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:19.426805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.440521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4df0b7-6fb1-417a-a4b3-73e381dd8c71 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.448362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.449345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.449678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.449962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.450699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.452993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.488592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.489195 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2524/5044] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:19.502558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869af08-35c2-47ac-accf-aae1958d0d14 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.574920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.575782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.576074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.576368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.577114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.579049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.599935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2521/5045] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:19.604731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.616336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276c93-f2f4-4d72-b3f5-3a1afe8634cf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.621270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.621941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.622229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.622516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.623238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.624967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.635703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2525/5046] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:19.640636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.656887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a041-0d4b-452e-91b2-3d380a7710a4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.662508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.663901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.664193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.664502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.665314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.672022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5939-19d2-4255-897f-279d5c385228 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.683264 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2522/5047] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:19.688826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.702765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227efc-d9d9-4a43-98ef-93d933f9f573 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.708893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.709848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.711017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.711363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] PATH_INFO: `/v3/projects/7e1612ab29d441cb834be5ff37e80e7a/users/90b3016eec8b45d8a90c282e6b9b6395/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.728251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1612ab29d441cb834be5ff37e80e7a, user_id=90b3016eec8b45d8a90c282e6b9b6395, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.731471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:19.745405 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2526/5048] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:19 2022] PUT /identity/v3/projects/7e1612ab29d441cb834be5ff37e80e7a/users/90b3016eec8b45d8a90c282e6b9b6395/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:19.756134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.756546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.756936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.790710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] MFA Rules not processed for user `90b3016eec8b45d8a90c282e6b9b6395`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:19.793164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:19.887804 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2523/5049] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:19.892776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:19.966114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24043c-811c-421b-aa53-f7cfba53eb0d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:19.975487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:19.976674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:19.977023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:19.977715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:19.980793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:19.983070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.015530 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2527/5050] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:19 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:20.020489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.034622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5a7cf-68a5-4a3a-adb4-b66b923d6cf5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.099502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.100209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.100533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.100845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.101558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.103942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.128532 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2524/5051] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:20 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:20.139488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.155990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44abd8-2ebc-4b5a-832d-cd92d102f407 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.162489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.163637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.164077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.164436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.166045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.167697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.180904 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2528/5052] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:20.185983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.199196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0a8b6-80ce-4863-abda-923d751d9a6c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.204554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.205514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.205803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.206095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] PATH_INFO: `/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1/users/f4df4e794a8d4638931c4cd50bc39470/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.225619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=524f5f2e2beb4e8fba1a7fbeae155ab1, user_id=f4df4e794a8d4638931c4cd50bc39470, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.228840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.244935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2525/5053] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:20 2022] PUT /identity/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1/users/f4df4e794a8d4638931c4cd50bc39470/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:20.249208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.260946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af99657-80e2-4424-9e0d-067b734e0505 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.328718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.329891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.330249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.330590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.331456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.333304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884d149-72bc-4d0b-8326-a1432501c50d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.344811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2529/5054] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:20.349209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.361549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b0f93-5d44-40fa-a571-5153a36dd7ee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.368582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.370008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.370358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.370693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] PATH_INFO: `/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1/users/f4df4e794a8d4638931c4cd50bc39470/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.373144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524f5f2e2beb4e8fba1a7fbeae155ab1, user_id=f4df4e794a8d4638931c4cd50bc39470, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.376432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.389800 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2526/5055] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:20 2022] PUT /identity/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1/users/f4df4e794a8d4638931c4cd50bc39470/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:20.487419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.487762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.487977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.521390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] MFA Rules not processed for user `f4df4e794a8d4638931c4cd50bc39470`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:20.522951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:20.604823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2530/5056] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:20.619151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.621339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:20.697409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7118b3-fda6-4ebd-9909-606f8e796655 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.701812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.702478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.702770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.703052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.715428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.717757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.733404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2527/5057] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:20.824275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:20.836503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d22aa-f668-4205-9b6f-5e4ae9a91d6c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:20.840346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:20.841058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:20.841669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:20.842018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:20.902628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:20.904437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:20.915422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2531/5058] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:21.231514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:21.309477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:21.312010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:21.316937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ded5e-eaf3-48c5-b9f8-4d10cbd0f914 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:21.322211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:21.323114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:21.323402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:21.323762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] PATH_INFO: `/v3/users/90b3016eec8b45d8a90c282e6b9b6395` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:21.325214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b3016eec8b45d8a90c282e6b9b6395)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:21.327437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:21.381380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b3016eec8b45d8a90c282e6b9b6395'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:21.387960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f8959-f2c9-4461-a900-dba69931af90 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:21.392298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:21.393060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:21.393576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:21.393855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:21.397385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:21.401763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b3016eec8b45d8a90c282e6b9b6395'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:21.403174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b3016eec8b45d8a90c282e6b9b6395'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:21.412446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b3016eec8b45d8a90c282e6b9b6395'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:21.419275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:21.421051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:21.422258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-702751b3-535f-4220-abb8-cf1e205866ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b3016eec8b45d8a90c282e6b9b6395'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:21.430189 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2528/5059] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:21 2022] DELETE /identity/v3/users/90b3016eec8b45d8a90c282e6b9b6395 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:21.435252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2532/5060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:21.435405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:21.435577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:21.436417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:21.471963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:21.473413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:21.552097 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2529/5061] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:21.565753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:21.578971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92419d23-bf4a-463f-a1fa-aefa337ed3e9 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:21.639328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:21.640096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:21.640509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:21.641669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:21.654284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:21.655870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:21.668420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2533/5062] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:22.236084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:22.239146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:22.256874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1611d8-e8f4-4842-bcbe-b0e5b5eeac80 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:22.263331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:22.264505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:22.264850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:22.265194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] PATH_INFO: `/v3/projects/7e1612ab29d441cb834be5ff37e80e7a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:22.266847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1612ab29d441cb834be5ff37e80e7a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:22.269278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:22.371463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1612ab29d441cb834be5ff37e80e7a', 'request_id': 'req-7b1e5297-3baa-42ca-a65a-a06d9b814c46'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.380627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1612ab29d441cb834be5ff37e80e7a', 'request_id': 'req-7b1e5297-3baa-42ca-a65a-a06d9b814c46'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.390757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1612ab29d441cb834be5ff37e80e7a', 'request_id': 'req-7b1e5297-3baa-42ca-a65a-a06d9b814c46'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.409151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] The token cache is being invalidate because project 7e1612ab29d441cb834be5ff37e80e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:22.409558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.410242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.412294 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2530/5063] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:22 2022] DELETE /identity/v3/projects/7e1612ab29d441cb834be5ff37e80e7a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:22.417130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:22.430075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1e99-d5b8-4f8c-9215-7002e5ac5bb6 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:22.552997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:22.556017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:22.556017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:22.556017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] PATH_INFO: `/v3/users/f4df4e794a8d4638931c4cd50bc39470` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:22.560785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4df4e794a8d4638931c4cd50bc39470)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:22.569187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:22.639949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4df4e794a8d4638931c4cd50bc39470'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.651366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4df4e794a8d4638931c4cd50bc39470'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.652213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4df4e794a8d4638931c4cd50bc39470'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.653872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4df4e794a8d4638931c4cd50bc39470'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.665150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e52916c0-cec1-4d3b-876f-6a03cb49877c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4df4e794a8d4638931c4cd50bc39470'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:22.686381 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2534/5064] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:22 2022] DELETE /identity/v3/users/f4df4e794a8d4638931c4cd50bc39470 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:23.795108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:23.796895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:23.813461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e5297-3baa-42ca-a65a-a06d9b814c46 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:23.961996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:23.964025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:23.964337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:23.964576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] PATH_INFO: `/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:23.966989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=524f5f2e2beb4e8fba1a7fbeae155ab1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:23.970142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.066077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524f5f2e2beb4e8fba1a7fbeae155ab1', 'request_id': 'req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:24.082126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524f5f2e2beb4e8fba1a7fbeae155ab1', 'request_id': 'req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:24.102641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524f5f2e2beb4e8fba1a7fbeae155ab1', 'request_id': 'req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:24.128738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] The token cache is being invalidate because project 524f5f2e2beb4e8fba1a7fbeae155ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:24.128869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:24.129667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-809e0e56-8dd1-4de4-ad0a-1faa9801d14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:24.135676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2531/5065] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:23 2022] DELETE /identity/v3/projects/524f5f2e2beb4e8fba1a7fbeae155ab1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:24.147845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.148550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.148741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.180691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:24.182822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:24.282089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2535/5066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:24.290757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.291127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.291564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.322203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:24.323657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:24.335848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2532/5067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:24.348510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.363802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ebf6-cbbb-4875-99c4-160c14ba7726 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.370938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.372572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.372918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.373473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.374274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:24.374592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.376513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.399690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.408138 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2536/5068] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:24.416254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593391f-9cbe-4226-888c-e06a9bde47d2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.430317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.432357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.433467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.435172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.437823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.443377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.520855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.531755 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2533/5069] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:24 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:24.538292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f396-0bc7-4ca2-95de-c4dca164dbbf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.641187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.641912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.642265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.643859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.644352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.646503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.686705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.689084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2537/5070] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:24 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:24.707160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f974-c63f-4fca-a2c2-b896200b21f3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.717524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.718265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.718576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.718931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.719857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.721595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.747811 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2534/5071] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:24.752215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.765600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d103751-236e-4c3e-b4cd-05d75837470c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.772238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.773026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.773320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.773604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.774900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.789903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185deb-652b-4c95-8aed-d096fb4fb293 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.816432 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2538/5072] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:24.821827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:24.833045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e32ce-743a-4d6b-8202-aa538c78a1ec admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:24.867004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:24.868071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.868660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.868944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] PATH_INFO: `/v3/projects/f54b2160309b4d76bd7a944454903520/users/d12e43a0a2994654a400b3a2bed83ecf/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.900298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54b2160309b4d76bd7a944454903520, user_id=d12e43a0a2994654a400b3a2bed83ecf, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:24.903754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:24.934226 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2535/5073] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:24 2022] PUT /identity/v3/projects/f54b2160309b4d76bd7a944454903520/users/d12e43a0a2994654a400b3a2bed83ecf/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:24.940051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:24.940344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:24.940814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:24.984157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:24.993833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:25.128962 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2539/5074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:25.141439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:25.143272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:25.257641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18946c-1a34-477f-8248-615a25579794 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:25.262749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:25.265179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:25.265909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:25.266035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:25.280860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:25.282956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:25.309847 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2536/5075] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:25.775088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:25.780060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:25.794472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad59d-33f2-4463-829b-1e4fab98b22a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:25.801017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:25.802131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:25.802394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:25.802671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] PATH_INFO: `/v3/users/d20c714151f14238a665d9760bec1d66` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:25.804253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20c714151f14238a665d9760bec1d66)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:25.806605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:25.856817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20c714151f14238a665d9760bec1d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:25.865320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20c714151f14238a665d9760bec1d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:25.866780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20c714151f14238a665d9760bec1d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:25.867482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20c714151f14238a665d9760bec1d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:25.876421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d6e9f4b6-5acd-48e7-9100-a6082e126d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20c714151f14238a665d9760bec1d66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:25.896142 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2540/5076] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:25 2022] DELETE /identity/v3/users/d20c714151f14238a665d9760bec1d66 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:26.243908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:26.276576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183d933-1096-480f-b87b-1c65447bf2ab service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:26.410753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:26.411714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.412499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.412499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] PATH_INFO: `/v3/projects/6a2dc7aaed2f489fa941c447aa5e3aa7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.423627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2dc7aaed2f489fa941c447aa5e3aa7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:26.425988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:26.534436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'request_id': 'req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:26.543925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'request_id': 'req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:26.549599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'request_id': 'req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:26.586761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] The token cache is being invalidate because project 6a2dc7aaed2f489fa941c447aa5e3aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:26.587058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:26.589372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ec7a8f-4c32-4b6d-8f40-09728742c1d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:26.592204 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2537/5077] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:26 2022] DELETE /identity/v3/projects/6a2dc7aaed2f489fa941c447aa5e3aa7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:26.597642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502f51-ddea-4cde-b2f5-72b457fa0f44 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.598387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502f51-ddea-4cde-b2f5-72b457fa0f44 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.598720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502f51-ddea-4cde-b2f5-72b457fa0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.641128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fd502f51-ddea-4cde-b2f5-72b457fa0f44 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:26.641128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd502f51-ddea-4cde-b2f5-72b457fa0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:26.668353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.669627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.669763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.722184 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2541/5078] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:26.726080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.726587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.726887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.727434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] MFA Rules not processed for user `d12e43a0a2994654a400b3a2bed83ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:26.729030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:26.751802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:26.753246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:26.764068 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2542/5079] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:26.768090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:26.779543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc5645-4ef5-4e43-ad7a-017a177497f0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:26.786609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:26.787381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.788537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.788865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.790205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:26.790714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:26.792757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:26.808044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2543/5080] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:26.812873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:26.816373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2538/5081] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:26.826499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081e730-3624-40f5-b10f-e7a63ae90810 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:26.835527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:26.836484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:26.837041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:26.837259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:26.838199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:26.840951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:26.842768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:26.847128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:26.891893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2544/5082] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:26 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:26.893228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:26.958100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5066f-2ad5-4815-b0ce-0b8a646e3f95 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:26.999770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b790-8071-4203-826a-0beb4519207f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.010831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.013012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.013951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.015625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.018732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.023734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.061284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.062114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.062469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.062869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.075248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2545/5083] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:26 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:27.076999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.100282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c0a-d344-454a-90b9-dfb1813ed712 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.106881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.107622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.108045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.108326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.109103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.110835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.123604 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2546/5084] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:27.127614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.139673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497b79-8ca3-4b37-a154-9ebfff25a994 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.145563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.146691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.147137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.148165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.149350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.151439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.165063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.166490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.168378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2547/5085] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:27.172574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.181123 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2539/5086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:27.182014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.183808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.195448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f987-cbb3-4bfa-9364-eb2a3d7aca50 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.201952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.203168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.203504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.203786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] PATH_INFO: `/v3/projects/82a38de4064140c78252570fd4096b50/users/b6c560579af044148e6183d905d01824/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.205144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782caf8-a7d4-441b-bf38-3b1db4406079 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.212804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.214113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.215078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.215520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] PATH_INFO: `/v3/users/eaa8ffe0235f4759bdb071a51ad51410` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.217145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa8ffe0235f4759bdb071a51ad51410)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.219323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.229873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a38de4064140c78252570fd4096b50, user_id=b6c560579af044148e6183d905d01824, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.233237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c313-f49e-4dd3-9818-f0a2673e68b5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.249832 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2548/5087] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:27 2022] PUT /identity/v3/projects/82a38de4064140c78252570fd4096b50/users/b6c560579af044148e6183d905d01824/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:27.261531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.262115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.262426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.280742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa8ffe0235f4759bdb071a51ad51410'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.296289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa8ffe0235f4759bdb071a51ad51410'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.297545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa8ffe0235f4759bdb071a51ad51410'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.298257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.300093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.308639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa8ffe0235f4759bdb071a51ad51410'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.318530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bac963b5-f716-4549-87f0-8ce2bc571442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa8ffe0235f4759bdb071a51ad51410'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.330177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2540/5088] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:27 2022] DELETE /identity/v3/users/eaa8ffe0235f4759bdb071a51ad51410 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:27.394055 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2549/5089] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:27.407645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de238b57-5de2-4543-afa0-3221527badff None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.408124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de238b57-5de2-4543-afa0-3221527badff None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.409163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de238b57-5de2-4543-afa0-3221527badff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.432702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-de238b57-5de2-4543-afa0-3221527badff None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.433995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de238b57-5de2-4543-afa0-3221527badff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.528522 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2541/5090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:27.544161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.546524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.576287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de238b57-5de2-4543-afa0-3221527badff None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.578897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de238b57-5de2-4543-afa0-3221527badff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.673201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de238b57-5de2-4543-afa0-3221527badff None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.673540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e022ad-85d1-44b2-8cf2-30ac71f4aec5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.679543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.680656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.681001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.681458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] PATH_INFO: `/v3/projects/2a4f1507b69e40c8ace9eac029f1ced2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.682891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4f1507b69e40c8ace9eac029f1ced2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.685441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.752937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.753188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4f1507b69e40c8ace9eac029f1ced2', 'request_id': 'req-63a5ca24-733f-472d-8b34-01d6c2759ae6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.753693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.754399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.754724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.762907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4f1507b69e40c8ace9eac029f1ced2', 'request_id': 'req-63a5ca24-733f-472d-8b34-01d6c2759ae6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.765105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.766749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb76730-4ef3-4e8d-9f83-8bd8755cb385 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.770446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4f1507b69e40c8ace9eac029f1ced2', 'request_id': 'req-63a5ca24-733f-472d-8b34-01d6c2759ae6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.776807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2550/5091] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:27.785269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] The token cache is being invalidate because project 2a4f1507b69e40c8ace9eac029f1ced2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:27.785638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.786482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63a5ca24-733f-472d-8b34-01d6c2759ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:27.793399 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2542/5092] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:27 2022] DELETE /identity/v3/projects/2a4f1507b69e40c8ace9eac029f1ced2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:27.798833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7ac79-d1f5-4775-bc66-b69cc33c4636 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.799474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7ac79-d1f5-4775-bc66-b69cc33c4636 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.799656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069148e-6963-466a-a76d-56f35f8f5135 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.799945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069148e-6963-466a-a76d-56f35f8f5135 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.800213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069148e-6963-466a-a76d-56f35f8f5135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.800346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7ac79-d1f5-4775-bc66-b69cc33c4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.820135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6069148e-6963-466a-a76d-56f35f8f5135 None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.821418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6069148e-6963-466a-a76d-56f35f8f5135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.823323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fcf7ac79-d1f5-4775-bc66-b69cc33c4636 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.824836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fcf7ac79-d1f5-4775-bc66-b69cc33c4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.896058 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2543/5093] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:27.902951 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2551/5094] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:27.919552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.919552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.919552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.928196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e8b-1f29-487e-90e5-6f283d7beb50 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.929053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e8b-1f29-487e-90e5-6f283d7beb50 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.929347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e8b-1f29-487e-90e5-6f283d7beb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.934416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.935783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.945617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2544/5095] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:27.949912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-56861e8b-1f29-487e-90e5-6f283d7beb50 None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:27.950611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:27.951486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56861e8b-1f29-487e-90e5-6f283d7beb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:27.959393 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2552/5096] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:27.966283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388cc7b-3253-4da5-bc2f-4ea5f8d2642a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:27.971875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:27.972856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.972856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.973150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.973912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:27.974174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:27.975812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:27.984099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba469-b882-4703-987d-825b8fdf3914 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:27.984487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba469-b882-4703-987d-825b8fdf3914 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:27.984854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ba469-b882-4703-987d-825b8fdf3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:27.992501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2545/5097] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:07:27.994562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.004336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c01ba469-b882-4703-987d-825b8fdf3914 None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.004686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636629f9-689a-4365-802c-b6dae1679a12 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.005915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c01ba469-b882-4703-987d-825b8fdf3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.009925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.010573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.010858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.011137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.011814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.013744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2553/5098] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:28.013878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.037323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.037614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.037919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.042435 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2546/5099] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:27 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:28.046469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.055879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] MFA Rules not processed for user `b6c560579af044148e6183d905d01824`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.057238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.107725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00e51-5451-464b-897c-198c03e48222 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.112351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.113063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.113342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.113622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.114517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.115569 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2554/5100] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:28.116895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.133111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.134546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.138317 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2547/5101] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:28.142525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.148257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8cb3f-42b5-40d9-a158-461486701025 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.151984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc490e-cc09-4bba-a29c-1e5f7f7f9e24 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.152913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.153774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.154057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.154380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] PATH_INFO: `/v3/users/b6c560579af044148e6183d905d01824` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.155563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c560579af044148e6183d905d01824)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.157531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.157675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.158424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.158747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.159057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.160176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.161938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.173807 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2548/5102] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:28.178084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.195059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbcbdd-1255-4f3a-8c21-f9451fb33ade admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.200991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.202179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.202468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.202775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.203462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.205208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.212838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c560579af044148e6183d905d01824'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.219718 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2549/5103] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:28.220849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.226437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c560579af044148e6183d905d01824'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.227456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c560579af044148e6183d905d01824'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.228572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c560579af044148e6183d905d01824'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.232432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf746-4e48-49d0-99b0-6deba9dd6c0e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.237543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25ab5705-eddb-4537-badf-6d894db14658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c560579af044148e6183d905d01824'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.238115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.239097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.239398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.239673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] PATH_INFO: `/v3/projects/41a9dffcc8a445fda1f074e4f6736ac4/users/2c71871505a8494a9230a15d40cefeb5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.256532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a9dffcc8a445fda1f074e4f6736ac4, user_id=2c71871505a8494a9230a15d40cefeb5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.257971 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2555/5104] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:28 2022] DELETE /identity/v3/users/b6c560579af044148e6183d905d01824 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:28.259779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b1b44-1793-4773-b248-47e70965a5ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.262887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.263217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.263511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.273604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2550/5105] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:28 2022] PUT /identity/v3/projects/41a9dffcc8a445fda1f074e4f6736ac4/users/2c71871505a8494a9230a15d40cefeb5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:28.281852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.283432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.284014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.284511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.284611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.311108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] MFA Rules not processed for user `2c71871505a8494a9230a15d40cefeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.312371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.341450 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2556/5106] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:28.350964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.352344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.376458 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2551/5107] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:28.381247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.389893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe8fb-19e2-449a-bf0e-b318e2e51c11 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.395020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.395935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.396358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.396678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.398085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:create_application_credential(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.400072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.410141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23414a3-ad73-4782-b4c0-617f98eb64dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.414583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.415215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.415497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.415875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.426200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.427753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.438091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2557/5108] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:28.496563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2552/5109] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials => generated 921 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:28.500966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.511430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc7fe-2bb8-4b64-9372-f81f26a4b569 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.516628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.517596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.517879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.518162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/e04e408bcd294000a0bbd09bab3a5362` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.519510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:delete_access_rule(user_id=2c71871505a8494a9230a15d40cefeb5, access_rule_id=e04e408bcd294000a0bbd09bab3a5362)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.521221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.566072 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-8b0790e5-4c41-4181-bfb2-81fa05f3393f tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Apr 02 21:07:28.568084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2558/5110] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Apr 2 21:07:28 2022] DELETE /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/e04e408bcd294000a0bbd09bab3a5362 => generated 89 bytes in 68 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:07:28.573001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.584497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a852a78-9e16-4cb5-8fa7-c0c135305a70 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.598668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.600073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.600429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.600843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials/b4a376b2e32b4a8ab99e41953a773481` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.619490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2c71871505a8494a9230a15d40cefeb5, application_credential_id=b4a376b2e32b4a8ab99e41953a773481)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.621098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.643273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.643630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.643975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.648784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2553/5111] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:07:28 2022] DELETE /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials/b4a376b2e32b4a8ab99e41953a773481 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:28.652448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.664169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cfb7e-ae80-4819-8c30-0f503e8bc467 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.669958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] MFA Rules not processed for user `d12e43a0a2994654a400b3a2bed83ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.670415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.671156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.671546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.671931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.672400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.674391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:list_access_rules(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.676108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.684114 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2554/5112] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules => generated 369 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:28.688122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.709110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4e1cd-affe-4cf4-aef6-366718271363 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.715564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.716554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.716853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.717994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/e04e408bcd294000a0bbd09bab3a5362` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.719085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:delete_access_rule(user_id=2c71871505a8494a9230a15d40cefeb5, access_rule_id=e04e408bcd294000a0bbd09bab3a5362)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.720639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.741686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2559/5113] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:28.747077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2555/5114] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Apr 2 21:07:28 2022] DELETE /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/e04e408bcd294000a0bbd09bab3a5362 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:28.752509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.765346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74625a-3b89-4dd9-b5b5-fad0eeb650e8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.771581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.772034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.773425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.773571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.773902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.774253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.779004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:list_access_rules(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.779625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.794610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7abfce-7e92-4c09-8f18-a0c87886c9b3 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.797845 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2560/5115] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules => generated 158 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:28.805328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.813533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.814422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.817126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.817227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] PATH_INFO: `/v3/projects/82a38de4064140c78252570fd4096b50` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.817315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd399e-a34d-43cd-be2c-8a6d97ed50c6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.819675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a38de4064140c78252570fd4096b50)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.821645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.823415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:28.824300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.824675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.824962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.825761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:create_application_credential(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:28.827410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:28.898093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a38de4064140c78252570fd4096b50', 'request_id': 'req-c906793d-7e3e-4f29-84fa-fa19a38f1377'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.908868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a38de4064140c78252570fd4096b50', 'request_id': 'req-c906793d-7e3e-4f29-84fa-fa19a38f1377'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.918828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a38de4064140c78252570fd4096b50', 'request_id': 'req-c906793d-7e3e-4f29-84fa-fa19a38f1377'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.947617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2561/5116] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials => generated 920 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:28.948823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] The token cache is being invalidate because project 82a38de4064140c78252570fd4096b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:28.949313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.950170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c906793d-7e3e-4f29-84fa-fa19a38f1377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:28.952322 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2556/5117] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:28 2022] DELETE /identity/v3/projects/82a38de4064140c78252570fd4096b50 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:28.953632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:28.955759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:28.957058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:28.957460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:28.957729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:28.971046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627992e-aaf5-4251-b755-0e527f515528 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:28.980489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:28.982078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.039414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.040272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.040564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.041059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.043228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:list_access_rules(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.044739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb956b-6c80-47b0-94e8-60b6508bbb62 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.050538 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2562/5118] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:07:28 2022] GET /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules => generated 369 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:29.053139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2557/5119] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:29.060593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.061776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.062275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.062585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.079060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71ddf-11f0-4665-a5b0-f2e44f3ac8d6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.084090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:29.084599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.085542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.085714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.085824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.086175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.086898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:create_application_credential(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.088084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.096010 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2563/5120] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:29.100971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.111139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6809aa-7878-439f-900f-b06827cca75b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.116971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.117714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.118009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.118311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.119270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:29.119636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.121453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.142206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2564/5121] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:07:29.143324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.154730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea44ca-abdc-484c-9a60-8efef2656216 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.160778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.161717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.162185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.162706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.163930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.165992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.202848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2558/5123] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/application_credentials => generated 921 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:29.203096 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2565/5123] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:29.204501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.205250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.223130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381ddbd-3c7f-4d00-a4ed-9ad65a223ec6 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.283888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c71871505a8494a9230a15d40cefeb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41a9dffcc8a445fda1f074e4f6736ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.285427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.285997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.285997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/89ad2b6b4a544202bb8f199d169b37e5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.287256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorizing `identity:get_access_rule(user_id=2c71871505a8494a9230a15d40cefeb5, access_rule_id=89ad2b6b4a544202bb8f199d169b37e5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.289062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.289439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f825-7ec7-4442-bad2-94a7e43f9fe7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.295463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.295738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.295994 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2559/5124] 10.222.0.18 () {58 vars in 1358 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/users/2c71871505a8494a9230a15d40cefeb5/access_rules/89ad2b6b4a544202bb8f199d169b37e5 => generated 229 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:07:29.299923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.299923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.299923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.299923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.301947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.304543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.321921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006afc4e-4dec-4b3b-8695-5bda0f30b099 tempest-AccessRulesV3Test-143787696 tempest-AccessRulesV3Test-143787696-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.327386 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2566/5125] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:29.328176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.329182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.329476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.329776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] PATH_INFO: `/v3/users/2c71871505a8494a9230a15d40cefeb5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.331591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c71871505a8494a9230a15d40cefeb5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.331725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.334029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.344420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995dbea-679d-4019-b3d6-9c755cb6e306 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.350030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.351027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.351996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.352628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.353446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.355655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.368625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2567/5126] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:29.373494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.387376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815028e0-32e9-405d-bc30-07e4377bd57a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.395132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.395861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.396097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.397032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.397740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.399259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.402758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c71871505a8494a9230a15d40cefeb5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:29.412520 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2568/5127] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:29.417105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.427690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d03e5-7117-49ec-abb8-9ddac358f56a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.433184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.434047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.434329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.434763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] PATH_INFO: `/v3/projects/1b8620340d064cd98fd526e46e061d4f/users/140cc422fc5b40eaa3cd538fb9c05b7a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.463478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8620340d064cd98fd526e46e061d4f, user_id=140cc422fc5b40eaa3cd538fb9c05b7a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.467644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c83a-7c13-439d-95d4-4f06d88f1bc2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.473138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c71871505a8494a9230a15d40cefeb5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:29.474973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c71871505a8494a9230a15d40cefeb5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:29.486023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c71871505a8494a9230a15d40cefeb5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:29.494664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3e203b9e-2788-44b2-b6f1-4cafe24ad58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c71871505a8494a9230a15d40cefeb5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:29.497719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2569/5128] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:29 2022] PUT /identity/v3/projects/1b8620340d064cd98fd526e46e061d4f/users/140cc422fc5b40eaa3cd538fb9c05b7a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:29.501696 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2560/5129] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:29 2022] DELETE /identity/v3/users/2c71871505a8494a9230a15d40cefeb5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:29.502749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.503257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.504327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.506344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.506839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.507215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.529157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:29.530455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.531117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:29.533070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.614414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2561/5130] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:29.616500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2570/5131] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:29.625026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.626920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.628934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:29.630346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:29.696378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548abdf3-e14d-4ede-ade9-2bf1dd7d32c8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.700518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.701294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.701708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.702061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.704909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16161bb1-8628-49a8-9549-1d3fa0dd7842 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:29.708776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:29.709490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:29.709902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:29.710833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:29.713521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.715178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.721534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:29.723360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcf691-cdf8-4659-97f9-ea7696cbd8d7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:29.726910 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2562/5132] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:29.740496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2571/5133] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:30.172554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.174717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.195185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90dd5-2d74-44fb-8240-37c2613d7a74 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.200936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.202426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.202969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.203326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] PATH_INFO: `/v3/projects/41a9dffcc8a445fda1f074e4f6736ac4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.204822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a9dffcc8a445fda1f074e4f6736ac4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.206957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.266923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a9dffcc8a445fda1f074e4f6736ac4', 'request_id': 'req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:30.273411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a9dffcc8a445fda1f074e4f6736ac4', 'request_id': 'req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:30.279151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a9dffcc8a445fda1f074e4f6736ac4', 'request_id': 'req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:30.292986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] The token cache is being invalidate because project 41a9dffcc8a445fda1f074e4f6736ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:30.294077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:30.294759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd7d29c6-6c19-4b6d-b4b6-4ec03ff2f573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:30.296347 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2563/5134] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:30 2022] DELETE /identity/v3/projects/41a9dffcc8a445fda1f074e4f6736ac4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:30.301319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e56af-69de-4e30-a4ca-2cf8d746f741 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.302138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e56af-69de-4e30-a4ca-2cf8d746f741 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.302510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e56af-69de-4e30-a4ca-2cf8d746f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.320478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5b7e56af-69de-4e30-a4ca-2cf8d746f741 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:30.321956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5b7e56af-69de-4e30-a4ca-2cf8d746f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.402532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2572/5135] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:30.411151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.411441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.411832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.451905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:30.451905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.455371 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2564/5136] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:30.463600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.467680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fe40-fe60-4675-9a06-73c994c057ca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.467981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fe40-fe60-4675-9a06-73c994c057ca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.468263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fe40-fe60-4675-9a06-73c994c057ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.493769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55a519-a53f-48fe-bc13-0b908ecc487d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.505978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.508886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.509173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.509458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.510200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:30.513306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.515418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.524719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2d87fe40-fe60-4675-9a06-73c994c057ca None None] MFA Rules not processed for user `140cc422fc5b40eaa3cd538fb9c05b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:30.527560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2d87fe40-fe60-4675-9a06-73c994c057ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.534943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2565/5137] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:30.535853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.549714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82bac0-9fea-4243-b895-575178234e25 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.556158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.556927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.557222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.557502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.558398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.562093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.617177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2566/5138] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:30.620284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.702835 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2573/5139] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:30.713039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.713634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.716374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.742717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] MFA Rules not processed for user `140cc422fc5b40eaa3cd538fb9c05b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:30.744268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.746923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557f137-1508-4fb6-9ff5-526877d46e5d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.752707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.753814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.754312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.755108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.755952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.758881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.790848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2567/5140] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:30.798813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.817100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2574/5141] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:30.829119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ceecb-d91b-4406-b2a3-ceb196c014d0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.830054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.831516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:30.834323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.835043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.835330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.835626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.836352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.838116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.851445 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2568/5142] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:30.852939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.864049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01e5cd-d403-4f89-8c4c-4ab03c302238 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.870266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.871086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.871448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.871837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.872668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.874381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.887462 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2569/5143] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:30.892150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:30.905154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e740313-e64d-4559-84b0-b24316d06572 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.912909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.914117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.914411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.914692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] PATH_INFO: `/v3/projects/b76f0882ca1e4feebecd38a315c92d00/users/0d907c84f1c2477d86a599e94f4b65fb/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.930943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76f0882ca1e4feebecd38a315c92d00, user_id=0d907c84f1c2477d86a599e94f4b65fb, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.933827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3470-80d4-4ca3-947a-776cd20c20d3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.943359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34ab1e-df67-4cab-952e-314776ed4e91 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:30.950765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:30.952348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.952868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.953358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:30.970469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:30.972882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:30.979309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2570/5144] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:30 2022] PUT /identity/v3/projects/b76f0882ca1e4feebecd38a315c92d00/users/0d907c84f1c2477d86a599e94f4b65fb/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:30.995657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2575/5145] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:30.998177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:30.998674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:30.999126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:31.031538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] MFA Rules not processed for user `0d907c84f1c2477d86a599e94f4b65fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:31.032859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:31.134678 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2571/5146] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:31.142291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:31.250698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def4d6b-ac94-4a76-903f-34c813306a08 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:31.255021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d907c84f1c2477d86a599e94f4b65fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b76f0882ca1e4feebecd38a315c92d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:31.255829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:31.256115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:31.256395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] PATH_INFO: `/v3/domains/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:31.257847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:31.259573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37416c3e-94eb-4941-8925-bb021d3ba066 tempest-DefaultDomainTestJSON-1555049832 tempest-DefaultDomainTestJSON-1555049832-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:31.261259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2576/5147] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:31.267552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:31.347237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28021914-a4d7-4ad0-ae45-d7bef0bad417 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:31.355364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:31.356590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:31.358822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:31.359124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] PATH_INFO: `/v3/users/0d907c84f1c2477d86a599e94f4b65fb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:31.361107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d907c84f1c2477d86a599e94f4b65fb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:31.363613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:31.433511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d907c84f1c2477d86a599e94f4b65fb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:31.467696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d907c84f1c2477d86a599e94f4b65fb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:31.468665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d907c84f1c2477d86a599e94f4b65fb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:31.486126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d907c84f1c2477d86a599e94f4b65fb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:31.509464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d907c84f1c2477d86a599e94f4b65fb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:31.521569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2572/5148] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:31 2022] DELETE /identity/v3/users/0d907c84f1c2477d86a599e94f4b65fb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:31.526249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:31.526761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:31.526917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:31.550510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:31.551697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:31.672347 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2577/5149] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:31.688521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:31.691134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:31.816808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd60c-281e-4a7c-a850-87720964c625 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:31.822315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:31.823070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:31.823361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:31.823786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:31.855725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:31.859871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774092a-28e0-4f1f-afc6-01599919d0d8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:31.882770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2573/5150] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:32.237119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:32.238941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:32.263841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5821858-54bd-46e2-be19-9515c73cad98 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:32.271039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:32.272132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.272782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.273404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] PATH_INFO: `/v3/projects/b76f0882ca1e4feebecd38a315c92d00` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.275264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76f0882ca1e4feebecd38a315c92d00)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:32.279009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:32.349445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76f0882ca1e4feebecd38a315c92d00', 'request_id': 'req-20c7004b-4f41-46c7-82e2-bb017d8c2940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:32.358849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76f0882ca1e4feebecd38a315c92d00', 'request_id': 'req-20c7004b-4f41-46c7-82e2-bb017d8c2940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:32.382290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76f0882ca1e4feebecd38a315c92d00', 'request_id': 'req-20c7004b-4f41-46c7-82e2-bb017d8c2940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:32.400186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] The token cache is being invalidate because project b76f0882ca1e4feebecd38a315c92d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:32.400656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:32.401880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-20c7004b-4f41-46c7-82e2-bb017d8c2940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:32.403880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2578/5151] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:32 2022] DELETE /identity/v3/projects/b76f0882ca1e4feebecd38a315c92d00 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:32.410720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29888-51f0-43a6-902b-82373971134a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.411370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29888-51f0-43a6-902b-82373971134a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.411370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29888-51f0-43a6-902b-82373971134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.431529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-afe29888-51f0-43a6-902b-82373971134a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:32.432811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-afe29888-51f0-43a6-902b-82373971134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:32.530981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2574/5152] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:32.539162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.539783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.539783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.561552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:32.562808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:32.573587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2579/5153] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:32.579046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29888-51f0-43a6-902b-82373971134a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:32.592346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29888-51f0-43a6-902b-82373971134a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:32.605048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:32.605969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.606243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.606531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.610137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:32.610491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:32.613268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:32.639492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2575/5154] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:32.644170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:32.656796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092b59-3685-416b-9d38-05e9b4d0782c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:32.664035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:32.665699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.666190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.666755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.669672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:32.672115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:32.736326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2580/5155] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:32 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:32.740760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:32.759928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495737b-fb32-442c-8f53-e9aad2547b6e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:32.892059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:32.892889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.893308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.894180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.894889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:32.896892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:32.927273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2576/5156] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:32 2022] POST /identity/v3/users => generated 305 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:32.933519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:32.947394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0927-3b87-4a75-8b3e-5a45729a0a8b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:32.962833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:32.966044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:32.966778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:32.967657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:32.971810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:32.977021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.004007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2581/5157] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:33.005979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.020805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e766-7684-467d-b66a-3a185eb51b1d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.027783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.028855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.029176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.029592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] PATH_INFO: `/v3/projects/789097eda69a42668f6d99a55af08136/users/271d8c5f89b44cd1a55f45bb44378dba/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.058107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789097eda69a42668f6d99a55af08136, user_id=271d8c5f89b44cd1a55f45bb44378dba, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.062050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.095085 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2577/5158] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:33 2022] PUT /identity/v3/projects/789097eda69a42668f6d99a55af08136/users/271d8c5f89b44cd1a55f45bb44378dba/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:33.098867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.117804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a582-8ff2-43f0-8334-e4b2d5afbd50 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.257174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.258064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.258570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.258819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.259662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.261550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f988-9d1a-4749-8373-55fb49047a19 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.286232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2582/5159] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:33.291186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.304200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dce98-78f8-46c9-af88-3e69c16dd527 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.312432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.313469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.314026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.314705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] PATH_INFO: `/v3/projects/789097eda69a42668f6d99a55af08136/users/271d8c5f89b44cd1a55f45bb44378dba/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.317388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789097eda69a42668f6d99a55af08136, user_id=271d8c5f89b44cd1a55f45bb44378dba, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.321037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.337926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2578/5160] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:33 2022] PUT /identity/v3/projects/789097eda69a42668f6d99a55af08136/users/271d8c5f89b44cd1a55f45bb44378dba/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:33.348869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.349168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.349456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.386520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] MFA Rules not processed for user `271d8c5f89b44cd1a55f45bb44378dba`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:33.388100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:33.504631 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2583/5161] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:33.509801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.583566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffc8ce-f4d8-4d27-93f6-06d1f0a81814 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.589311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.590086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.593485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.593485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.593485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.593830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.634988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.636155 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2579/5162] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:33 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:33.657750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d960-4ce5-4b79-8234-c08ec76567b2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.731804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.732415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.734660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.734973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.736171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.738640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.782949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2584/5163] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:33 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:33.784192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.821040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e21bc-4a6e-4151-b2ca-35cab4e2908b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.843090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.843803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.844082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.844360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.845131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.846743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.888063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.888383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2580/5164] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:33.902981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66b28-fa7e-4473-9973-3f119a4017d6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.911073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.912306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.913006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.913467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.914584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.916313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca8d6b-ebab-497a-99c3-126f5320ff34 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:33.934720 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2585/5165] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:33.935565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:33.951951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6363-aef8-4a77-8514-44c8ca658e91 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:33.958177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:33.959327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:33.959929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:33.960355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] PATH_INFO: `/v3/projects/8378d7c9f15f46f1a86b7a67cb8c0d73/users/499ebfd2c9b04225a9c43c95540c0b86/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:33.984288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8378d7c9f15f46f1a86b7a67cb8c0d73, user_id=499ebfd2c9b04225a9c43c95540c0b86, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:33.987392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:34.018731 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2581/5166] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:33 2022] PUT /identity/v3/projects/8378d7c9f15f46f1a86b7a67cb8c0d73/users/499ebfd2c9b04225a9c43c95540c0b86/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:34.031019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:34.031245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:34.031576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:34.062554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] MFA Rules not processed for user `499ebfd2c9b04225a9c43c95540c0b86`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:34.064282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:34.193648 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2586/5167] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:34.205578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:34.208047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:34.369556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5825103-ac0d-423a-9b2e-1691d7b7e7a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:34.374771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:34.375442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:34.375729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:34.375990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:34.469839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:34.471414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8276052-fe52-48ef-8bbf-baeba76a7550 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:34.491979 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2582/5168] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:34.972601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:35.087548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6771-fb8c-45fb-8d4d-8cc8d0b47a9a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:35.093343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:35.094550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:35.095034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:35.095512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] PATH_INFO: `/v3/users/271d8c5f89b44cd1a55f45bb44378dba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:35.097953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271d8c5f89b44cd1a55f45bb44378dba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:35.100925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:35.176448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271d8c5f89b44cd1a55f45bb44378dba'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:35.189231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271d8c5f89b44cd1a55f45bb44378dba'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:35.190264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271d8c5f89b44cd1a55f45bb44378dba'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:35.190909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271d8c5f89b44cd1a55f45bb44378dba'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:35.202761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271d8c5f89b44cd1a55f45bb44378dba'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:35.235933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2587/5169] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:34 2022] DELETE /identity/v3/users/271d8c5f89b44cd1a55f45bb44378dba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:35.241587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:35.242610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:35.243102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:35.264641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:35.266206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:35.384595 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2583/5170] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:35.404916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:35.407216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:35.551579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f68-7d57-4cf7-8799-d641a4f1d265 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:35.556483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:35.557353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:35.557708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:35.559345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:35.586601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:35.588821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:35.602288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2588/5171] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:37.217524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:37.219033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:37.233154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b081b5-3ec3-4cdb-b389-2d339650ac6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:37.246561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:37.247827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:37.248279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:37.248760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] PATH_INFO: `/v3/projects/789097eda69a42668f6d99a55af08136` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:37.250508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] RBAC: Authorizing `identity:delete_project(project_id=789097eda69a42668f6d99a55af08136)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:37.261540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:37.344376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789097eda69a42668f6d99a55af08136', 'request_id': 'req-c66a1926-bfd8-40e5-99b8-2bb05530161f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.363646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789097eda69a42668f6d99a55af08136', 'request_id': 'req-c66a1926-bfd8-40e5-99b8-2bb05530161f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.371991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789097eda69a42668f6d99a55af08136', 'request_id': 'req-c66a1926-bfd8-40e5-99b8-2bb05530161f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.410686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] The token cache is being invalidate because project 789097eda69a42668f6d99a55af08136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:37.411276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.412230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.419761 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2584/5172] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:37 2022] DELETE /identity/v3/projects/789097eda69a42668f6d99a55af08136 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:37.419981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:37.433519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e1111-75ac-429e-a3fd-cdf6ff076978 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:37.599240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:37.601065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:37.601469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:37.602139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] PATH_INFO: `/v3/users/499ebfd2c9b04225a9c43c95540c0b86` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:37.603941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499ebfd2c9b04225a9c43c95540c0b86)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:37.606236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:37.689882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499ebfd2c9b04225a9c43c95540c0b86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.706210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499ebfd2c9b04225a9c43c95540c0b86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.708903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499ebfd2c9b04225a9c43c95540c0b86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.710522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499ebfd2c9b04225a9c43c95540c0b86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.728234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec64e98d-ecb7-4cd2-816b-83974790e357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499ebfd2c9b04225a9c43c95540c0b86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:37.775346 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2589/5173] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:37 2022] DELETE /identity/v3/users/499ebfd2c9b04225a9c43c95540c0b86 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:38.993008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:38.995785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:39.012611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1926-bfd8-40e5-99b8-2bb05530161f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.155082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.156631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.157668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.158609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] PATH_INFO: `/v3/projects/8378d7c9f15f46f1a86b7a67cb8c0d73` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.160347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8378d7c9f15f46f1a86b7a67cb8c0d73)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.163402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.275066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8378d7c9f15f46f1a86b7a67cb8c0d73', 'request_id': 'req-758c7b69-f5a1-458c-9cec-904b8d7118f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:39.289892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8378d7c9f15f46f1a86b7a67cb8c0d73', 'request_id': 'req-758c7b69-f5a1-458c-9cec-904b8d7118f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:39.301369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8378d7c9f15f46f1a86b7a67cb8c0d73', 'request_id': 'req-758c7b69-f5a1-458c-9cec-904b8d7118f7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:39.329177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] The token cache is being invalidate because project 8378d7c9f15f46f1a86b7a67cb8c0d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:39.329793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:39.330770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-758c7b69-f5a1-458c-9cec-904b8d7118f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:39.333235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2585/5174] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:38 2022] DELETE /identity/v3/projects/8378d7c9f15f46f1a86b7a67cb8c0d73 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:39.339830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.341377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.342035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.379804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:39.381371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:39.465811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2590/5175] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:39.474155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.474445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.474728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.499860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:39.501356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:39.513293 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2586/5176] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:39.517737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.533432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eae1b7-7eaa-46d6-afa3-80bbc21bb3de None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.540961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.542681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.542908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.543191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.545047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:39.545354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.547920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.568117 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2591/5177] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:39.571930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.590071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25d00-a8f0-4627-8d77-1e67a7f1bf20 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.595597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.596294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.596612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.596888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.597914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.601038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.634857 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2587/5178] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:39 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:39.639072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.649825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93101f-5ac1-4292-950d-5ecffaff542e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.736141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.736986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.737451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.738529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.738529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.740716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.764717 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2592/5179] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:39 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:39.770195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.785510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25089e-eb6a-4af0-a834-890f67f7e91a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.799941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.801136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.801462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.801809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.802668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.811254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.826836 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2588/5180] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:39.830542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.852369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95995-0807-42ca-886d-d1adf5c6d981 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.873355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.874096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.874413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.874721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.875637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.877116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351af0-bb80-4f8b-a723-4a0755386e24 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:39.899848 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2593/5181] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:39.904399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:39.917049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65292141-2b7e-4f4a-88ec-a2181b403ae3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:39.934753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:39.935825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:39.936266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:39.936586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] PATH_INFO: `/v3/projects/4890172d2e9e4cec952b7208cb2b1364/users/62954b0924944c9c88d921a9fde9d898/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:39.971722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4890172d2e9e4cec952b7208cb2b1364, user_id=62954b0924944c9c88d921a9fde9d898, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:39.979334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:40.004655 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2589/5182] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:39 2022] PUT /identity/v3/projects/4890172d2e9e4cec952b7208cb2b1364/users/62954b0924944c9c88d921a9fde9d898/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:40.016120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:40.016436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:40.016813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:40.064729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] MFA Rules not processed for user `62954b0924944c9c88d921a9fde9d898`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:40.066426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:40.204183 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2594/5183] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:40.219468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:40.221486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:40.319845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b41faa-1c0f-46d7-8ff3-85e9589925c6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:40.323903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:40.324631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:40.324921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:40.325340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:40.336985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:40.338750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4184fd3-a25c-4ada-983e-362760526628 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:40.351407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2590/5184] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:41.347549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:41.477268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedd14-cd44-4f50-88b2-ba0584d6ac9d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:41.481781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eefc75-4af3-45f9-b9ec-79c4e0d037d1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.482612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eefc75-4af3-45f9-b9ec-79c4e0d037d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.483109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eefc75-4af3-45f9-b9ec-79c4e0d037d1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.485250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2591/5185] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 02 21:07:41.488699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:41.489812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.490262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.490728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] PATH_INFO: `/v3/users/62954b0924944c9c88d921a9fde9d898` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.492335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62954b0924944c9c88d921a9fde9d898)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:41.494554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:41.496550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b174f7-a84f-46b6-ac22-c95c91d2d032 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.497337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b174f7-a84f-46b6-ac22-c95c91d2d032 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.497780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b174f7-a84f-46b6-ac22-c95c91d2d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.570068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f1b174f7-a84f-46b6-ac22-c95c91d2d032 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:41.571984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1b174f7-a84f-46b6-ac22-c95c91d2d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:41.621517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62954b0924944c9c88d921a9fde9d898'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:41.640188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62954b0924944c9c88d921a9fde9d898'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:41.641758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62954b0924944c9c88d921a9fde9d898'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:41.642910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62954b0924944c9c88d921a9fde9d898'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:41.657962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62954b0924944c9c88d921a9fde9d898'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:41.681548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2595/5186] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:41 2022] DELETE /identity/v3/users/62954b0924944c9c88d921a9fde9d898 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:41.682385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:41.684785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:41.701783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2592/5187] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:41.703671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.704346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.704835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.744132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:41.746396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:41.793595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407c13f-ab00-4938-bc63-8433653bd752 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:41.808232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:41.809312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.809751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.810101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.812061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:41.838359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:41.839752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:41.856150 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2596/5188] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:41.857855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:41.859562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:41.891622 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2593/5189] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:41.942946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfc9ac-a579-46f2-8b7a-ead353f78734 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:41.948774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:41.949751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:41.950276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:41.950752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:41.962392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:41.964878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:41.976376 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2597/5190] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:42.047155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:42.049096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:42.066357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c74717-0823-43c5-8575-065cd84bac1d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:42.072116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:42.072876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:42.073795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:42.073795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:42.084169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:42.086011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd079f-bcdd-40e7-b8ec-199a3881d5bd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:42.097338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2594/5191] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:43.086596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.095203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:43.143718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a499b-5acd-4f52-ac8d-2eee14fe5e53 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.157029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.159005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.159678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.160550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] PATH_INFO: `/v3/projects/4890172d2e9e4cec952b7208cb2b1364` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.162015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4890172d2e9e4cec952b7208cb2b1364)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.164396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.241942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4890172d2e9e4cec952b7208cb2b1364', 'request_id': 'req-aa2b6f5e-db25-4292-b404-b2bda32df185'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:43.250421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4890172d2e9e4cec952b7208cb2b1364', 'request_id': 'req-aa2b6f5e-db25-4292-b404-b2bda32df185'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:43.277133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4890172d2e9e4cec952b7208cb2b1364', 'request_id': 'req-aa2b6f5e-db25-4292-b404-b2bda32df185'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:43.318106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] The token cache is being invalidate because project 4890172d2e9e4cec952b7208cb2b1364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:43.319213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:43.320256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa2b6f5e-db25-4292-b404-b2bda32df185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:43.323080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2598/5192] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:43 2022] DELETE /identity/v3/projects/4890172d2e9e4cec952b7208cb2b1364 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:43.329344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.329906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.330034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.366308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:43.368685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:43.467399 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2595/5193] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:43.546138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.546424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.546695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.572117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:43.573415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:43.582926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2599/5194] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:43.587665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.599271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4681f7f-4680-41c1-b484-7bba36323264 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.605106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.605965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.606258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.606596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.607328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:43.608156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.609722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.624510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2596/5195] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:43.629153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.641287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84f125-bf19-4f2c-bf71-4d4964790ef1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.647327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.648173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.648488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.648815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.649623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.651649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.682063 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2600/5196] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:43 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:43.687477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.706296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3ef12-3257-4d78-9e62-c96b19d6837f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.785680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.786602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.786934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.787344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.788318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.790742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.826579 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2597/5197] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:43 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:43.826914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.839560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088fb1-0f74-4d15-ac98-ad928fb32895 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.847805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.848593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.848920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.849174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.850417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.852512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.870262 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2601/5198] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:43.880029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.892728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57da15-24fe-47d6-9798-bedfae317b48 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.899963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.900798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.901260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.901561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.902539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.904393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbafb4c-c6e1-43e5-a688-996b568d5f23 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.921274 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2598/5199] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:43.922683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:43.934180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed53c6-481d-488e-bd99-4ea3bc5eaf6e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:43.941028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:43.942029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:43.942392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:43.943282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] PATH_INFO: `/v3/projects/9019a66d9d8449379b3e815771bf6d9f/users/aa96a8b4d9d345a7ac95dcd2875186e0/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:43.963288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9019a66d9d8449379b3e815771bf6d9f, user_id=aa96a8b4d9d345a7ac95dcd2875186e0, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:43.966412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:43.992973 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2602/5200] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:43 2022] PUT /identity/v3/projects/9019a66d9d8449379b3e815771bf6d9f/users/aa96a8b4d9d345a7ac95dcd2875186e0/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:44.002431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:44.003127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:44.003488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:44.104993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] MFA Rules not processed for user `aa96a8b4d9d345a7ac95dcd2875186e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:44.113339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:44.234400 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2599/5201] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:44.259263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:44.266216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:44.396155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cc73c-4477-4949-8456-0d6b79afa5c7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:44.404682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:44.405540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:44.406126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:44.406654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:44.423547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:44.427832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e7c5-b57f-40dd-8f07-bbb7cc4a9f9f service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:44.442686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2603/5202] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:45.061550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:45.202602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d081-f2ae-420a-b9a4-e9cbcab9d283 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:45.208312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:45.210078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:45.210288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:45.210581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] PATH_INFO: `/v3/users/aa96a8b4d9d345a7ac95dcd2875186e0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:45.212119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa96a8b4d9d345a7ac95dcd2875186e0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:45.214515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:45.276830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa96a8b4d9d345a7ac95dcd2875186e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:45.292196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa96a8b4d9d345a7ac95dcd2875186e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:45.293055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa96a8b4d9d345a7ac95dcd2875186e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:45.302245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa96a8b4d9d345a7ac95dcd2875186e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:45.310651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa96a8b4d9d345a7ac95dcd2875186e0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:45.318693 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2600/5203] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:45 2022] DELETE /identity/v3/users/aa96a8b4d9d345a7ac95dcd2875186e0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:45.323528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:45.324144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:45.324144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:45.343987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:45.345321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:45.415605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2604/5204] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:45.425870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:45.427471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:45.513279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a27b01-70b4-4404-afb3-206c5b683ee8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:45.519649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:45.520323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:45.520648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:45.520929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:45.534726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:45.537068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe60b-78d8-4674-8e3b-8fa5069e1914 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:45.548800 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2601/5205] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:45.982080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:45.984315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:45.999831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1114-b787-41e2-939b-3b014ae15870 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.006710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.008878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.009634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.010196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] PATH_INFO: `/v3/projects/9019a66d9d8449379b3e815771bf6d9f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.012320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9019a66d9d8449379b3e815771bf6d9f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.015506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.124973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9019a66d9d8449379b3e815771bf6d9f', 'request_id': 'req-0820e18f-2592-49be-87cc-55e246659f0a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:46.132926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9019a66d9d8449379b3e815771bf6d9f', 'request_id': 'req-0820e18f-2592-49be-87cc-55e246659f0a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:46.144742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9019a66d9d8449379b3e815771bf6d9f', 'request_id': 'req-0820e18f-2592-49be-87cc-55e246659f0a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:46.157400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] The token cache is being invalidate because project 9019a66d9d8449379b3e815771bf6d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:46.157697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:46.158375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0820e18f-2592-49be-87cc-55e246659f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:46.162984 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2605/5206] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:45 2022] DELETE /identity/v3/projects/9019a66d9d8449379b3e815771bf6d9f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:46.169480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.171260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.171381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.194883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:46.196119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:46.295068 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2602/5207] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:46.306641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.308393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.309010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.334315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:46.337425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:46.391287 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2606/5208] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:46.395845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.421830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a19d5-e98f-4a28-ba77-70ae8ac9684d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.434546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.435674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.436071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.436548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.437419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:46.437960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.440612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.460333 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2603/5209] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:46.464842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.479358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d38e3-4f77-4be9-b5a5-54ffee36c07b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.497840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.498566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.498858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.499244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.500011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.502157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.545818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2607/5210] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:46 2022] POST /identity/v3/projects => generated 411 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:46.550277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.563693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c949bd-4bc4-4ee0-a156-a8e1cf18072c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.674511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.675216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.675506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.675790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.676611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.679173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.707054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2604/5211] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:46 2022] POST /identity/v3/users => generated 306 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:46.710881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.731217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92433-80d5-451b-a83e-96fb06e0118f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.738867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.739559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.739827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.740116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.740937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.742574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.760383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2608/5212] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:46.761703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.779134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15365-91ea-446a-9a39-032401f8d1dc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.786324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.786324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.786324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.786672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.787902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.789570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.805308 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2605/5213] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:46.806893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.820569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4435-d758-414c-a9db-6fac371bc8f3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.831146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:46.835014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.835903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.836603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] PATH_INFO: `/v3/projects/7430123a83304e0fb8e6cfb6440a98c3/users/9279547b0ef1499188143e1d57cdfa26/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.870113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7430123a83304e0fb8e6cfb6440a98c3, user_id=9279547b0ef1499188143e1d57cdfa26, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:46.873223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581325-7e5b-4ecf-a0b0-2ecad3de6c68 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:46.880037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:46.885037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:46.929243 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2609/5214] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:46 2022] PUT /identity/v3/projects/7430123a83304e0fb8e6cfb6440a98c3/users/9279547b0ef1499188143e1d57cdfa26/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:46.931224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:46.932001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:46.932376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:46.932554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46a68-4f40-4640-b440-38044688695d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:46.976598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] MFA Rules not processed for user `9279547b0ef1499188143e1d57cdfa26`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:46.978467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.041414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.042582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.043468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.043468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] PATH_INFO: `/v3/users/8c887a3020eb4d0fbf93b55a1aba87a8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.048443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c887a3020eb4d0fbf93b55a1aba87a8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.051001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.081468 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2610/5215] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:47.087586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.103879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8115f48-86fc-470a-b2cf-4ee21eb5cb18 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.110195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.111032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.111376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.111784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.112616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.115093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.119990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c887a3020eb4d0fbf93b55a1aba87a8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.135700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c887a3020eb4d0fbf93b55a1aba87a8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.136607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c887a3020eb4d0fbf93b55a1aba87a8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.156702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2611/5216] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/projects => generated 411 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:47.158186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c887a3020eb4d0fbf93b55a1aba87a8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.159155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.162545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.169840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c887a3020eb4d0fbf93b55a1aba87a8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.181306 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2606/5217] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:46 2022] DELETE /identity/v3/users/8c887a3020eb4d0fbf93b55a1aba87a8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:47.266023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55596973-156c-4976-b864-58e6a6e60d9f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.338602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.339366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.339658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.340182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.341405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.343641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.371274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2612/5218] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/users => generated 312 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:47.372685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.385381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecb63-700e-4b01-82e9-070337fdace9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.393384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.393795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.394262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.395210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.395712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.395904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.396480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.398786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.410174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928cf26-354a-4654-a38b-4fd6b4f33f0b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.416507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2607/5219] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:47.424219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.425454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.425975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.426507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] PATH_INFO: `/v3/projects/9d575ad1b73d40c4a8a1c7e0455886ce` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.429143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d575ad1b73d40c4a8a1c7e0455886ce)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.431601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.432824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.453888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca0082-22fe-4cf2-96a1-212f4aa0e899 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.461432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.463250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.463545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.464004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] PATH_INFO: `/v3/projects/7f35ccccacaa4bbf896416b40c10f60d/users/8351a70bca9b436396c45e7abcd739ea/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.518724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f35ccccacaa4bbf896416b40c10f60d, user_id=8351a70bca9b436396c45e7abcd739ea, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.527785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.551543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2608/5220] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:47 2022] PUT /identity/v3/projects/7f35ccccacaa4bbf896416b40c10f60d/users/8351a70bca9b436396c45e7abcd739ea/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:47.557644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.574797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d575ad1b73d40c4a8a1c7e0455886ce', 'request_id': 'req-283d943c-6c7d-4a4d-9560-c91fcc659d1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.589464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d575ad1b73d40c4a8a1c7e0455886ce', 'request_id': 'req-283d943c-6c7d-4a4d-9560-c91fcc659d1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.603565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d575ad1b73d40c4a8a1c7e0455886ce', 'request_id': 'req-283d943c-6c7d-4a4d-9560-c91fcc659d1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.625259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] The token cache is being invalidate because project 9d575ad1b73d40c4a8a1c7e0455886ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:47.626133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.627077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-283d943c-6c7d-4a4d-9560-c91fcc659d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:47.632953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2613/5221] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:47 2022] DELETE /identity/v3/projects/9d575ad1b73d40c4a8a1c7e0455886ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:47.643141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442140-e243-4b0a-b091-c74aee6a506a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.643552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442140-e243-4b0a-b091-c74aee6a506a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.643911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4442140-e243-4b0a-b091-c74aee6a506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.666635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4442140-e243-4b0a-b091-c74aee6a506a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:47.668952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4442140-e243-4b0a-b091-c74aee6a506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.705304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18b01e-3578-42a8-95cf-4daba72c5af7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.714941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.715735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.716107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.716486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.717434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.719546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.735898 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2609/5222] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:07:47.738141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.739992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.752959 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2614/5223] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:47.761680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.761974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.762261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.763056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45cc54-f260-4ef1-91df-df1e553fe5bc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.770847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.772123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.772888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.773300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] PATH_INFO: `/v3/projects/7f35ccccacaa4bbf896416b40c10f60d/users/8351a70bca9b436396c45e7abcd739ea/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.776999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f35ccccacaa4bbf896416b40c10f60d, user_id=8351a70bca9b436396c45e7abcd739ea, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.780319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7d80d-651f-48fc-80a8-63a1e46e04bf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.785987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:47.787748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.796770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2610/5224] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:47 2022] PUT /identity/v3/projects/7f35ccccacaa4bbf896416b40c10f60d/users/8351a70bca9b436396c45e7abcd739ea/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:47.806584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.807032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.807573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.881154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2615/5225] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:47.882771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] MFA Rules not processed for user `8351a70bca9b436396c45e7abcd739ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:47.884335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:47.888981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.902020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3419e-db5b-4585-9d84-a203752265f4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:47.909210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:47.910679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:47.911197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:47.911568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:47.914719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:47.914719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:47.917023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:47.938170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2616/5226] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:47.939940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:47.985578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc334b-7cdd-45b8-abbe-89de55170315 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.002111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.003031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.003382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.003805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.005471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.008125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.058091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2617/5227] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:48.060128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.109498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2611/5228] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:48.122492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.124678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:48.217060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be732-b3b8-469a-968a-330fcbfebb20 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.228720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.229806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.230902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.231798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.234068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.237774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.238486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab575e2-8c12-46c0-bd79-60d8a3bab9b2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.280554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2618/5229] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:48 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:48.281509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.292470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca26b9-f2f7-4a75-ad11-6cc806e9c7aa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.297948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.298638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.299553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.300156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.300992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.302631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.316177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2619/5230] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:48.321875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.322562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.323524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.323890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.324291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.336044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11295-7885-4150-9899-5512a4e87a6b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.345246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.346009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.346343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.346627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.347729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.351047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.368262 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2620/5231] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:48.372813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.401695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e0a9-6fbb-4f40-8162-e5ee10f0cdd4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.408807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.410017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.410337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.411620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] PATH_INFO: `/v3/projects/93da813e266e41509229a1e99815d9ab/users/ac8027ca8086469999ae8a73639fca90/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.417752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.423281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c354c32-0abd-47e7-93b8-29d1b760fb40 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.434720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2612/5232] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:07:48.439876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93da813e266e41509229a1e99815d9ab, user_id=ac8027ca8086469999ae8a73639fca90, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.465274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.486342 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2621/5233] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:48 2022] PUT /identity/v3/projects/93da813e266e41509229a1e99815d9ab/users/ac8027ca8086469999ae8a73639fca90/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:48.494165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768120-4fc2-4fbd-a6ad-51da12613ee4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.494988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768120-4fc2-4fbd-a6ad-51da12613ee4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.495102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768120-4fc2-4fbd-a6ad-51da12613ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.530916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-08768120-4fc2-4fbd-a6ad-51da12613ee4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:48.533549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08768120-4fc2-4fbd-a6ad-51da12613ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:48.620898 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2613/5234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:48.634808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:48.642481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:48.736191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1a56-930a-463b-92a5-2101beb260d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:48.740133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:48.741935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:48.742228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:48.742510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:48.753697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:48.756445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b424a-fb70-481b-9845-6f9c66beb6ca service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:48.767077 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2622/5235] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:49.317258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadc148-b5ed-4435-91ff-262b00883aa1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:49.318386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadc148-b5ed-4435-91ff-262b00883aa1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:49.319013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadc148-b5ed-4435-91ff-262b00883aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:49.340670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9dadc148-b5ed-4435-91ff-262b00883aa1 None None] MFA Rules not processed for user `d12e43a0a2994654a400b3a2bed83ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:49.342560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9dadc148-b5ed-4435-91ff-262b00883aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:49.407373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2614/5236] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:49.848559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24a5f-c682-4cb9-8a69-4b81c1a6f7d5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:49.850322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24a5f-c682-4cb9-8a69-4b81c1a6f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:49.850322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24a5f-c682-4cb9-8a69-4b81c1a6f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:49.908957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-68b24a5f-c682-4cb9-8a69-4b81c1a6f7d5 None None] MFA Rules not processed for user `ac8027ca8086469999ae8a73639fca90`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:49.912607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-68b24a5f-c682-4cb9-8a69-4b81c1a6f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:50.093317 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2623/5237] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:50.188960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:50.189506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:50.190255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:50.212558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] MFA Rules not processed for user `ac8027ca8086469999ae8a73639fca90`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:50.214457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:50.235701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:50.236249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:50.236799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:50.237022 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2615/5238] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:50.258890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] MFA Rules not processed for user `ac8027ca8086469999ae8a73639fca90`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:50.260100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:50.275142 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2624/5239] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:50.284816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:50.286747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:50.325641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:50.346673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dff2a-4821-4295-b97b-b20bed6e10a4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:50.357504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:50.358711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:50.359911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:50.360516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:50.364836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:50.391579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:50.395642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d42301-9bb2-4894-8e50-d66abd816d1c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:50.428057 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2625/5240] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:50.475580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe8497-414f-4ddc-8794-1948789bebc4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:50.484048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:50.485141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:50.485666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:50.486146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:50.497821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:50.499975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:50.517619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2616/5241] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:52.026465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a964-303c-45e3-9b26-291688f336da None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:52.027126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a964-303c-45e3-9b26-291688f336da None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:52.027517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a964-303c-45e3-9b26-291688f336da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:52.097152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7259a964-303c-45e3-9b26-291688f336da None None] MFA Rules not processed for user `ac8027ca8086469999ae8a73639fca90`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:52.104114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7259a964-303c-45e3-9b26-291688f336da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:52.113093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:52.125057 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2626/5242] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:52.143502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d57e0-35dd-4b8d-834d-01cef82ec190 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:52.164484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:52.168976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:52.169274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:52.172140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] PATH_INFO: `/v3/users/9279547b0ef1499188143e1d57cdfa26` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:52.176361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9279547b0ef1499188143e1d57cdfa26)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:52.186776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:52.328089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9279547b0ef1499188143e1d57cdfa26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:52.348061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9279547b0ef1499188143e1d57cdfa26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:52.349780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9279547b0ef1499188143e1d57cdfa26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:52.365908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9279547b0ef1499188143e1d57cdfa26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:52.382854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9279547b0ef1499188143e1d57cdfa26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:52.393154 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2617/5243] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:52 2022] DELETE /identity/v3/users/9279547b0ef1499188143e1d57cdfa26 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:52.399164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403fe4-353c-4416-9bcd-7ac1731dfc37 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:52.399596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403fe4-353c-4416-9bcd-7ac1731dfc37 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:52.400002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403fe4-353c-4416-9bcd-7ac1731dfc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:52.445358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d1403fe4-353c-4416-9bcd-7ac1731dfc37 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:52.446853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1403fe4-353c-4416-9bcd-7ac1731dfc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:52.631999 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2627/5244] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:52.704145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:52.705747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:52.855837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3256e25-b9ca-4e9f-bf50-a1a18e05ec25 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:52.864200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:52.873893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:52.874803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:52.875303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:52.908165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:52.911179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:52.933843 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2618/5245] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:53.588021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:53.589271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:53.590258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:53.642142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] MFA Rules not processed for user `ac8027ca8086469999ae8a73639fca90`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:53.643386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:53.722453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:53.723946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:53.753200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf31d-c024-4632-903c-92d4ff5ef45d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:53.767892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:53.770313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:53.773761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:53.774133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] PATH_INFO: `/v3/projects/7430123a83304e0fb8e6cfb6440a98c3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:53.778607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7430123a83304e0fb8e6cfb6440a98c3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:53.781386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:53.798175 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2628/5246] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:53.939730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7430123a83304e0fb8e6cfb6440a98c3', 'request_id': 'req-02e9a22c-9687-4d84-a11f-757e3107bddc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:53.950396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7430123a83304e0fb8e6cfb6440a98c3', 'request_id': 'req-02e9a22c-9687-4d84-a11f-757e3107bddc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:53.957410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7430123a83304e0fb8e6cfb6440a98c3', 'request_id': 'req-02e9a22c-9687-4d84-a11f-757e3107bddc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:53.985894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] The token cache is being invalidate because project 7430123a83304e0fb8e6cfb6440a98c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:53.986492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:53.989145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:53.992989 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2619/5247] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:53 2022] DELETE /identity/v3/projects/7430123a83304e0fb8e6cfb6440a98c3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:53.999605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:54.017211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82e8fb-d206-42ee-ae4a-4a43e9c273a8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:54.118677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:54.120486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:54.200251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:54.201366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:54.201869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:54.202247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] PATH_INFO: `/v3/users/8351a70bca9b436396c45e7abcd739ea` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:54.207881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8351a70bca9b436396c45e7abcd739ea)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:54.210857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:54.320606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8351a70bca9b436396c45e7abcd739ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.338572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8351a70bca9b436396c45e7abcd739ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.340582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8351a70bca9b436396c45e7abcd739ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.341468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8351a70bca9b436396c45e7abcd739ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.363040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8351a70bca9b436396c45e7abcd739ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.385824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2629/5248] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:53 2022] DELETE /identity/v3/users/8351a70bca9b436396c45e7abcd739ea => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:54.387812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9a22c-9687-4d84-a11f-757e3107bddc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:54.512925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:54.531594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:54.533958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:54.534931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] PATH_INFO: `/v3/users/140cc422fc5b40eaa3cd538fb9c05b7a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:54.539468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140cc422fc5b40eaa3cd538fb9c05b7a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:54.544805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:54.660642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140cc422fc5b40eaa3cd538fb9c05b7a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.689780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140cc422fc5b40eaa3cd538fb9c05b7a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.690557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140cc422fc5b40eaa3cd538fb9c05b7a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.701913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140cc422fc5b40eaa3cd538fb9c05b7a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.718011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140cc422fc5b40eaa3cd538fb9c05b7a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:54.729596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2620/5249] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:07:54 2022] DELETE /identity/v3/users/140cc422fc5b40eaa3cd538fb9c05b7a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:54.975201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:54.978427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.018769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e958ca-2f85-4d84-b87b-0899395023a2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:55.127915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:55.128974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.129631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.130025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] PATH_INFO: `/v3/projects/7f35ccccacaa4bbf896416b40c10f60d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.133189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f35ccccacaa4bbf896416b40c10f60d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:55.140549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:55.257195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:55.258954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.284060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f35ccccacaa4bbf896416b40c10f60d', 'request_id': 'req-707ab710-6f2f-48d1-b3ae-8bbbc527165a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.303490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f35ccccacaa4bbf896416b40c10f60d', 'request_id': 'req-707ab710-6f2f-48d1-b3ae-8bbbc527165a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.320624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f35ccccacaa4bbf896416b40c10f60d', 'request_id': 'req-707ab710-6f2f-48d1-b3ae-8bbbc527165a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.324419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f465ff8-44f1-4a10-8041-36601a1ca8a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:55.352374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] The token cache is being invalidate because project 7f35ccccacaa4bbf896416b40c10f60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:55.355551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.356629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-707ab710-6f2f-48d1-b3ae-8bbbc527165a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.360850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2630/5250] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:54 2022] DELETE /identity/v3/projects/7f35ccccacaa4bbf896416b40c10f60d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:55.382565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a5b4-3de3-42bd-96f6-1eb9646f0bef None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.382866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a5b4-3de3-42bd-96f6-1eb9646f0bef None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.383198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a5b4-3de3-42bd-96f6-1eb9646f0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.460252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8da4a5b4-3de3-42bd-96f6-1eb9646f0bef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:55.461744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8da4a5b4-3de3-42bd-96f6-1eb9646f0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.486223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:55.487820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.492167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.492838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] PATH_INFO: `/v3/projects/1b8620340d064cd98fd526e46e061d4f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.499098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8620340d064cd98fd526e46e061d4f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:55.510999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:55.642524 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2631/5251] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:55.652470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.653128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.653662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.675692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8620340d064cd98fd526e46e061d4f', 'request_id': 'req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.685413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8620340d064cd98fd526e46e061d4f', 'request_id': 'req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.691448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:55.691941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8620340d064cd98fd526e46e061d4f', 'request_id': 'req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.693851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.716898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] The token cache is being invalidate because project 1b8620340d064cd98fd526e46e061d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:07:55.717329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.718281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d0d7ba1-44a8-4b18-a5b9-6076d9280f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:07:55.721246 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2621/5252] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:07:55 2022] DELETE /identity/v3/projects/1b8620340d064cd98fd526e46e061d4f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:07:55.728561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095e36-8423-4308-842b-7ef46a4043f4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.729561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095e36-8423-4308-842b-7ef46a4043f4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.730047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e095e36-8423-4308-842b-7ef46a4043f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.760164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6e095e36-8423-4308-842b-7ef46a4043f4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:55.762440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e095e36-8423-4308-842b-7ef46a4043f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.813631 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2632/5253] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:55.817518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:55.839165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d87b8a-4ce2-4ccd-90e6-e3cdfae41daf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:55.849203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:55.850845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.851135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.851849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.853130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:55.854503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:55.857156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:55.877197 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2633/5254] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:55.883240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:55.906648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd75f9-44a6-41f2-ae82-190a3da37496 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:55.919473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2622/5255] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:55.920759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:55.921447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.921736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.922012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.922586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:55.922752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:55.923296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:55.923757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:55.924635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:55.945194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:55.947016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:55.957091 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2623/5256] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:55.963382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:55.983321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f87d27-d50b-4090-9ca5-08cc736a9547 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:55.988563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2634/5257] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:55.990075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.066277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.067166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.067593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.068010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.069498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:07:56.069915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.071646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.081227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691fb39-d0c6-4bb3-a1b8-d7078b10b781 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.086798 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2624/5258] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:07:56.088604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.089416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.089710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.090082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.090927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.091643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.093146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.102652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d925f-0acb-4527-86b4-28bbb2ce9d5e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.108211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.109323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.109638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.110210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.111061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.113207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.130444 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2635/5259] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:55 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:56.137387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.158870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37aa3c-38bc-48e7-a702-50f7a4b47faf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.165025 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2625/5260] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:07:56.173167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.175475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.176155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.176563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.177746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.183027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.184770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.220777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2636/5261] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:56.221791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.239640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb0e01-a10a-4b6e-989f-c9e55527affa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.310276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da54b9-2ea2-4a12-b935-b87b61f2fa5b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.319350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.320064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.320356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.321399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.322098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.328402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.373884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.374722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.375330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.375620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.376866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.378599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.380421 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2626/5262] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:56.390242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.406320 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2637/5263] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:56.408123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.410975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10362314-1b56-4d99-91a2-4b3e1b0f212c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.421804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.422185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8cd9-e8aa-4a82-91ea-4f549a0457c4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.423407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.423920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.424417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.425812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.428296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.429421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.430611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.431089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.431606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] PATH_INFO: `/v3/projects/23bcc97db4fb439c963372cc4cb40d5e/users/5f5eda0097aa44bd99d72582428c3522/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.457807 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2627/5264] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:56.459560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.478171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178f76-393e-4b1f-af0f-e149d8456dbc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.485041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.486128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.486702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.487216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.488244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.490770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.494061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bcc97db4fb439c963372cc4cb40d5e, user_id=5f5eda0097aa44bd99d72582428c3522, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.497122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d567b-f8ce-4208-953d-1a6ea66aef46 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.510628 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2628/5265] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:56.513397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.531336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d7635-9345-4219-8754-7d2a9f87485c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.533239 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2638/5266] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:56 2022] PUT /identity/v3/projects/23bcc97db4fb439c963372cc4cb40d5e/users/5f5eda0097aa44bd99d72582428c3522/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:56.544687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.545072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.545413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.585476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] MFA Rules not processed for user `5f5eda0097aa44bd99d72582428c3522`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:56.586924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:56.672269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2639/5267] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:07:56.676226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.676226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.677182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.679491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.680285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] PATH_INFO: `/v3/projects/381ce062df854c77b16cc5cff07c462e/users/59fa2d8ade804f859d48ea6be1949e42/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.707887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f165f-875e-4016-b4fe-cf7620ed10c5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.719260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.720033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.720389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.720635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.722531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.723399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381ce062df854c77b16cc5cff07c462e, user_id=59fa2d8ade804f859d48ea6be1949e42, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.725154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.732867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b581-6c77-42d0-97f0-1eef616fe089 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.768277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2640/5268] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:56.771873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2629/5269] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:56 2022] PUT /identity/v3/projects/381ce062df854c77b16cc5cff07c462e/users/59fa2d8ade804f859d48ea6be1949e42/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:56.773613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.781529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.785226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.785857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.873713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:56.876335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:56.894600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b3f3b-11bd-438c-9b3b-5de3ab8967bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.901007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.902612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.904556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.905040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.906127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.909483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:56.960488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2641/5270] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:07:56.964727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:56.968652 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2630/5271] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:56.984773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ea6f6-5122-49dc-ad37-165b5e04e1f1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:56.992703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:56.994123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:56.994754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:56.995229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:56.997277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:56.997952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:57.001191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.004742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:57.019297 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2642/5272] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:57.028369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:57.055632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f302b-30ee-4891-83e3-5343ee6c2413 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:57.066598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:57.067602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.067900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.068419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] PATH_INFO: `/v3/projects/da46e21128e84fe4ba4983461606723a/users/53ac8e2a47b24a99b34d60e561c321e5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.098268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da46e21128e84fe4ba4983461606723a, user_id=53ac8e2a47b24a99b34d60e561c321e5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:57.109061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.110938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f130d-bb74-46d7-84a9-8ffa59417a67 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:57.118303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:57.119117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.119412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.122437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.142235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:57.145985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.153879 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2643/5273] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:57 2022] PUT /identity/v3/projects/da46e21128e84fe4ba4983461606723a/users/53ac8e2a47b24a99b34d60e561c321e5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:57.157815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:57.174522 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2631/5274] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:57.288222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d8ec0-6d83-4023-9ba0-0d5c900cda63 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:57.296035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:57.296951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.297105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.297450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.298190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:57.299963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc97be-6359-422d-8d20-a298b7d39f95 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.312821 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2644/5275] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:07:57.318002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:57.337191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896475d-d85b-4fe8-9b43-fc648e7776ec service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:57.345345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:57.347005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.347403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.347857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] PATH_INFO: `/v3/projects/da46e21128e84fe4ba4983461606723a/users/53ac8e2a47b24a99b34d60e561c321e5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.352926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da46e21128e84fe4ba4983461606723a, user_id=53ac8e2a47b24a99b34d60e561c321e5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:57.356056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.399160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2632/5276] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:07:57 2022] PUT /identity/v3/projects/da46e21128e84fe4ba4983461606723a/users/53ac8e2a47b24a99b34d60e561c321e5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:07:57.408300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.408649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.409363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.475578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] MFA Rules not processed for user `53ac8e2a47b24a99b34d60e561c321e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:57.479188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:57.626446 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2645/5277] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:07:57.652538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:57.655342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:57.742901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d362f-d10b-42ec-a6a8-941d9c77e3f7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:57.747646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:57.748683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:57.748683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:57.748897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:57.760314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:57.762028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a3dde-f066-4ccc-8060-3ace6f3531b3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:57.776433 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2633/5278] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:58.279457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:07:58.284894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:58.462371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7f549-22b7-43df-bb96-b3376aa560ae None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:07:58.477493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:07:58.478354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:58.478654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:58.478993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:58.486118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:58.509574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:07:58.512070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192fa85-4198-402b-a65a-e26941da63b6 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:07:58.544795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2646/5279] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:07:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:59.780063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:07:59.780714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:07:59.780714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:07:59.799926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] MFA Rules not processed for user `2fed8f5059c44a8fa1a9526e81fa73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:07:59.801164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:07:59.882167 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2634/5280] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:00.551746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:00.552344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:00.552712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:00.598710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] MFA Rules not processed for user `59fa2d8ade804f859d48ea6be1949e42`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:00.600606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:00.692198 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2647/5281] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:00.701536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:00.703301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:00.733202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967fe4a-0113-4033-ac05-c43b0f39bdc3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:00.740809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:00.742277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:00.742990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:00.743641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:00.754937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:00.757540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb1627-7788-437d-8323-a70ef8d3f36b service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:00.767963 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2635/5282] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:02.255969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:02.394572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12991d1-f08c-4e45-aa39-2418155980bc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:02.403276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:02.405084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:02.405525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:02.406250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] PATH_INFO: `/v3/users/5f5eda0097aa44bd99d72582428c3522` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:02.407851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5eda0097aa44bd99d72582428c3522)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:02.411165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:02.514072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5eda0097aa44bd99d72582428c3522'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:02.529983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5eda0097aa44bd99d72582428c3522'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:02.530930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5eda0097aa44bd99d72582428c3522'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:02.531709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5eda0097aa44bd99d72582428c3522'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:02.548947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5eda0097aa44bd99d72582428c3522'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:02.591328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2648/5283] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:02 2022] DELETE /identity/v3/users/5f5eda0097aa44bd99d72582428c3522 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:02.595895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:02.596586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:02.596586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:02.634617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:02.638407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:02.791931 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2636/5284] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:02.806415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:02.808436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:02.942484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2bde4-4b69-4154-8c17-8a46427f0f71 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:02.951680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:02.952995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:02.953794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:02.954320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:02.971388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:02.973751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:03.010281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2649/5285] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:03.277309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:03.283467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:03.332105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07ca18-5bfc-430f-8ab1-c6b31da36462 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:03.339240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:03.340392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:03.340874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:03.341319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] PATH_INFO: `/v3/users/59fa2d8ade804f859d48ea6be1949e42` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:03.342797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fa2d8ade804f859d48ea6be1949e42)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:03.344965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:03.417667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fa2d8ade804f859d48ea6be1949e42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.434427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fa2d8ade804f859d48ea6be1949e42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.435821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fa2d8ade804f859d48ea6be1949e42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.453689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fa2d8ade804f859d48ea6be1949e42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.468680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fa2d8ade804f859d48ea6be1949e42'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.476841 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2637/5286] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:03 2022] DELETE /identity/v3/users/59fa2d8ade804f859d48ea6be1949e42 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:03.565403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:03.566966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:03.615117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaa6aa-f9c9-47ac-99f0-8272f4d3e0ff service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:03.695145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:03.696181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:03.696608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:03.696992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] PATH_INFO: `/v3/projects/23bcc97db4fb439c963372cc4cb40d5e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:03.698489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bcc97db4fb439c963372cc4cb40d5e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:03.701347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:03.802915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bcc97db4fb439c963372cc4cb40d5e', 'request_id': 'req-36464adb-e906-4b0e-9942-c78bab7e5b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.821171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bcc97db4fb439c963372cc4cb40d5e', 'request_id': 'req-36464adb-e906-4b0e-9942-c78bab7e5b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.840716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bcc97db4fb439c963372cc4cb40d5e', 'request_id': 'req-36464adb-e906-4b0e-9942-c78bab7e5b2b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.866920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] The token cache is being invalidate because project 23bcc97db4fb439c963372cc4cb40d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:03.867556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.872002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:03.881221 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2650/5287] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:03 2022] DELETE /identity/v3/projects/23bcc97db4fb439c963372cc4cb40d5e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:03.885955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:03.889189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:03.915722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68053203-bff7-4ce2-b9e6-c259d54bc1d8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.020495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.022405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:04.026738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.029309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.029823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.030427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] PATH_INFO: `/v3/users/53ac8e2a47b24a99b34d60e561c321e5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.035212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ac8e2a47b24a99b34d60e561c321e5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.039151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.061968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36464adb-e906-4b0e-9942-c78bab7e5b2b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.081068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.083952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.084266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.084671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] PATH_INFO: `/v3/projects/381ce062df854c77b16cc5cff07c462e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.087778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=381ce062df854c77b16cc5cff07c462e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.089760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.159871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ac8e2a47b24a99b34d60e561c321e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.182097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ac8e2a47b24a99b34d60e561c321e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.183185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ac8e2a47b24a99b34d60e561c321e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.195064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ac8e2a47b24a99b34d60e561c321e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.204550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381ce062df854c77b16cc5cff07c462e', 'request_id': 'req-bb457b19-99a6-47b2-ad3b-6a0395a66dab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.206630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f6965872-4c71-4958-86e0-3bb6bbd80a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ac8e2a47b24a99b34d60e561c321e5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.214171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381ce062df854c77b16cc5cff07c462e', 'request_id': 'req-bb457b19-99a6-47b2-ad3b-6a0395a66dab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.215372 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2638/5288] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:03 2022] DELETE /identity/v3/users/53ac8e2a47b24a99b34d60e561c321e5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:08:04.223690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381ce062df854c77b16cc5cff07c462e', 'request_id': 'req-bb457b19-99a6-47b2-ad3b-6a0395a66dab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.235827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] The token cache is being invalidate because project 381ce062df854c77b16cc5cff07c462e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:04.236270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.237228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bb457b19-99a6-47b2-ad3b-6a0395a66dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:04.239158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2651/5289] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:04 2022] DELETE /identity/v3/projects/381ce062df854c77b16cc5cff07c462e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:04.244763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.245294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.246549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.270290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:04.273314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:04.355964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.356564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.356977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.360992 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2639/5290] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:04.382724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:04.385112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:04.404128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.414844 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2652/5291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:04.419816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48211563-610f-4874-8e32-a2f4c76e97bb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.426954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.428576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.429109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.429651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.430778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:04.431491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.435701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.472709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.483706 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2640/5292] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:04.490472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb26b5-1d8c-4aea-8be7-1156d43c7ef2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.496341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.497582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.497952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.498396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.499558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.501606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.557076 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2653/5293] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:04 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:04.557278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.572310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d4dc-8628-42fc-890c-fecc2f4fff2a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.691251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.692431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.692822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.693612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.694298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.696402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.724412 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2641/5294] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:04 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:04.725869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.748071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca6f14-a710-4d13-ab0a-3140d48563c7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.755158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.757636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.758163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.758643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.760107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.762269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.784760 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2654/5295] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:04.790430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.813251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7888-0973-44bd-95c3-408380c3f50b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.821071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.822607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.822931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.823169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.824009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.825638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7b932-94d9-4166-a79a-daba303664c7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.840508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2642/5296] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:08:04.842454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.854656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98f0bb-7652-4031-973c-e09c98f00400 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:04.862434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:04.864425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.865752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.866237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] PATH_INFO: `/v3/projects/26c2ad88757e44dca408afd7d040112f/users/b4b018df5174476da8718bc8cf5ea96c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.885128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c2ad88757e44dca408afd7d040112f, user_id=b4b018df5174476da8718bc8cf5ea96c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:04.887796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:04.902863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2655/5297] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:04 2022] PUT /identity/v3/projects/26c2ad88757e44dca408afd7d040112f/users/b4b018df5174476da8718bc8cf5ea96c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:04.909118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:04.910075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:04.910541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:04.935072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:04.936982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:04.958413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:04.960745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.033822 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2643/5298] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:08:05.056550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.058594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.074221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351edece-22d3-4969-adcb-1789a38b592a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.080226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.081439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.081728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.082006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] PATH_INFO: `/v3/projects/da46e21128e84fe4ba4983461606723a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.083275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da46e21128e84fe4ba4983461606723a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.085791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.150851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da46e21128e84fe4ba4983461606723a', 'request_id': 'req-9095b332-7422-4b33-96bb-16ceec234465'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:05.151270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53be57-5cea-4eb9-8d63-af5d0093ec4e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.164365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da46e21128e84fe4ba4983461606723a', 'request_id': 'req-9095b332-7422-4b33-96bb-16ceec234465'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:05.176521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da46e21128e84fe4ba4983461606723a', 'request_id': 'req-9095b332-7422-4b33-96bb-16ceec234465'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:05.195866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] The token cache is being invalidate because project da46e21128e84fe4ba4983461606723a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:05.196767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:05.197531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9095b332-7422-4b33-96bb-16ceec234465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:05.199700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2656/5299] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:04 2022] DELETE /identity/v3/projects/da46e21128e84fe4ba4983461606723a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:05.204680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabc38-885d-4ce8-8ce1-52b8d6baf686 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.205048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabc38-885d-4ce8-8ce1-52b8d6baf686 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.205399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabc38-885d-4ce8-8ce1-52b8d6baf686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.218444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.219197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.219553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.220065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.222805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.228619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-77eabc38-885d-4ce8-8ce1-52b8d6baf686 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:05.229929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77eabc38-885d-4ce8-8ce1-52b8d6baf686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.300153 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2657/5300] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:08:05.309103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.309397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.309680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.312060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.314217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.324817 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2644/5301] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:05.328515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:05.329768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.339674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2658/5302] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:05.343899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.354245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346871-6447-444e-a968-ebeb08ffe69c service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.359828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.360520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.360807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.361109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.361872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:05.362185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.363857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.380714 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2645/5303] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:08:05.381897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.391475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fcb51-d0ff-499c-aaf3-eaa28859b9ab None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.397087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.398006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.398251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.398549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.401017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.402995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.434037 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2659/5304] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:05.435197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.446350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db5675-a696-4a87-89e4-1fe5ae162000 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.503324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.503992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.504276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.504583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.505291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.507191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.529907 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2646/5305] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:05.531162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.541898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247bd09-d085-4fed-a31f-95b9ee4931d9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.547009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.547705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.547978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.548253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.549088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.550863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.562347 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2660/5306] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:05.566378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.577111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ac93-f155-4b6e-bc96-74090031d39b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.582425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.583060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.583346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.584158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.584944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.586529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6caea5-758c-461f-9fd7-2faa63630cb3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.601181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2647/5307] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:05.603206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.614757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafa0d-ebba-4c00-b8f3-f80dd7dc0777 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.619674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.621190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.621549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.621898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] PATH_INFO: `/v3/projects/d42f34e8f988415fa2def86d0607270d/users/f7219096bcfe4e079894902a2c4ccd81/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.638937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42f34e8f988415fa2def86d0607270d, user_id=f7219096bcfe4e079894902a2c4ccd81, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.642038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.656845 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2661/5308] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:05 2022] PUT /identity/v3/projects/d42f34e8f988415fa2def86d0607270d/users/f7219096bcfe4e079894902a2c4ccd81/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:05.667075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.667433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.667687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.695430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] MFA Rules not processed for user `f7219096bcfe4e079894902a2c4ccd81`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:05.696706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:05.761849 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2648/5309] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:05.766287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.854257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e05a-5b87-4306-b4bf-c3250e13e69c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:05.862946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:05.862946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:05.862946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:05.862946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:05.863446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:05.865214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:05.897147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2662/5310] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:05.900969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:05.913294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91085f31-20eb-4d54-b1c2-1f7f9e1078c4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.016791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.018809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.019408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.020031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.021415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.024199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.062746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2649/5311] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:05 2022] POST /identity/v3/users => generated 309 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:08:06.066677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.084959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9374da-4299-4ab1-9436-05b4a5d3f209 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.099014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.099719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.100009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.100282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.101054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.102692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.120169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2663/5312] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:06.124208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.141563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a0b2-7feb-4f14-bc21-08e81dbc42f1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.159031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.160120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.160511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.160759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] PATH_INFO: `/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2/users/065d67cfb79c41a38bca568d44e02d88/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.189081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b272e1d8024dbc9b630c8b5ae4fde2, user_id=065d67cfb79c41a38bca568d44e02d88, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.194631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.232938 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2650/5313] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:06 2022] PUT /identity/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2/users/065d67cfb79c41a38bca568d44e02d88/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:06.236876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.261087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab823-5ea5-483a-bc0b-320cc4b42738 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.359260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.359934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.360225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.360534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.361248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.362841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cb4ba-d9ec-430c-8f64-5db6ba2521cf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.378555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2664/5314] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:08:06.383724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.397510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c82fe-c1fe-41ac-bfe1-55d3dfcd7cd6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.402338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.403234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.403695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.403981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] PATH_INFO: `/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2/users/065d67cfb79c41a38bca568d44e02d88/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.406006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b272e1d8024dbc9b630c8b5ae4fde2, user_id=065d67cfb79c41a38bca568d44e02d88, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.408844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.424545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2651/5315] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:06 2022] PUT /identity/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2/users/065d67cfb79c41a38bca568d44e02d88/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:06.433136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d178360-3cde-45e9-8ad8-b315f26b9c00 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.433431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d178360-3cde-45e9-8ad8-b315f26b9c00 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.433887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d178360-3cde-45e9-8ad8-b315f26b9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.491322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1d178360-3cde-45e9-8ad8-b315f26b9c00 None None] MFA Rules not processed for user `065d67cfb79c41a38bca568d44e02d88`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:06.492732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d178360-3cde-45e9-8ad8-b315f26b9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:06.579186 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2665/5316] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:06.590432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.592671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:06.686414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361d57-7cc7-4964-8478-076eec325645 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:06.692560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:06.693773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.694150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.694521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.767248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:06.772982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:06.796015 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2652/5317] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:06.808656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:06.808656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:06.809213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:06.837577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] MFA Rules not processed for user `b4b018df5174476da8718bc8cf5ea96c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:06.839265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:06.960970 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2666/5318] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:06.973010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:06.976334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:07.086435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428731b-d5be-42de-94b8-86f3107ea9aa service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:07.093772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:07.094756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:07.095386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:07.095869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:07.108240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:07.110574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09d2e7-b0e2-4651-912b-37e4590e93d6 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:07.121027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2653/5319] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:08:07.473628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:07.475474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:07.499701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc980-4b27-4cd5-9947-e4db4a16b65e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:07.512120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:07.513367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:07.514274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:07.514274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:07.526132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:07.528173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:07.540604 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2667/5320] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:08.452936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7b86-eed7-485d-952c-e67aee180016 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:08.453805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7b86-eed7-485d-952c-e67aee180016 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:08.454243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7b86-eed7-485d-952c-e67aee180016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:08.479960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5b9b7b86-eed7-485d-952c-e67aee180016 None None] MFA Rules not processed for user `b4b018df5174476da8718bc8cf5ea96c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:08.481494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5b9b7b86-eed7-485d-952c-e67aee180016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:08.490946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2654/5321] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:08.886213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:08.887698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:08.913795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8209ed-d430-4b3d-ba37-6aa859816602 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:08.917973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:08.918775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:08.919073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:08.919498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:08.921757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:08.948393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:08.949732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:08.963933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2668/5322] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:14.778067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:14.779091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:14.779544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:14.807365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:14.809482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:14.903872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2655/5323] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:14.978897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:14.981330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:15.142780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fda60-9d07-4978-ace4-28ca2ee34cbf service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:15.153748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:15.154731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:15.155363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:15.155883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:15.168349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:15.170530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c86d-7d46-403f-87b1-c947dd68e576 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:15.213000 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2669/5324] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:15.997641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:16.162091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe27bd-e7cf-4c86-acdb-9c29a64e33b4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:16.172677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:16.173822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:16.174277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:16.174723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] PATH_INFO: `/v3/users/f7219096bcfe4e079894902a2c4ccd81` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:16.176107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7219096bcfe4e079894902a2c4ccd81)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:16.181894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:16.250322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7219096bcfe4e079894902a2c4ccd81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:16.266974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7219096bcfe4e079894902a2c4ccd81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:16.267947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7219096bcfe4e079894902a2c4ccd81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:16.280630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7219096bcfe4e079894902a2c4ccd81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:16.294382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7219096bcfe4e079894902a2c4ccd81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:16.315885 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2656/5325] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:15 2022] DELETE /identity/v3/users/f7219096bcfe4e079894902a2c4ccd81 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:16.318329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:16.318906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:16.319015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:16.343117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:16.344836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:16.467313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2670/5326] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:08:16.492148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:16.493839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:16.657151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2805-3139-4a0d-a35a-4f5f4ccafa2a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:16.662251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:16.663269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:16.663609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:16.663898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:16.676963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:16.678732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:16.691276 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2657/5327] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:16.968395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:16.970334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:16.996692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ffd53-556a-4c01-9a30-f163ae771240 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:17.003130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:17.004391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:17.004702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:17.005874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] PATH_INFO: `/v3/projects/d42f34e8f988415fa2def86d0607270d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:17.007920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42f34e8f988415fa2def86d0607270d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:17.010017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:17.087212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42f34e8f988415fa2def86d0607270d', 'request_id': 'req-af238802-1232-4c2c-8db0-e410b72242b8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.097802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42f34e8f988415fa2def86d0607270d', 'request_id': 'req-af238802-1232-4c2c-8db0-e410b72242b8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.110604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42f34e8f988415fa2def86d0607270d', 'request_id': 'req-af238802-1232-4c2c-8db0-e410b72242b8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.124875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] The token cache is being invalidate because project d42f34e8f988415fa2def86d0607270d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:17.125649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.126722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.129100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2671/5328] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:16 2022] DELETE /identity/v3/projects/d42f34e8f988415fa2def86d0607270d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:17.133925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:17.162292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfaac-a5fa-4a01-aa5c-cb01c4ececf6 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:17.321170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:17.322040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:17.322331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:17.324814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] PATH_INFO: `/v3/users/065d67cfb79c41a38bca568d44e02d88` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:17.329746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065d67cfb79c41a38bca568d44e02d88)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:17.332273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:17.499195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065d67cfb79c41a38bca568d44e02d88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.532114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065d67cfb79c41a38bca568d44e02d88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.533542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065d67cfb79c41a38bca568d44e02d88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.549519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065d67cfb79c41a38bca568d44e02d88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.567247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fe809ba-1f88-438e-bede-b4b5a13b8434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065d67cfb79c41a38bca568d44e02d88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:17.591066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2658/5329] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:17 2022] DELETE /identity/v3/users/065d67cfb79c41a38bca568d44e02d88 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:17.904152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:17.907555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:17.965160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af238802-1232-4c2c-8db0-e410b72242b8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:18.057614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:18.058927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.059426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.059911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] PATH_INFO: `/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.062113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b272e1d8024dbc9b630c8b5ae4fde2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:18.065456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:18.163448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b272e1d8024dbc9b630c8b5ae4fde2', 'request_id': 'req-f5fc313a-d0a9-475f-a31a-1555270292e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:18.191379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b272e1d8024dbc9b630c8b5ae4fde2', 'request_id': 'req-f5fc313a-d0a9-475f-a31a-1555270292e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:18.214403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b272e1d8024dbc9b630c8b5ae4fde2', 'request_id': 'req-f5fc313a-d0a9-475f-a31a-1555270292e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:18.245305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] The token cache is being invalidate because project 56b272e1d8024dbc9b630c8b5ae4fde2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:18.245305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:18.245305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f5fc313a-d0a9-475f-a31a-1555270292e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:18.251412 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2672/5330] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:17 2022] DELETE /identity/v3/projects/56b272e1d8024dbc9b630c8b5ae4fde2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:18.252971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.253508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.254572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.300631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:18.305818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:18.440887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2659/5331] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:18.448399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.448961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.449344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.492312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:18.495908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:18.507692 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2673/5332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:18.511899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:18.527439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da986c9-8985-4e2b-beba-69a3d1bc9dbf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:18.562542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:18.566808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.569347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.569814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.572129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:18.572650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:18.578013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:18.615316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:18.620576 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2660/5333] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:18.634831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54494e-0bce-4692-8703-4a82a3ce9cd2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:18.651462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:18.652306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.653065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.653469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.654276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:18.658577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:18.722048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2674/5334] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:18 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:18.723277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:18.739003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571f9e-5081-4b9b-a421-109ebeb8b522 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:18.862398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:18.863174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.863554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.863898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.865041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:18.867087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:18.897186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2661/5335] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:18 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:18.898408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:18.927853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe533b-e253-4a8a-804d-1a36ff47de7c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:18.954225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:18.955673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:18.956203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:18.956736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:18.958909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:18.962090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:18.988529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2675/5336] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:18.989713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.004255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7e8b-601b-450f-8b51-e9ab89fd4208 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.013102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.014400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.014952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.015798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.017209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.021164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11275a19-8b59-4059-bae2-c0977eb8759b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.054392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.057345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2662/5337] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:19.080215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2ba1-f896-4913-bfc4-c67b9429352c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.087465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.089900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.090421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.090720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] PATH_INFO: `/v3/projects/fad24d22ed244e45ae7c215bc2334bae/users/880f012fb3954de0b757b2cd6a8ff8ee/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.143171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad24d22ed244e45ae7c215bc2334bae, user_id=880f012fb3954de0b757b2cd6a8ff8ee, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.147887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.190550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2676/5338] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:19 2022] PUT /identity/v3/projects/fad24d22ed244e45ae7c215bc2334bae/users/880f012fb3954de0b757b2cd6a8ff8ee/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:08:19.205061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.206240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.206727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.264496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] MFA Rules not processed for user `880f012fb3954de0b757b2cd6a8ff8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:19.266194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:19.381283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.387398 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2663/5339] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:19.536109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98f0d-92de-4230-8daa-8656591af175 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.541692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.542388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.542670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.542951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.543649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.545853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.585411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2677/5340] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:19 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:19.589480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.620780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7508cdf-b9dc-468f-9fb6-e25d2e9b38b4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.759674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.760904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.761288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.761622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.762489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.764744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.804954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2664/5341] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:19 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:08:19.808562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.833896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30131b0-d1c5-4173-bd75-431a84326141 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.843319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.844364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.845248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.845742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.847140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.849873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.870811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2678/5342] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:19.875167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:19.892980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf28fd6-891f-4d9c-b3d3-93511a172f1e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:19.921158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:19.922835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:19.923545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:19.923923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] PATH_INFO: `/v3/projects/ad819fff1305481d99551c3c226d9427/users/e451315b01ce4b468ca045ce9815c7c5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:19.943982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad819fff1305481d99551c3c226d9427, user_id=e451315b01ce4b468ca045ce9815c7c5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:19.948283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:19.997797 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2665/5343] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:19 2022] PUT /identity/v3/projects/ad819fff1305481d99551c3c226d9427/users/e451315b01ce4b468ca045ce9815c7c5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:08:20.002060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:20.023002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f57a3-d6c0-457b-bf6f-06a4e09b1531 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:20.160144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:20.162104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:20.162498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:20.162918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:20.164415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:20.166760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb4cf-5edf-4809-bc50-7df11880797a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:20.183309 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2679/5344] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:20.187354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:20.204236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e310a-a709-44ca-a4b5-56a4d0466260 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:20.213836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:20.215125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:20.215345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:20.215601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] PATH_INFO: `/v3/projects/ad819fff1305481d99551c3c226d9427/users/e451315b01ce4b468ca045ce9815c7c5/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:20.217697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad819fff1305481d99551c3c226d9427, user_id=e451315b01ce4b468ca045ce9815c7c5, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:20.221418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:20.242142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2666/5345] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:20 2022] PUT /identity/v3/projects/ad819fff1305481d99551c3c226d9427/users/e451315b01ce4b468ca045ce9815c7c5/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:08:20.246459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:20.246794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:20.247036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:20.290777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] MFA Rules not processed for user `e451315b01ce4b468ca045ce9815c7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:20.292008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:20.424961 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2680/5346] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:20.433602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:20.438241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:20.559811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cad7f0-9b4f-4a18-bb9d-5042ede66005 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:20.565020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:20.566548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:20.567044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:20.567561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:20.578450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:20.580250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:20.611794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2667/5347] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:29.504232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:29.525665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0123313-f636-4be0-9518-937c09c5f6af None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:29.538765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e451315b01ce4b468ca045ce9815c7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad819fff1305481d99551c3c226d9427', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:29.539944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:29.542506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:29.544005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:29.547760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:29.547906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:29.553128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:29.583353 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2681/5348] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:29.584208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:29.609772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b706-5527-4988-9d60-71d6cfc60497 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:29.637186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e451315b01ce4b468ca045ce9815c7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad819fff1305481d99551c3c226d9427', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:29.638040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:29.638482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:29.638770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:29.639476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:29.641476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:29.697660 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2668/5349] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:29 2022] POST /identity/v3/projects => generated 348 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:08:29.702079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:29.724162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148360c3-94b3-44fd-a355-caef7a0c5b4f tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:29.915196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e451315b01ce4b468ca045ce9815c7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad819fff1305481d99551c3c226d9427', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:29.916413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:29.917195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:29.917586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:29.921967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:29.922467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:29.929864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:29.972019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2682/5350] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:30.661929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:30.681188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be5f1-9d53-4229-81d9-a77f1b3551c9 tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:30.691798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e451315b01ce4b468ca045ce9815c7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad819fff1305481d99551c3c226d9427', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:30.693923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:30.694216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:30.694561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] PATH_INFO: `/v3/projects/78a27337bd9b4b8e9d56ee63333daea1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:30.696937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78a27337bd9b4b8e9d56ee63333daea1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:30.698960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:30.759818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:30.766474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:30.810050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a27337bd9b4b8e9d56ee63333daea1', 'request_id': 'req-902d7974-e4b0-48ac-ade0-571fc4b2d62d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:30.822174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a27337bd9b4b8e9d56ee63333daea1', 'request_id': 'req-902d7974-e4b0-48ac-ade0-571fc4b2d62d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:30.835156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a27337bd9b4b8e9d56ee63333daea1', 'request_id': 'req-902d7974-e4b0-48ac-ade0-571fc4b2d62d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:30.857319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] The token cache is being invalidate because project 78a27337bd9b4b8e9d56ee63333daea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:30.858070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:30.858958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:30.863176 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2669/5351] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:30 2022] DELETE /identity/v3/projects/78a27337bd9b4b8e9d56ee63333daea1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:30.875943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:30.878663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:30.915532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a162db1-c6aa-4fbb-bce0-58f776120b6d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:30.995428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d7974-e4b0-48ac-ade0-571fc4b2d62d tempest-RoutersIpV6AdminTest-690975595 tempest-RoutersIpV6AdminTest-690975595-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:31.007310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:31.008511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:31.009206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:31.009889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:31.013240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:31.078972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:31.079802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:31.081161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:31.081359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] PATH_INFO: `/v3/users/b4b018df5174476da8718bc8cf5ea96c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:31.085376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b018df5174476da8718bc8cf5ea96c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:31.089102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:31.162254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:31.164038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:31.190977 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2670/5352] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:08:31.198152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b018df5174476da8718bc8cf5ea96c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.213808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b018df5174476da8718bc8cf5ea96c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.214796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b018df5174476da8718bc8cf5ea96c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.215604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b018df5174476da8718bc8cf5ea96c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.226637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-58e9df6e-62ee-45b0-b879-56e19825f0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b018df5174476da8718bc8cf5ea96c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.258712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2683/5353] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:30 2022] DELETE /identity/v3/users/b4b018df5174476da8718bc8cf5ea96c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:31.614119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:31.617119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:31.659665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367220b7-d9a3-4dce-b57d-5e338cdec860 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:31.800798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:31.802407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:31.802791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:31.803176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] PATH_INFO: `/v3/projects/26c2ad88757e44dca408afd7d040112f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:31.805451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c2ad88757e44dca408afd7d040112f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:31.807656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:31.889159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c2ad88757e44dca408afd7d040112f', 'request_id': 'req-2b5caf94-22be-4d60-85da-b4cc714e1422'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.900707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c2ad88757e44dca408afd7d040112f', 'request_id': 'req-2b5caf94-22be-4d60-85da-b4cc714e1422'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.908884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c2ad88757e44dca408afd7d040112f', 'request_id': 'req-2b5caf94-22be-4d60-85da-b4cc714e1422'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.929686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] The token cache is being invalidate because project 26c2ad88757e44dca408afd7d040112f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:31.930847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.931644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2b5caf94-22be-4d60-85da-b4cc714e1422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:31.938978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2671/5354] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:31 2022] DELETE /identity/v3/projects/26c2ad88757e44dca408afd7d040112f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:31.941347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:31.941979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:31.943031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:31.978522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:31.981515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:32.076868 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2684/5355] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:32.084877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.085839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.085839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.115228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:32.116567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:32.129671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2672/5356] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:08:32.131294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.154601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa8aaa-2178-4e7f-aee8-18711be4743d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.160381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.161345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.161731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.162105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.163759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:32.163759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.165908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.202224 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2685/5357] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:32.202639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.218637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f516426-c8b2-4334-9fb0-307d83b37a08 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.238746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.242588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.243381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.244353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.246615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.250981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.322820 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2673/5358] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:32 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:08:32.323282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.339496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914846-bfc0-4021-95cf-a65cd63dab11 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.477957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.478767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.479067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.479351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.480054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.482081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.527437 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2686/5359] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:32 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:32.538246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.557488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7888c2-bd27-49bc-a3a8-6545f3c0a436 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.573612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.574703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.575071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.577510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.579603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.587413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.623722 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2674/5360] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:32.627840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.640884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec507-bf24-47e1-a343-e5a5dd732a11 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.647345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.648045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.648336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.648793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.649388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.651027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036b67-694f-4935-9caa-50ee0775fd35 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.668207 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2687/5361] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:08:32.670292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.685103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a00184-ad7f-44e4-923a-e345d5186259 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:32.692882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:32.694304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.694872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.695329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] PATH_INFO: `/v3/projects/bcc988d584ef47dd99506305e1c7d45a/users/20f75a3bb7e8417791babaae0fda1c39/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.718875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc988d584ef47dd99506305e1c7d45a, user_id=20f75a3bb7e8417791babaae0fda1c39, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:32.729575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:32.765861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2675/5362] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:32 2022] PUT /identity/v3/projects/bcc988d584ef47dd99506305e1c7d45a/users/20f75a3bb7e8417791babaae0fda1c39/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:32.767781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11610bc-3a11-4758-883f-427bbde9dc12 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:32.768423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11610bc-3a11-4758-883f-427bbde9dc12 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:32.769571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11610bc-3a11-4758-883f-427bbde9dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:32.791963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c11610bc-3a11-4758-883f-427bbde9dc12 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:32.793632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c11610bc-3a11-4758-883f-427bbde9dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:32.915676 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2688/5363] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:32.927986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:32.931223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:33.054084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eb554-a6a8-41eb-a011-95c53e2fbaa1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:33.059802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:33.060504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:33.060888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:33.061173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:33.081075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:33.081327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2565f8-b9bf-413e-8ce4-b5a7749d08f4 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:33.117129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2676/5364] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:42.714011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:42.714588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:42.714588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:42.744351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] MFA Rules not processed for user `20f75a3bb7e8417791babaae0fda1c39`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:42.745691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:42.818262 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2689/5365] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:42.828403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab140-7854-4b46-b049-b8c2f0edbe69 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:42.829419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab140-7854-4b46-b049-b8c2f0edbe69 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:42.830066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ab140-7854-4b46-b049-b8c2f0edbe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:42.847692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0c3ab140-7854-4b46-b049-b8c2f0edbe69 None None] MFA Rules not processed for user `20f75a3bb7e8417791babaae0fda1c39`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:42.849025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0c3ab140-7854-4b46-b049-b8c2f0edbe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:42.856260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2677/5366] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:42.868594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:42.870419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:42.993757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5f07-9797-41f0-a584-b299d1e3b90b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:43.020113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:43.022673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.022972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.023250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.036478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:43.039652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:43.053635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2690/5367] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:43.086646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd149c-246d-4fbc-a5ec-92314b0aa0d2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.087150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd149c-246d-4fbc-a5ec-92314b0aa0d2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.087619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd149c-246d-4fbc-a5ec-92314b0aa0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.117734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-89cd149c-246d-4fbc-a5ec-92314b0aa0d2 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:43.119231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-89cd149c-246d-4fbc-a5ec-92314b0aa0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:43.209335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2678/5368] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:43.223356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:43.223356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:43.352156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46174-c3f6-45fc-84ed-a2a4c419dc4f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:43.359535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:43.360412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.360812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.361238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.372621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:43.374483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ebe8c-ec17-4697-a329-7042c4c7714e service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:43.387873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2691/5369] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:43.741837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.742191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.742600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.744892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2679/5370] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:08:43.752363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.752880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.753011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.786232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:43.788556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:43.811912 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2692/5371] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:43.829426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:43.831584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:43.857987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9256d-8b58-452e-ab45-61c5d52df9bb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:43.864169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:43.866716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:43.868521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:43.869237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:43.881654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:43.884415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:43.909924 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2680/5372] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:08:46.217469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:46.219674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:46.241940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376a531-170b-4e60-b954-d2432ba9601b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:46.249077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:46.250722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:46.251097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:46.251378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] PATH_INFO: `/v3/users/d12e43a0a2994654a400b3a2bed83ecf` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:46.265022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12e43a0a2994654a400b3a2bed83ecf)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:46.270584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:46.404411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12e43a0a2994654a400b3a2bed83ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:46.433210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12e43a0a2994654a400b3a2bed83ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:46.434378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12e43a0a2994654a400b3a2bed83ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:46.435475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12e43a0a2994654a400b3a2bed83ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:46.462418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-51186a90-fbc3-48dd-8ce9-84a37d2104dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12e43a0a2994654a400b3a2bed83ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:46.510333 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2693/5373] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:08:46 2022] DELETE /identity/v3/users/d12e43a0a2994654a400b3a2bed83ecf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:46.862190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:46.888656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935e09d-455e-439c-b470-83fb07a18422 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.037996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.039670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.040085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.041435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] PATH_INFO: `/v3/projects/f54b2160309b4d76bd7a944454903520` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.043644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54b2160309b4d76bd7a944454903520)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.047441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.190232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54b2160309b4d76bd7a944454903520', 'request_id': 'req-10287606-a30a-4c85-9d04-110a353dcc17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:47.203488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54b2160309b4d76bd7a944454903520', 'request_id': 'req-10287606-a30a-4c85-9d04-110a353dcc17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:47.230265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54b2160309b4d76bd7a944454903520', 'request_id': 'req-10287606-a30a-4c85-9d04-110a353dcc17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:47.254949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] The token cache is being invalidate because project f54b2160309b4d76bd7a944454903520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:08:47.255662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:47.256801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-10287606-a30a-4c85-9d04-110a353dcc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:08:47.258766 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2681/5374] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:08:46 2022] DELETE /identity/v3/projects/f54b2160309b4d76bd7a944454903520 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:47.264861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.265765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.266363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.295631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:47.297007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:47.398848 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2694/5375] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:47.407051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.407452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.407649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.442561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:47.444244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:47.459258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2682/5376] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:08:47.464394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.481894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb97840-b612-460b-b2f4-5fae115b37ee None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.487291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.488404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.489135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.490024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.491038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:08:47.491650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.495349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.517545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2695/5377] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:08:47.518993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.538166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8cd43-ba49-49b5-b82e-c40c208067d6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.546648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.547621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.548267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.548899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.550546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.554227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.614009 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2683/5378] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:08:47 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:47.618269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.631446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b3f8a-ac7f-4580-b574-cba13d7a1add admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.761230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.762297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.762595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.763401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.764357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.767693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.804054 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2696/5379] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:08:47 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:08:47.812059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.827639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ebb9-31ce-40de-8af2-7dd61400ed7c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.838007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.839134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.839691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.840171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.841147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.843147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.858912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2684/5380] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:08:47.863025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.878004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555326af-6ff8-45be-b3bc-87a1e3893a59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.886217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.887077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.887738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.887738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.889410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.891529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91e8f2-49c4-4232-837f-4e0ebb776c12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.908592 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2697/5381] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:08:47.911852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:47.925842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd07fde-979f-409c-ad4e-91c20a239e5c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:47.931808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:47.933452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:47.933790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:47.934136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] PATH_INFO: `/v3/projects/2442029388874d1a9e68e31f444d718a/users/2aebce92aa0b4b9b97a930bfb53fc981/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:47.962653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2442029388874d1a9e68e31f444d718a, user_id=2aebce92aa0b4b9b97a930bfb53fc981, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:47.969467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:47.997170 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2685/5382] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:08:47 2022] PUT /identity/v3/projects/2442029388874d1a9e68e31f444d718a/users/2aebce92aa0b4b9b97a930bfb53fc981/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:08:48.018282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:48.019043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:48.019533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:48.074941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] MFA Rules not processed for user `2aebce92aa0b4b9b97a930bfb53fc981`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:08:48.076165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:48.214532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2698/5383] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:08:48.231333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:08:48.233353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:08:48.398014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2199dd-25c1-410b-aece-a5a0c9f08b85 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:08:48.406903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:08:48.407815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:08:48.408111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:08:48.414557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:08:48.446381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:08:48.451938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5a225-c4c4-4485-8712-9f6fdacef81b service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:08:48.479191 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2686/5384] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:08:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:00.110003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:00.181167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2723b6-2284-4de1-b792-c477853271a4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:00.187252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:00.188576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:00.188933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:00.189286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] PATH_INFO: `/v3/users/2aebce92aa0b4b9b97a930bfb53fc981` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:00.190594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aebce92aa0b4b9b97a930bfb53fc981)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:00.193396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:00.270110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aebce92aa0b4b9b97a930bfb53fc981'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.281062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aebce92aa0b4b9b97a930bfb53fc981'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.282429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aebce92aa0b4b9b97a930bfb53fc981'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.283887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aebce92aa0b4b9b97a930bfb53fc981'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.292926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aebce92aa0b4b9b97a930bfb53fc981'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.320683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2699/5385] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:00 2022] DELETE /identity/v3/users/2aebce92aa0b4b9b97a930bfb53fc981 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:00.324845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:00.325386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:00.325741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:00.343619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:00.344915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:00.410931 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2687/5386] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:00.429719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:00.431951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:00.529345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df841a45-4a74-4878-942b-c25c932556f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:00.533588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:00.534244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:00.535540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:00.535826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:00.547175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:00.548648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae5bd-422c-4bf2-8352-7eaa04a215c2 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:00.570090 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2700/5387] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:00.856069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:00.857728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:00.873709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227ceb1-13e6-4fb7-a65a-3a873a636ac3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:00.878518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:00.879384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:00.879676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:00.880022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] PATH_INFO: `/v3/projects/2442029388874d1a9e68e31f444d718a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:00.881139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2442029388874d1a9e68e31f444d718a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:00.883093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:00.938511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2442029388874d1a9e68e31f444d718a', 'request_id': 'req-4532857c-08ca-475e-ab07-8c1042990434'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.945077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2442029388874d1a9e68e31f444d718a', 'request_id': 'req-4532857c-08ca-475e-ab07-8c1042990434'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.950787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2442029388874d1a9e68e31f444d718a', 'request_id': 'req-4532857c-08ca-475e-ab07-8c1042990434'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.966706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] The token cache is being invalidate because project 2442029388874d1a9e68e31f444d718a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:00.967079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.967829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4532857c-08ca-475e-ab07-8c1042990434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:00.973399 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2688/5388] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:00 2022] DELETE /identity/v3/projects/2442029388874d1a9e68e31f444d718a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:00.975150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:00.975518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:00.975878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:00.995467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:00.997779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:01.067428 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2701/5389] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:09:01.075343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.075772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.076084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.095102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:01.096392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:01.105148 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2689/5390] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:01.109452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.119247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9e377-d905-40bb-b296-4cee7ebb1c1b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.126189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.126189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.126189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.126189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.126750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:09:01.126750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.127940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.140519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2702/5391] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:09:01.145354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.154538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea22973-a2fe-40a7-a360-29d67679a9b5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.159353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.160038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.160326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.160642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.161350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.163356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.189734 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2690/5392] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:01 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:01.194193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.204630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6727901-d3db-407d-a7fa-ec8005f8d409 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.262196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.262878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.263169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.263455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.264147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.266100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.286749 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2703/5393] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:01 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:01.290867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.302143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb85b21-f7cb-4757-9425-d0e5d49a30bf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.311725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.311725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.311725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.311725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.312082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.312082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.325011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2691/5394] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:01.328752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.339900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891af42-14ad-4aa7-b8ec-38d70c0b5dfe admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.344547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.345256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.345544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.345821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.346647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.348394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe83fc-b49d-405b-b1d1-bdfb4a6a6bae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.358736 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2704/5395] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:09:01.365157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.377858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb3d4-1bb8-45ff-bb1b-169a1a6f3a33 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.383435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.384931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.384931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.385344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] PATH_INFO: `/v3/projects/3e69485d6b5e4cd6ba0ffbb3b210952b/users/912051f37cf84f30942319efc614fc12/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.402724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e69485d6b5e4cd6ba0ffbb3b210952b, user_id=912051f37cf84f30942319efc614fc12, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.405626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.420227 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2692/5396] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:01 2022] PUT /identity/v3/projects/3e69485d6b5e4cd6ba0ffbb3b210952b/users/912051f37cf84f30942319efc614fc12/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:09:01.425863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.426276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.426660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.459451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:01.460907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:01.534550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2705/5397] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:09:01.544422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:01.546412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:01.617896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22622-5ad9-4146-8e6a-8318fd902716 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:01.622295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:01.623090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:01.623380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:01.623760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:01.634812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:01.636396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:01.646757 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2693/5398] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:09:06.252798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:06.255227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:06.274697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36208f46-b9d3-4380-9c3b-1c0030a83ca3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:06.282327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:06.283320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:06.283611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:06.283875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] PATH_INFO: `/v3/users/ac8027ca8086469999ae8a73639fca90` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:06.286331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8027ca8086469999ae8a73639fca90)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:06.292926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:06.382217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8027ca8086469999ae8a73639fca90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:06.397897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8027ca8086469999ae8a73639fca90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:06.398652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8027ca8086469999ae8a73639fca90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:06.399317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8027ca8086469999ae8a73639fca90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:06.411917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-128dd9af-0e62-41b4-9ac7-c96f6597293a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8027ca8086469999ae8a73639fca90'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:06.433583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2706/5399] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:06 2022] DELETE /identity/v3/users/ac8027ca8086469999ae8a73639fca90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:07.081215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:07.095491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca455a-aec4-4a87-a37c-a76ad6d69105 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:07.169579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:07.170678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.170975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.171259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] PATH_INFO: `/v3/projects/93da813e266e41509229a1e99815d9ab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.172504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93da813e266e41509229a1e99815d9ab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:07.189504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:07.285560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93da813e266e41509229a1e99815d9ab', 'request_id': 'req-a8a9432c-81a5-4df5-b86a-ec64a213a130'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:07.294337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93da813e266e41509229a1e99815d9ab', 'request_id': 'req-a8a9432c-81a5-4df5-b86a-ec64a213a130'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:07.301645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93da813e266e41509229a1e99815d9ab', 'request_id': 'req-a8a9432c-81a5-4df5-b86a-ec64a213a130'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:07.333033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] The token cache is being invalidate because project 93da813e266e41509229a1e99815d9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:07.333325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:07.334099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8a9432c-81a5-4df5-b86a-ec64a213a130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:07.340430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2694/5400] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:07 2022] DELETE /identity/v3/projects/93da813e266e41509229a1e99815d9ab => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:07.343717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.344205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.344297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.367883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:07.370271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:07.474380 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2707/5401] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:07.482605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.483235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.484014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.510163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:07.512046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:07.523825 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2695/5402] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:07.528599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:07.542865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33413cca-b349-417d-a76c-6f65009900a9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:07.550896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:07.551788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.552245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.552728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.553674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:09:07.554157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:07.556193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:07.586162 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2708/5403] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:09:07.590770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:07.600617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49798-1fa5-4bde-aedc-e46d267a8ee7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:07.625958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:07.626759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.627083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.628613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.629613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:07.631734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:07.728353 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2696/5404] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:07 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:07.731429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:07.764853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fde2f-ec85-45bc-ac02-158f798ac2fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:07.868646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:07.881624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.882098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.882392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.883357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:07.886457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:07.930305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:07.943068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b5509-285b-465e-9056-0bcb1ae3c834 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:07.944659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2709/5405] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:07 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:07.950389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:07.951133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:07.951469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:07.951756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:07.952574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:07.954425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:07.978301 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2697/5406] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:07.979509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:08.005809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ca638-b851-4543-b001-0c067215cc96 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:08.013374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:08.014504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:08.014653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:08.015780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:08.016637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:08.019685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4c50-bc49-4883-a18f-13891f55de22 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:08.047851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:08.055980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2710/5407] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:09:08.061518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446812-7ed1-490b-9116-682584b82f88 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:08.075721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:08.076830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:08.077226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:08.079296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] PATH_INFO: `/v3/projects/7623755f811741a0ac8fe7ca2f08e42b/users/ae4eb2db87694abe80feb344bb617c46/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:08.109478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7623755f811741a0ac8fe7ca2f08e42b, user_id=ae4eb2db87694abe80feb344bb617c46, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:08.116624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498b6e-644d-4a6b-9708-34b2f6530293 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:08.153974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2698/5408] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:08 2022] PUT /identity/v3/projects/7623755f811741a0ac8fe7ca2f08e42b/users/ae4eb2db87694abe80feb344bb617c46/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:08.165124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:08.165438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:08.166077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:08.220033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] MFA Rules not processed for user `ae4eb2db87694abe80feb344bb617c46`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:08.220999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:08.396605 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2711/5409] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:08.400805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675477-5701-4fa7-b266-4f4c502e2a8c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:08.401264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675477-5701-4fa7-b266-4f4c502e2a8c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:08.401634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675477-5701-4fa7-b266-4f4c502e2a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:08.441702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ca675477-5701-4fa7-b266-4f4c502e2a8c None None] MFA Rules not processed for user `ae4eb2db87694abe80feb344bb617c46`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:08.443661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca675477-5701-4fa7-b266-4f4c502e2a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:08.488183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2699/5410] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:08.501747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:08.504395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:08.639505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43bdf-2cca-48ca-9961-6ae6cfe82932 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:08.651836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:08.652684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:08.652970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:08.653249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:08.663234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:08.664956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:08.688651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2712/5411] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:09.695756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:09.696305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:09.696305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:09.740071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] MFA Rules not processed for user `912051f37cf84f30942319efc614fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:09.742541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:09.894948 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2700/5412] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:09.895696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:09.897342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:10.009566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d0928-c56f-47fe-b63e-8051ab0b6b89 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.016875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.017836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.018298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.018663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.019463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.021515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.055651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2713/5413] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:09 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:10.060070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:10.074186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251abb5-33d5-4340-b005-6cd0e44646e9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.155077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.156808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.157496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.158641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.161828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.165039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.210287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2701/5414] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:10 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:10.214057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:10.229657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a7fa-7161-4b30-88ad-d2616857270e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.242497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.243195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.243482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.243763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.244526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.247381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.263380 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2714/5415] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:10.266694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:10.278266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f775b-4bfa-4bed-a717-3ee474df3420 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.285085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.287251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.287659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.288045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] PATH_INFO: `/v3/projects/a44918b6e8e14b59a0ff928f20a37bed/users/cef22d160ef540d9b2ef157b7082e1bc/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.319036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44918b6e8e14b59a0ff928f20a37bed, user_id=cef22d160ef540d9b2ef157b7082e1bc, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.323038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.357135 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2702/5416] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:10 2022] PUT /identity/v3/projects/a44918b6e8e14b59a0ff928f20a37bed/users/cef22d160ef540d9b2ef157b7082e1bc/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:10.358115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:10.375027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ac8f-432a-416b-811e-4536368c262e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.483911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.486904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.487211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.487532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.488816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.491007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92510a68-c1e4-4f43-a5de-914c2be0f6c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.507011 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2715/5417] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:10.511738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:10.528038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba7e8-fb70-4624-99c5-0f2521708882 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:10.533138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:10.534043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:10.534973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:10.535253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] PATH_INFO: `/v3/projects/a44918b6e8e14b59a0ff928f20a37bed/users/cef22d160ef540d9b2ef157b7082e1bc/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:10.537336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44918b6e8e14b59a0ff928f20a37bed, user_id=cef22d160ef540d9b2ef157b7082e1bc, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:10.539991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:10.563304 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2703/5418] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:10 2022] PUT /identity/v3/projects/a44918b6e8e14b59a0ff928f20a37bed/users/cef22d160ef540d9b2ef157b7082e1bc/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:13.876974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:13.877571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:13.877839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:13.922556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] MFA Rules not processed for user `2fed8f5059c44a8fa1a9526e81fa73e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:13.927909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:14.089634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2716/5419] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:19.795675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:19.798715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:19.886251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:19.913294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0409b-ffd1-4acf-ab9e-65b74390aa22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:19.918416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:19.919327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:19.919611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:19.919885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] PATH_INFO: `/v3/users/880f012fb3954de0b757b2cd6a8ff8ee` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:19.921194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=880f012fb3954de0b757b2cd6a8ff8ee)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:19.923268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:19.964891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bba325-e2ad-4829-b2d7-bc2b5afc07be None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:19.970889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:19.972720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:19.973259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:19.973734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] PATH_INFO: `/v3/users/ae4eb2db87694abe80feb344bb617c46` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:19.975232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4eb2db87694abe80feb344bb617c46)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:19.977392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:20.006359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880f012fb3954de0b757b2cd6a8ff8ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.027206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880f012fb3954de0b757b2cd6a8ff8ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.029929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880f012fb3954de0b757b2cd6a8ff8ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.054305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880f012fb3954de0b757b2cd6a8ff8ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.070447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0f421a92-7f01-4a6a-9461-9e30d048d92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880f012fb3954de0b757b2cd6a8ff8ee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.075845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4eb2db87694abe80feb344bb617c46'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.081564 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2704/5420] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:19 2022] DELETE /identity/v3/users/880f012fb3954de0b757b2cd6a8ff8ee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:20.083046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b445-9f27-43ce-831b-bd8402dd2a4a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.083387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b445-9f27-43ce-831b-bd8402dd2a4a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.083613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b445-9f27-43ce-831b-bd8402dd2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.086294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4eb2db87694abe80feb344bb617c46'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.099080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4eb2db87694abe80feb344bb617c46'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.100773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4eb2db87694abe80feb344bb617c46'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.109538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-70e925d1-e81d-4927-8ae4-7d0da4433e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4eb2db87694abe80feb344bb617c46'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:20.122460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8a24b445-9f27-43ce-831b-bd8402dd2a4a None None] MFA Rules not processed for user `cef22d160ef540d9b2ef157b7082e1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:20.123517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a24b445-9f27-43ce-831b-bd8402dd2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.141340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2717/5421] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:19 2022] DELETE /identity/v3/users/ae4eb2db87694abe80feb344bb617c46 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:20.141340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.141340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.141340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.163989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:20.165917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.221297 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2705/5422] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:20.223530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.223826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.224110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.256185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:20.258771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.286810 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2718/5423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:20.287629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:20.289840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.358858 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2706/5424] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:20.360599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:20.363275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.406574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabd86b-adf2-4daa-a7e8-5402abf1561f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:20.414517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:20.415488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.415966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.416253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.418158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:20.456874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a2198-ba6a-4b9a-861c-58fa963275bb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:20.465251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:20.466229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.466710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.468844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.488361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:20.490307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:20.513665 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2707/5425] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:20.514988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:20.539505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15ed1-c185-47a8-896e-4734032ebdac service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:20.550111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:20.550379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:20.551209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:20.552158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:20.552608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:20.552895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:20.567680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2719/5426] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:20.585507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:20.589309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:20.603781 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2708/5427] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:21.234881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:21.236613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:21.274638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a5da-2dc6-4a84-b927-f52cc0cbaddb service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:21.286785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:21.289499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:21.289998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:21.290454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] PATH_INFO: `/v3/projects/fad24d22ed244e45ae7c215bc2334bae` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:21.292163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad24d22ed244e45ae7c215bc2334bae)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:21.294466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:21.393149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad24d22ed244e45ae7c215bc2334bae', 'request_id': 'req-1efde01f-74b7-421f-b513-69a30dd6e7f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.410755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad24d22ed244e45ae7c215bc2334bae', 'request_id': 'req-1efde01f-74b7-421f-b513-69a30dd6e7f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.426996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad24d22ed244e45ae7c215bc2334bae', 'request_id': 'req-1efde01f-74b7-421f-b513-69a30dd6e7f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.444085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] The token cache is being invalidate because project fad24d22ed244e45ae7c215bc2334bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:21.445096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.446291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.449095 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2720/5428] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:21 2022] DELETE /identity/v3/projects/fad24d22ed244e45ae7c215bc2334bae => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:21.453083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:21.467240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62284b88-e8bd-443e-b5fe-130491188a57 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:21.549282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:21.550535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:21.552877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:21.553649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] PATH_INFO: `/v3/users/e451315b01ce4b468ca045ce9815c7c5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:21.555289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e451315b01ce4b468ca045ce9815c7c5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:21.557504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:21.612608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:21.615469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:21.649221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e451315b01ce4b468ca045ce9815c7c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.650795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde01f-74b7-421f-b513-69a30dd6e7f9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:21.684076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:21.686239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:21.689826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:21.691510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] PATH_INFO: `/v3/projects/7623755f811741a0ac8fe7ca2f08e42b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:21.692899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e451315b01ce4b468ca045ce9815c7c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.695774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e451315b01ce4b468ca045ce9815c7c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.696321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7623755f811741a0ac8fe7ca2f08e42b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:21.702787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:21.718704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e451315b01ce4b468ca045ce9815c7c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.729989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-26394aa2-ac2c-4de1-ad51-c17bc815daaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e451315b01ce4b468ca045ce9815c7c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.741006 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2709/5429] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:21 2022] DELETE /identity/v3/users/e451315b01ce4b468ca045ce9815c7c5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:21.786808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7623755f811741a0ac8fe7ca2f08e42b', 'request_id': 'req-ff6ed1a1-f383-47f0-a931-3752fd836089'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.797851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7623755f811741a0ac8fe7ca2f08e42b', 'request_id': 'req-ff6ed1a1-f383-47f0-a931-3752fd836089'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.809766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7623755f811741a0ac8fe7ca2f08e42b', 'request_id': 'req-ff6ed1a1-f383-47f0-a931-3752fd836089'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.825304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] The token cache is being invalidate because project 7623755f811741a0ac8fe7ca2f08e42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:21.825738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.826650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ff6ed1a1-f383-47f0-a931-3752fd836089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:21.833456 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2721/5430] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:21 2022] DELETE /identity/v3/projects/7623755f811741a0ac8fe7ca2f08e42b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:21.835252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:21.836649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:21.837213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:21.863425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:21.865779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.009042 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2710/5431] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.032922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.033237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.033527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.060265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:22.061203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.080311 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2722/5432] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.081735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.095838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cccd29-c39a-4493-b535-2b2e1fe0fafd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.111548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.113095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.113518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.113898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.115547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:09:22.115547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.119553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.150018 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2711/5433] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:09:22.154117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.167169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f96e-63c4-4ad5-8dbe-7d5fb07c7dd6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.180528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.180981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.181365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.181776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.182593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.184762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.225866 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2723/5434] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:09:22.228506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.243446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e3ad-2c07-45ea-b542-49aa9f15449b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.258324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.261388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.335981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.337214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.339088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.339664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.345135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.349774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.394877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea183b24-faf3-43d5-98bf-babe4c35869f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.397350 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2712/5435] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:22.398494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.398819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.399709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.399996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.400279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] PATH_INFO: `/v3/projects/ad819fff1305481d99551c3c226d9427` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.401733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad819fff1305481d99551c3c226d9427)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.403772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.416502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff4dc3-7b6f-40f6-aca3-69e33bb87477 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.422279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.423082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.423477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.424017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.425056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.427643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.443808 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2713/5436] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:22.445354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.465584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b118-ed15-4e66-87bd-988d749f53a4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.478835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.478835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.479815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.480154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.482149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.489963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.517112 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2714/5437] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:22.519075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.532018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7b6f-03e0-4917-bbd0-2216cf399c1a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.532231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad819fff1305481d99551c3c226d9427', 'request_id': 'req-848beda5-a64e-40c8-be01-e9f18692d6e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:22.552160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad819fff1305481d99551c3c226d9427', 'request_id': 'req-848beda5-a64e-40c8-be01-e9f18692d6e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:22.565507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad819fff1305481d99551c3c226d9427', 'request_id': 'req-848beda5-a64e-40c8-be01-e9f18692d6e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:22.593078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] The token cache is being invalidate because project ad819fff1305481d99551c3c226d9427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:22.593403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:22.594462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-848beda5-a64e-40c8-be01-e9f18692d6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:22.600789 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2724/5438] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:22 2022] DELETE /identity/v3/projects/ad819fff1305481d99551c3c226d9427 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:22.602477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c50c-e5b1-4b9c-94c8-a2db5dcb65c0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.602917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c50c-e5b1-4b9c-94c8-a2db5dcb65c0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.603209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59c50c-e5b1-4b9c-94c8-a2db5dcb65c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.620199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.621230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.621578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.621925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] PATH_INFO: `/v3/projects/e9e9483710f0424b9c347c74a9da708a/users/d7ebf8694d674ee38bb5f58a3687a415/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.625325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7b59c50c-e5b1-4b9c-94c8-a2db5dcb65c0 None None] MFA Rules not processed for user `912051f37cf84f30942319efc614fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:22.627344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b59c50c-e5b1-4b9c-94c8-a2db5dcb65c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.638941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e9483710f0424b9c347c74a9da708a, user_id=d7ebf8694d674ee38bb5f58a3687a415, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.641795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7440b-9b21-4ffa-956e-2f6cf9139976 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.669108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2715/5439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:22 2022] PUT /identity/v3/projects/e9e9483710f0424b9c347c74a9da708a/users/d7ebf8694d674ee38bb5f58a3687a415/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:22.669108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c057eb-c2d8-4e21-b645-d048d2bb44dc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.669108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c057eb-c2d8-4e21-b645-d048d2bb44dc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.669544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c057eb-c2d8-4e21-b645-d048d2bb44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.688996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-88c057eb-c2d8-4e21-b645-d048d2bb44dc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:22.690443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-88c057eb-c2d8-4e21-b645-d048d2bb44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.709196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2725/5440] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.715056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.715429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.715786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.742054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:22.743293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.777700 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2716/5441] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.790653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.790953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.791237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.840712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:22.841949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.858025 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2717/5442] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.858242 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2726/5443] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:22.860125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.870213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486af7-df58-4737-bb38-caf139a0ca8a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.871827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.874017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:22.886938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.887774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.888066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.888341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.889301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:09:22.889617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.895309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.921048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2718/5444] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:09:22.925470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:22.943554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b8c35-19d4-45e7-b8b7-98a8dd2316de admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.956335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.957905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.959385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.960407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.961405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.965434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.965640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ca04-26b0-4713-8c9f-fb76c9d478b6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:22.969708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:22.970373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:22.970684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:22.970935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:22.983899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:22.984997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:22.997006 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2727/5445] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:09:23.026041 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2719/5446] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:22 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:09:23.031038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.042388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272b692-b2c2-46b8-a6d7-28450d78e3a7 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.135452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.135896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.136251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.136769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.137974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.142314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.195595 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2728/5447] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:23 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:09:23.198744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.230506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d831e8-b1e3-44a6-af53-91bea4a8571c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.236084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.237147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.237552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.237980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.238783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.240602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.258568 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2720/5448] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:23.260176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.271864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052d07a-4dc8-4090-a81f-ad6c0c3ffea4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.279400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.280298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.280730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.281159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.282015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.285103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032c576-f101-429b-9315-d4dbc2ca2cef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.302303 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2729/5449] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:23.304127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.318932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6298469-48d7-4b47-a683-fc4e5c21a840 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.328290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.330391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.331795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.333260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] PATH_INFO: `/v3/projects/745eae9eff304043b72bdd1a7c148931/users/e152fe89c3924a21b9244b94c9258c2d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.362178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745eae9eff304043b72bdd1a7c148931, user_id=e152fe89c3924a21b9244b94c9258c2d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.367001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.399644 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2721/5450] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:23 2022] PUT /identity/v3/projects/745eae9eff304043b72bdd1a7c148931/users/e152fe89c3924a21b9244b94c9258c2d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:23.411636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.411767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.412041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.449097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] MFA Rules not processed for user `e152fe89c3924a21b9244b94c9258c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:23.450663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:23.539135 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2730/5451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:23.549981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.552513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:23.631040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c5417-d082-4b95-9d5b-93c392bdbc32 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.636949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.637750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.638059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.638510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.653590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.655190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59383c-8439-4392-80ab-5c18c9fc1778 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.670358 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2722/5452] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:23.724675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:23.807555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489778-19fa-409c-9ad2-ae92f87a83dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:23.813322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:23.814233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.814520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.814800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] PATH_INFO: `/v3/users/e152fe89c3924a21b9244b94c9258c2d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.817186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e152fe89c3924a21b9244b94c9258c2d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:23.819139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:23.875289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e152fe89c3924a21b9244b94c9258c2d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:23.885675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e152fe89c3924a21b9244b94c9258c2d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:23.886646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e152fe89c3924a21b9244b94c9258c2d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:23.887554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e152fe89c3924a21b9244b94c9258c2d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:23.897159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e152fe89c3924a21b9244b94c9258c2d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:23.942669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2731/5453] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:09:23 2022] DELETE /identity/v3/users/e152fe89c3924a21b9244b94c9258c2d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:23.951905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:23.953093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:23.953272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:23.990643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:23.991914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:24.106061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2723/5454] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:24.201259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:24.203843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:24.307640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9c03d-a166-458b-8ac1-e35c8fbcffae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:24.314374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:24.315962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:24.316425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:24.316908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:24.330100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:24.332310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a189b-1b77-4c27-a226-4dbacd41b38f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:24.349839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2732/5455] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:25.082396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.084606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:25.108503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66b49-3d64-4f80-b65e-ac0e688135e4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.126316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.128817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.129276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.129742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] PATH_INFO: `/v3/projects/745eae9eff304043b72bdd1a7c148931` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.131389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] RBAC: Authorizing `identity:delete_project(project_id=745eae9eff304043b72bdd1a7c148931)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.133682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.217321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745eae9eff304043b72bdd1a7c148931', 'request_id': 'req-7f198e31-85e6-4baa-bf5d-296879c7424e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:25.226223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745eae9eff304043b72bdd1a7c148931', 'request_id': 'req-7f198e31-85e6-4baa-bf5d-296879c7424e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:25.233701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745eae9eff304043b72bdd1a7c148931', 'request_id': 'req-7f198e31-85e6-4baa-bf5d-296879c7424e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:25.258818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] The token cache is being invalidate because project 745eae9eff304043b72bdd1a7c148931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:09:25.259728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:25.261052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f198e31-85e6-4baa-bf5d-296879c7424e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:09:25.266430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2724/5456] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:09:25 2022] DELETE /identity/v3/projects/745eae9eff304043b72bdd1a7c148931 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:09:25.271691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.272130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.272716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.297878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:25.299643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:25.379629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2733/5457] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:25.387952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.388380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.388811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.413148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:25.415337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:25.424895 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2725/5458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:25.428977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.449800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07fd0-03fa-4714-bac4-02140496b159 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.464181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.465053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.465492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.466072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.467085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:09:25.468060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.470097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.490114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2734/5459] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:09:25.491308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.506964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848eb00-7452-4cf2-88c7-e2c1df509b43 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.518289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.519114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.519402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.519681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.520374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.522330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.561381 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2726/5460] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:09:25 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:09:25.563233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.580128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c7572-11f4-4a69-af3e-07746a8fe8f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.723588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.724944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.725433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.726506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.727308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.744752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.803042 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2735/5461] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:09:25 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:09:25.804567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.821054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0775-92da-4a20-a0ec-701bd9045fec admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.828245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.829494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.830002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.830956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.831974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.834115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.853463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2727/5462] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:25.857592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.872075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a7d0b-d5a6-4a00-94be-1e72dd39e875 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.880291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.881348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.881821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.882284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.883242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.885371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f47e-87cb-421c-a1b0-051b1a882d62 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:25.898409 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2736/5463] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:09:25.903198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:25.918724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8bd44-95f0-4f23-8903-1071cdb79760 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:25.932676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:25.934222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:25.934515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:25.934802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] PATH_INFO: `/v3/projects/77d2003536394f7687aad79d929427b6/users/57aaf2fa0a424431b178a7a1cb4e78a7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:25.988125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d2003536394f7687aad79d929427b6, user_id=57aaf2fa0a424431b178a7a1cb4e78a7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:25.995123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:26.066520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2728/5464] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:09:25 2022] PUT /identity/v3/projects/77d2003536394f7687aad79d929427b6/users/57aaf2fa0a424431b178a7a1cb4e78a7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:09:26.078703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:26.079216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:26.079515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:26.167265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] MFA Rules not processed for user `57aaf2fa0a424431b178a7a1cb4e78a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:26.170866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:26.342094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2737/5465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:26.387634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:26.391671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:26.491982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85816-1085-4e32-b72c-b0f746f0af51 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:26.497077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:26.497951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:26.498410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:26.499008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:26.512804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:26.514268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad0ff8-bea7-4600-8801-461bb403bfc8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:26.527284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2729/5466] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:32.875997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:32.877624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:32.995391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c4833-9be9-4c07-9afd-560ba64d0a1e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:33.002976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:33.003888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:33.004342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:33.005035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:33.009347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:33.024265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:33.024896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:33.024896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:33.043707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:33.045925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee449db6-5538-4d43-ab9a-ea8c7f676d24 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:33.066422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2738/5467] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:33.084339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] MFA Rules not processed for user `d7ebf8694d674ee38bb5f58a3687a415`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:33.085804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:33.243418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2730/5468] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:09:33.246121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86260ff-efee-426f-b284-033ca0e59f5d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:33.246425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86260ff-efee-426f-b284-033ca0e59f5d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:33.246731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86260ff-efee-426f-b284-033ca0e59f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:33.299673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b86260ff-efee-426f-b284-033ca0e59f5d None None] MFA Rules not processed for user `d7ebf8694d674ee38bb5f58a3687a415`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:33.301328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b86260ff-efee-426f-b284-033ca0e59f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:33.321615 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2739/5469] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:33.500906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:33.503474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:33.641963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f4de-0d8e-400d-b902-a14f5077a38f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:33.652065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:33.652790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:33.653082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:33.653364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:33.665015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:33.666840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:33.721672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2731/5470] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:36.520619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:36.521505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:36.522011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:36.557233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] MFA Rules not processed for user `d7ebf8694d674ee38bb5f58a3687a415`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:09:36.558486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:36.579245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2740/5471] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:09:38.979881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:39.005845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9b360-b10c-4fae-aa80-45b16174e298 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:39.018991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:39.022591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:39.031616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:39.032476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:39.036556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:39.078719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:39.081463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:39.099784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2732/5472] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:41.348437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:41.350187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:41.389225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f552092-a94f-49e4-8a97-d943595b41fd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:41.400699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:41.401887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:41.402366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:41.402816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:41.422258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:41.566681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:41.569989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:09:41.583848 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2741/5473] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:09:59.837596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:09:59.859322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37e503-f8bf-411f-950e-11430391315d service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:09:59.864036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:09:59.864967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:09:59.865449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:09:59.865944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:09:59.867969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:09:59.958576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:09:59.960328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:00.006995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2733/5474] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:10:02.877455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:02.882759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:02.962641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afc9b-3cd7-4778-91dc-68008b7eea03 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:02.968371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:02.969402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:02.971145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:02.971897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] PATH_INFO: `/v3/users/20f75a3bb7e8417791babaae0fda1c39` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:02.973456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f75a3bb7e8417791babaae0fda1c39)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:02.976189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:03.043648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f75a3bb7e8417791babaae0fda1c39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.057610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f75a3bb7e8417791babaae0fda1c39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.058289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f75a3bb7e8417791babaae0fda1c39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.058980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f75a3bb7e8417791babaae0fda1c39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.067703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7964ae6-cb74-4291-bd88-5fd39abca300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f75a3bb7e8417791babaae0fda1c39'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.086234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2742/5475] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:02 2022] DELETE /identity/v3/users/20f75a3bb7e8417791babaae0fda1c39 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:03.564189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:03.582831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9120829-07a3-4426-b059-080509607c48 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:03.680900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:03.681850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:03.682146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:03.682428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] PATH_INFO: `/v3/projects/bcc988d584ef47dd99506305e1c7d45a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:03.684572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc988d584ef47dd99506305e1c7d45a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:03.686893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:03.741360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc988d584ef47dd99506305e1c7d45a', 'request_id': 'req-f33f33bf-cac0-4330-9573-a72e66ec1117'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.748417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc988d584ef47dd99506305e1c7d45a', 'request_id': 'req-f33f33bf-cac0-4330-9573-a72e66ec1117'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.755009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc988d584ef47dd99506305e1c7d45a', 'request_id': 'req-f33f33bf-cac0-4330-9573-a72e66ec1117'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.773287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] The token cache is being invalidate because project bcc988d584ef47dd99506305e1c7d45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:03.773826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.774566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f33f33bf-cac0-4330-9573-a72e66ec1117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:03.776194 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2734/5476] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:03 2022] DELETE /identity/v3/projects/bcc988d584ef47dd99506305e1c7d45a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:03.781873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:03.782257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:03.782573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:03.801803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:03.803278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:03.867001 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2743/5477] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:03.875577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:03.875946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:03.876879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:03.895375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:03.896629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:03.912033 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2735/5478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:03.916282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:03.926620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9725a3-95fb-4464-b21c-7d791a7ea7e6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:03.932106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:03.932840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:03.933132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:03.933415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:03.934175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:03.934496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:03.936133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:03.949099 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2744/5479] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:10:03.953286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:03.962624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107b19-a9ce-4073-9a0b-32cc2ce97fe3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:03.969392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:03.969392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:03.969392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:03.969392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:03.969894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:03.972163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.015724 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2736/5480] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:03 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:10:04.019735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:04.031987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5c29d-c63b-498b-a971-0216b8c1bc6b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:04.109412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:04.110242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.111192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.111528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.112242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:04.114195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.138675 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2745/5481] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:04 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:10:04.142490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:04.154365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b570-854f-40ee-9034-c9350783ec7c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:04.171050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:04.172050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.172646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.174421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.175732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:04.179696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.210215 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2737/5482] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:04.213947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:04.230034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47126f-3b20-4c38-9eb0-070a0bb5fc1f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:04.236277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:04.237444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.239715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.240223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.241171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:04.243387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebdc1-1535-414d-afda-cecfa6780c67 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.255559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2746/5483] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:04.259330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:04.275960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acbecd-5467-4999-8d9e-fa41aa927215 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:04.286230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:04.287388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.287771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.288315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] PATH_INFO: `/v3/projects/6b10b2726e7c4fb385dd98063b209656/users/3156f3a86961452eac493ee89e4f56fd/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.319877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b10b2726e7c4fb385dd98063b209656, user_id=3156f3a86961452eac493ee89e4f56fd, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:04.322694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41453399-15c1-4e9a-9a23-d2e474bb57a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.341131 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2738/5484] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:04 2022] PUT /identity/v3/projects/6b10b2726e7c4fb385dd98063b209656/users/3156f3a86961452eac493ee89e4f56fd/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:04.352790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.353184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.353513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.385461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] MFA Rules not processed for user `3156f3a86961452eac493ee89e4f56fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:04.387187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:04.473834 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2747/5485] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:04.485850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.488125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.488685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.512719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] MFA Rules not processed for user `3156f3a86961452eac493ee89e4f56fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:04.514478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:04.524825 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2739/5486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:04.538222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:04.540919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:04.637630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b922fea-fad9-4a79-bf1f-34a687d9cdb9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:04.643925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:04.644774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:04.645070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:04.645354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:04.654569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:04.657114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:04.667556 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2748/5487] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:08.712359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:08.713969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:08.775389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd97b5-9b7c-4670-aec9-62c5651785fb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:08.779476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:08.780304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:08.780626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:08.780911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:08.783274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:08.850733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:08.852180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac8ced-184c-43e6-a844-85335d94257a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:08.863757 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2740/5488] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:10:10.021240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.022826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.042690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c894d7-5173-4fc5-bab6-748f3faadb0f service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.048523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.049407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.049695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.049975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] PATH_INFO: `/v3/users/57aaf2fa0a424431b178a7a1cb4e78a7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.051230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57aaf2fa0a424431b178a7a1cb4e78a7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.053361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.103255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57aaf2fa0a424431b178a7a1cb4e78a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.111467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57aaf2fa0a424431b178a7a1cb4e78a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.112210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57aaf2fa0a424431b178a7a1cb4e78a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.112848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57aaf2fa0a424431b178a7a1cb4e78a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.119564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57aaf2fa0a424431b178a7a1cb4e78a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.136363 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2749/5489] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:10 2022] DELETE /identity/v3/users/57aaf2fa0a424431b178a7a1cb4e78a7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:10.140891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.141428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.141538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.158512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:10.159703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.221790 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2741/5490] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:10.231328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.232764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.291405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192dc9e-80d4-4875-b430-251ea4b1da95 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.295088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.295743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.296035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.296332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.306298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.307733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690157-2d0e-4d96-a737-fb06a0846b1a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.317498 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2750/5491] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:10.489441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.491355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.507807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f086c-67d8-458e-9264-dfbb4068bdcb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.528719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.529695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.529983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.530263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] PATH_INFO: `/v3/projects/77d2003536394f7687aad79d929427b6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.531773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d2003536394f7687aad79d929427b6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.534328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.603627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d2003536394f7687aad79d929427b6', 'request_id': 'req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.611529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d2003536394f7687aad79d929427b6', 'request_id': 'req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.620125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d2003536394f7687aad79d929427b6', 'request_id': 'req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.639910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] The token cache is being invalidate because project 77d2003536394f7687aad79d929427b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:10.640209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.640887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fa6930d3-c2f1-4588-b3b7-36c0da4d7efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:10.643472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2742/5492] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:10 2022] DELETE /identity/v3/projects/77d2003536394f7687aad79d929427b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:10.648281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.648726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.649108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.671891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:10.673186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.744007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2751/5493] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:10.751419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.752864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.753246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.784992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:10.786291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:10.795756 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2743/5494] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:10.799848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.809604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107b3c9-1671-4485-8478-2a5a028c0fe1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.815043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.815820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.816103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.816385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.817122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:10.817436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.819045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.832746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2752/5495] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:10.837226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.847970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ca875-2240-4b3c-8a8e-136663d5a8e5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.853472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.854776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.855132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.855475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.856259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.858256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.888565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2744/5496] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:10 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:10:10.892981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:10.903848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df755a-9309-4842-8592-ce9181d7f9e7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:10.965436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:10.966140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:10.966433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:10.966715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:10.967402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:10.969533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:10.993220 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2753/5497] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:10 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:10.997649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:11.009444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401edbd-aac3-4482-9cb6-9c6500b4a6b0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:11.016072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:11.017506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:11.017790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:11.018065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:11.018788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:11.020388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:11.031778 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2745/5498] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:10:11.036276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:11.052083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ee72a-c214-4e5a-b3b5-6f8dac5f4f70 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:11.058141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:11.059440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:11.059730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:11.060005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:11.060862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:11.063676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8420-d6b3-44f5-8baf-34dd20a445c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:11.078176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2754/5499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:11.079944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:11.090046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92368151-ffcf-48f0-b11b-c42e51d519d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:11.095082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:11.095997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:11.096279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:11.096591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] PATH_INFO: `/v3/projects/7568e68b76ba4608936b1cd4ed8033fa/users/335fbcc3a06743aca0e49eb4f945ba08/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:11.111388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7568e68b76ba4608936b1cd4ed8033fa, user_id=335fbcc3a06743aca0e49eb4f945ba08, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:11.114529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:11.131184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2746/5500] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:11 2022] PUT /identity/v3/projects/7568e68b76ba4608936b1cd4ed8033fa/users/335fbcc3a06743aca0e49eb4f945ba08/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:11.142384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:11.142690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:11.142977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:11.202201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] MFA Rules not processed for user `335fbcc3a06743aca0e49eb4f945ba08`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:11.204522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:11.281359 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2755/5501] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:11.294609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:11.296399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:11.389289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df07b1-6a05-4a4a-a516-d59e36854e47 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:11.395202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:11.396559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:11.397082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:11.398059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:11.409305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:11.411193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:11.421652 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2747/5502] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:18.217754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:18.219291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:18.307626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38701-addd-4afa-baa6-5b3aeef40ef7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:18.315431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:18.316323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:18.316651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:18.316932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] PATH_INFO: `/v3/users/ee1c48c096304c819e0eac11e84aef26` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:18.318307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1c48c096304c819e0eac11e84aef26)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:18.320264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:18.395743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1c48c096304c819e0eac11e84aef26'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.408112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1c48c096304c819e0eac11e84aef26'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.408927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1c48c096304c819e0eac11e84aef26'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.409714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1c48c096304c819e0eac11e84aef26'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.423853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1c48c096304c819e0eac11e84aef26'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.450725 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2756/5503] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:18 2022] DELETE /identity/v3/users/ee1c48c096304c819e0eac11e84aef26 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:18.697730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:18.713318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc47e3-998b-44fe-8635-b9b443aa787b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:18.821672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:18.822654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:18.823013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:18.823368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] PATH_INFO: `/v3/projects/fad5516982b843a9a35e49795fda0844` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:18.824671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad5516982b843a9a35e49795fda0844)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:18.826655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:18.889623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad5516982b843a9a35e49795fda0844', 'request_id': 'req-0caa1356-11b1-44ae-83bb-a971500314a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.897534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad5516982b843a9a35e49795fda0844', 'request_id': 'req-0caa1356-11b1-44ae-83bb-a971500314a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.904281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad5516982b843a9a35e49795fda0844', 'request_id': 'req-0caa1356-11b1-44ae-83bb-a971500314a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.923230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] The token cache is being invalidate because project fad5516982b843a9a35e49795fda0844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:18.923741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.925031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:18.927650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2748/5504] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:18 2022] DELETE /identity/v3/projects/fad5516982b843a9a35e49795fda0844 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:10:18.932387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:18.933862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:18.948726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1c72b-5337-4693-be33-038a7d0561a3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.005697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.006575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.006858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.007133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] PATH_INFO: `/v3/users/2071e721c18d4b0da78ece25fae86679` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.008326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2071e721c18d4b0da78ece25fae86679)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.010268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.061959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2071e721c18d4b0da78ece25fae86679'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.070005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2071e721c18d4b0da78ece25fae86679'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.070791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2071e721c18d4b0da78ece25fae86679'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.071492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2071e721c18d4b0da78ece25fae86679'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.078336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4ed29f58-ae60-4d8a-8f27-21e9bb39c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2071e721c18d4b0da78ece25fae86679'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.096789 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2757/5505] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:18 2022] DELETE /identity/v3/users/2071e721c18d4b0da78ece25fae86679 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:19.420107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.421582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:19.437893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1356-11b1-44ae-83bb-a971500314a3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.514829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.515752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.516601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.516881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] PATH_INFO: `/v3/projects/3594e07bf51f4a24bf631961d5366fd7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.518089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3594e07bf51f4a24bf631961d5366fd7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.520012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.571343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3594e07bf51f4a24bf631961d5366fd7', 'request_id': 'req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.580188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3594e07bf51f4a24bf631961d5366fd7', 'request_id': 'req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.585951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3594e07bf51f4a24bf631961d5366fd7', 'request_id': 'req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.602582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] The token cache is being invalidate because project 3594e07bf51f4a24bf631961d5366fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:19.604407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.604807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f390bb-1e34-4da5-9912-b8f1f80c7e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:19.606746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2749/5506] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:19 2022] DELETE /identity/v3/projects/3594e07bf51f4a24bf631961d5366fd7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:19.611697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.612225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.612436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.633782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:19.635170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:19.708118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2758/5507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:19.710814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.711306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.711410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.730652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:19.731849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:19.740050 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2750/5508] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:19.744162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.754333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9be3-7ce2-444c-b151-fc2740fdf597 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.758903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.759567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.759849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.760125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.760899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:19.761206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.762801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.778071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2759/5509] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:19.779270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.789331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada6267-a29a-4f8f-be0c-cc330f784c6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.794470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.795362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.795658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.796001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.796966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.799784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.825926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2751/5510] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:19 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:19.831418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.842682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49a5d-d3f1-4eb3-9817-87a26b402416 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.913394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.914229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.914623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.915009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.915801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.917853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.945488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2760/5511] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:19 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:19.947794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.960905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864a332-fd72-4619-bc7e-f39f16ae7893 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:19.965927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:19.966624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:19.966908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:19.967209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:19.968092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:19.969974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:19.982430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2752/5512] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:19.986596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:19.999838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77011787-d3cd-416c-9ec4-33319dabf823 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:20.005743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:20.006442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:20.006731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:20.007013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:20.007753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:20.009964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bc106-ad9f-424d-b352-b5b3a8a033f8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:20.021897 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2761/5513] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:20.026110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:20.041746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887b195-4335-4268-b73a-7b3465626089 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:20.046744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:20.047896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:20.048186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:20.048491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] PATH_INFO: `/v3/projects/e25481b7efed4632bcd054e2cec3b161/users/27f570c67ed24546ac51341ef8ea2439/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:20.065640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25481b7efed4632bcd054e2cec3b161, user_id=27f570c67ed24546ac51341ef8ea2439, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:20.068369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:20.087106 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2753/5514] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:20 2022] PUT /identity/v3/projects/e25481b7efed4632bcd054e2cec3b161/users/27f570c67ed24546ac51341ef8ea2439/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:20.092001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1019b-aaa7-45c4-ad87-fdcd07bc976f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:20.092293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1019b-aaa7-45c4-ad87-fdcd07bc976f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:20.092681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1019b-aaa7-45c4-ad87-fdcd07bc976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:20.111844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e2c1019b-aaa7-45c4-ad87-fdcd07bc976f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:20.113121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e2c1019b-aaa7-45c4-ad87-fdcd07bc976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:20.190737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2762/5515] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:20.200026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:20.202231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:20.271892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ccaf4-c634-46e2-9e2f-f9217fd415ed admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:20.277276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:20.277936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:20.278683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:20.278683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:20.287966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:20.289473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:20.301569 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2754/5516] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:26.114799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aef-92a9-4ed7-abe9-6b5fb25008bf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:26.115723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aef-92a9-4ed7-abe9-6b5fb25008bf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:26.116211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc411aef-92a9-4ed7-abe9-6b5fb25008bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:26.152087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dc411aef-92a9-4ed7-abe9-6b5fb25008bf None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:26.154505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dc411aef-92a9-4ed7-abe9-6b5fb25008bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:26.262891 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2763/5517] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:26.275636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:26.277187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:26.370970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ef9c-609e-403f-af80-ccadba78fde5 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:26.381271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:26.381962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:26.382260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:26.382627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:26.392405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:26.397975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:26.408534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2755/5518] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:10:29.037130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e2125-cd68-47af-8424-8682eaa5ef39 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:29.037603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e2125-cd68-47af-8424-8682eaa5ef39 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:29.037603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e2125-cd68-47af-8424-8682eaa5ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:29.074765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-523e2125-cd68-47af-8424-8682eaa5ef39 None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:29.076406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-523e2125-cd68-47af-8424-8682eaa5ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:29.085403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2764/5519] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:46.129551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:46.132273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:46.151763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710cf4-9dce-4b59-b967-a6596b4cfaca service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:46.161567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:46.162548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:46.162915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:46.163256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] PATH_INFO: `/v3/users/3156f3a86961452eac493ee89e4f56fd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:46.164582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3156f3a86961452eac493ee89e4f56fd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:46.167186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:46.248052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3156f3a86961452eac493ee89e4f56fd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.262074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3156f3a86961452eac493ee89e4f56fd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.263178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3156f3a86961452eac493ee89e4f56fd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.276312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3156f3a86961452eac493ee89e4f56fd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.286440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3156f3a86961452eac493ee89e4f56fd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.291342 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2756/5520] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:46 2022] DELETE /identity/v3/users/3156f3a86961452eac493ee89e4f56fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:46.295903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:46.297050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:46.297174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:46.315109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:46.316302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:46.380264 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2765/5521] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:46.392534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:46.394141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:46.466968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d201a-8e14-4bcf-ba97-97bcc9bc578c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:46.471382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:46.472036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:46.472321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:46.472638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:46.482257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:46.483706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90fa8-2aca-4168-8963-7be8199bbd96 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:46.500578 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2757/5522] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:10:46.858894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:46.860317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:46.878333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23369b4b-2fb9-4dbf-a8fd-15fc4c262182 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:46.883231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:46.884086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:46.884744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:46.885148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] PATH_INFO: `/v3/projects/6b10b2726e7c4fb385dd98063b209656` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:46.886335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b10b2726e7c4fb385dd98063b209656)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:46.888884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:46.938275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b10b2726e7c4fb385dd98063b209656', 'request_id': 'req-8be08e3c-8fdd-458c-95dc-4650fb039535'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.944580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b10b2726e7c4fb385dd98063b209656', 'request_id': 'req-8be08e3c-8fdd-458c-95dc-4650fb039535'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.953672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b10b2726e7c4fb385dd98063b209656', 'request_id': 'req-8be08e3c-8fdd-458c-95dc-4650fb039535'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.963998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] The token cache is being invalidate because project 6b10b2726e7c4fb385dd98063b209656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:46.964285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.964952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8be08e3c-8fdd-458c-95dc-4650fb039535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:46.966532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2766/5523] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:46 2022] DELETE /identity/v3/projects/6b10b2726e7c4fb385dd98063b209656 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:46.971566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:46.971859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:46.972140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:46.989202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:46.990388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:47.050490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2758/5524] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:47.059395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.059711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.059979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.086768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:47.088258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:47.097908 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2767/5525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:47.102656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.113814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f21007-5234-4852-b271-8310efe9da43 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.118752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.119416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.119700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.120012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.121039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:47.121169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.122831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.135605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2759/5526] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:47.139838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.153374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308cff2-368d-4bd8-860a-9d0c62091e0e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.158307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.158987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.159256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.159532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.160243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.162182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.188078 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2768/5527] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:47 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:47.192313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.202124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cbb5-bfab-4ac2-b82b-36fb5982d56e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.260158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.260855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.261142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.261424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.262116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.264024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.285846 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2760/5528] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:47 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:47.290248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.303199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1b027-2089-4724-b313-6437147f1e20 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.310962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.311644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.312917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.313428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.314447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.317070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.329357 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2769/5529] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:47.333417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.343607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb748c4a-30db-44bd-974c-0e0a9688e05e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.348476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.349149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.349436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.349716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.350434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.352033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9dde-0343-46d0-b156-103104e09f06 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.366168 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2761/5530] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:47.367626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.379230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888a6f6-fbdc-4335-99d5-f1b6a8a4c06b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.384778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.385916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.386211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.386490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] PATH_INFO: `/v3/projects/19737338fb9f4d53a9353bfab097594a/users/609cc7d1420848279d441e4d80b447ec/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.406854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19737338fb9f4d53a9353bfab097594a, user_id=609cc7d1420848279d441e4d80b447ec, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.412252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.437859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2770/5531] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:47 2022] PUT /identity/v3/projects/19737338fb9f4d53a9353bfab097594a/users/609cc7d1420848279d441e4d80b447ec/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:47.446980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013e63-5798-41ac-9f97-71be447b55d0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.447276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013e63-5798-41ac-9f97-71be447b55d0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.447558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013e63-5798-41ac-9f97-71be447b55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.475106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-19013e63-5798-41ac-9f97-71be447b55d0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:47.476851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-19013e63-5798-41ac-9f97-71be447b55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:47.541356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2762/5532] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:47.551398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:47.553431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:47.626929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1992f-cb74-4f95-a281-772f56e54e68 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:47.631734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:47.632742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:47.633289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:47.633760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:47.646188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:47.647641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd018-6d24-4ef2-a3b5-7065f9ef2930 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:47.658893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2771/5533] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:48.043170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:48.043472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:48.043757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:48.074040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] MFA Rules not processed for user `609cc7d1420848279d441e4d80b447ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:48.075930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:48.160933 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2763/5534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:48.173754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:48.174154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:48.174534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:48.197189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] MFA Rules not processed for user `609cc7d1420848279d441e4d80b447ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:48.198418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:48.209891 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2772/5535] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:48.218097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:48.219982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:48.299351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38644735-8e8b-47bd-902c-cb44432a30bd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:48.305736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:48.306531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:48.306824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:48.307097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:48.316886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:48.318476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:48.327935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2764/5536] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:49.306310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:49.318030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf669-07fc-4b8b-808d-15c5c1745d8a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:49.322767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:49.324056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:49.324234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:49.324810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] PATH_INFO: `/v3/users/609cc7d1420848279d441e4d80b447ec` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:49.326335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609cc7d1420848279d441e4d80b447ec)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:49.330051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:49.406987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609cc7d1420848279d441e4d80b447ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.420191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609cc7d1420848279d441e4d80b447ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.420191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609cc7d1420848279d441e4d80b447ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.420191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609cc7d1420848279d441e4d80b447ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.428374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81fb128d-2805-476e-b5a7-d30b6e346811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609cc7d1420848279d441e4d80b447ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.453071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2773/5537] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:49 2022] DELETE /identity/v3/users/609cc7d1420848279d441e4d80b447ec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:49.732800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:49.755797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebec26-fab3-4d46-8417-a029a4483868 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:49.829244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:49.830128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:49.830416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:49.830695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] PATH_INFO: `/v3/projects/19737338fb9f4d53a9353bfab097594a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:49.832178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19737338fb9f4d53a9353bfab097594a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:49.834314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:49.882604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19737338fb9f4d53a9353bfab097594a', 'request_id': 'req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.890669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19737338fb9f4d53a9353bfab097594a', 'request_id': 'req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.897662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19737338fb9f4d53a9353bfab097594a', 'request_id': 'req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.912659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] The token cache is being invalidate because project 19737338fb9f4d53a9353bfab097594a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:49.913357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.914422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b7c1506-ca05-4e6b-9b0f-5504e1cfa53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:49.916199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2765/5538] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:49 2022] DELETE /identity/v3/projects/19737338fb9f4d53a9353bfab097594a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:49.923017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf9db-8866-46e6-9928-571b0967fd69 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:49.923310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf9db-8866-46e6-9928-571b0967fd69 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:49.923779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccf9db-8866-46e6-9928-571b0967fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:49.941992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-edccf9db-8866-46e6-9928-571b0967fd69 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:49.943212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-edccf9db-8866-46e6-9928-571b0967fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:49.999371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:49.999780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.000159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.013744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2774/5539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:50.020150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:50.021963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:50.022649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.023264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.023569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.049467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:50.050680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:50.063858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2775/5540] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:50.065337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.075458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5188f6-05a3-42b3-8f9f-4d5a01a0ec1c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.081010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.082045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.082342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.082663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.083565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:50.084055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.086123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.089211 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2766/5541] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:50.100532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2776/5542] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:50.104854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.119839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d5ed-1d87-42bc-a403-cf70f778d65d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.126831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.127912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.128433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.129063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.130081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.133090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.153681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.155294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:50.179201 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2777/5543] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:50 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:10:50.182616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.263505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7312c2-76e6-4558-8a15-3126a34fd2c2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.269554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.270298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.270591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.270937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.271817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.273842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.276158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573326b-8ce4-460e-a23e-57ceca3dbaab None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.318920 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2778/5544] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:50 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:50.320426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.347052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4cbc-08ba-4b17-9b3d-15ac4f0e889a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.358540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.359481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.359959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.360408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.361576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.363361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.374408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.375426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.375722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.376116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.376859 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2779/5545] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:50.382079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.395582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6246-3fa5-4b82-aba4-72e0fc5997f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.401938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.403267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.403727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.404183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.406674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.408572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.426849 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2780/5546] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:50.428431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.444335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4d4d-b225-44b3-a583-aa4fe2a0e88e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:50.462741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:50.463661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.463948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.464984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] PATH_INFO: `/v3/projects/5c747cda9e5642ab862d2d78e431b9c9/users/25a1d869428b41bfa3c44213d824601c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.477541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.479159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe5ba2-b9b3-4227-bd83-f6d873239e40 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.486156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c747cda9e5642ab862d2d78e431b9c9, user_id=25a1d869428b41bfa3c44213d824601c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:50.489122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:50.499832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2767/5547] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:10:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:10:50.512182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2781/5548] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:50 2022] PUT /identity/v3/projects/5c747cda9e5642ab862d2d78e431b9c9/users/25a1d869428b41bfa3c44213d824601c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:50.524535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:50.524956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:50.525343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:50.602803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] MFA Rules not processed for user `25a1d869428b41bfa3c44213d824601c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:50.603687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:50.731599 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2768/5549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:50.880019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:50.881847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:51.033421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64e0ad-6dc2-4734-af70-a1738c7819a0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:51.054951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:51.056050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:51.057356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:51.057817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:51.069245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:51.071894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51faf0-056a-4f8e-bc62-d133c0f49371 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:51.115017 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2782/5550] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:51.481556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:51.649928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6806a0-6aa7-4009-8622-d921a004fe53 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:51.662530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:51.663603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:51.663893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:51.664168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] PATH_INFO: `/v3/users/25a1d869428b41bfa3c44213d824601c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:51.667133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a1d869428b41bfa3c44213d824601c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:51.671867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:51.792704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a1d869428b41bfa3c44213d824601c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:51.817821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a1d869428b41bfa3c44213d824601c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:51.819307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a1d869428b41bfa3c44213d824601c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:51.831958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a1d869428b41bfa3c44213d824601c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:51.845601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a1d869428b41bfa3c44213d824601c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:51.865753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:51.866351 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2769/5551] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:51 2022] DELETE /identity/v3/users/25a1d869428b41bfa3c44213d824601c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:51.866466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:51.866466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:51.904351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:51.910197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:52.086708 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2783/5552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:10:52.113808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:52.115817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:52.282261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef8e0-9cfd-4c33-9ce3-565fa7df7bb8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:52.286546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:52.287340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:52.287745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:52.288127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:52.317544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:52.319547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:52.332080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2770/5553] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:52.914483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:52.915934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:53.139690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca8ac7-4ecf-4c48-8bbf-a8fcb064e99e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:53.158447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:53.159943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:53.160525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:53.161281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:53.164484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:53.353553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:53.355446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba179fa-4c66-4665-af4c-2973446732fd service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:53.381975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2784/5554] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:10:54.044879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:54.046302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:54.082183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df453-3bbf-4b5f-8417-19dd60bb225f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:54.109695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:54.113591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:54.120357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:54.120962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] PATH_INFO: `/v3/projects/5c747cda9e5642ab862d2d78e431b9c9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:54.123357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c747cda9e5642ab862d2d78e431b9c9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:54.125403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:54.288226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c747cda9e5642ab862d2d78e431b9c9', 'request_id': 'req-bd4e70ea-2bd6-41df-8497-5d7479f95f28'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:54.304179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c747cda9e5642ab862d2d78e431b9c9', 'request_id': 'req-bd4e70ea-2bd6-41df-8497-5d7479f95f28'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:54.322091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c747cda9e5642ab862d2d78e431b9c9', 'request_id': 'req-bd4e70ea-2bd6-41df-8497-5d7479f95f28'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:54.354066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] The token cache is being invalidate because project 5c747cda9e5642ab862d2d78e431b9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:54.354390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:54.355096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd4e70ea-2bd6-41df-8497-5d7479f95f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:54.363995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2771/5555] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:10:54 2022] DELETE /identity/v3/projects/5c747cda9e5642ab862d2d78e431b9c9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:54.365716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:54.366232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:54.366387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:54.427989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:54.430365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:54.576914 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2785/5556] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:54.583807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:54.584146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:54.584378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:54.629070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:54.641511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:54.669304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:54.673039 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2772/5557] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:54.687159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab5d2e-28e4-46c7-9247-be76683086ce None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:54.704902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:54.707640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:54.708064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:54.708352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:54.710272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:54.712151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:54.715823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:54.749088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2786/5558] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:54.751229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:54.761914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce6a83-3fad-49db-8265-ab1b6be78117 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:54.784105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:54.784817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:54.787648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:54.788390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:54.789324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:54.798751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:54.885031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2773/5559] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:54 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:54.890107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:54.918211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea543-0e13-4a24-8527-2ea7a16e3efb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:55.119947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:55.120995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.121641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.122084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.122933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:55.125753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:55.181883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2787/5560] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:54 2022] POST /identity/v3/users => generated 282 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:55.187272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:55.203426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40b-e50f-4cb8-9e08-b6451eba7b82 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:55.249586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:55.256888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.257219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.260758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.261833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:55.273024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:55.295660 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2774/5561] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:55.299840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:55.325414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc2d52-6590-40d4-b728-b2a3becb1134 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:55.349197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:55.349891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.350220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.350499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.351226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:55.353675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce885d-bbf9-4457-9e4e-c1d33d950ccb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:55.380029 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2788/5562] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:55.384580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:55.400844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c60f7-02aa-4e12-a7d9-7fadabd7986e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:55.418089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:55.419202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.419668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.420104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] PATH_INFO: `/v3/projects/fcca174d670f4749a9fe4be13f7a7914/users/42bbfbdf14dd46cdbd136a202c7c987e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.485691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcca174d670f4749a9fe4be13f7a7914, user_id=42bbfbdf14dd46cdbd136a202c7c987e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:55.488610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:55.530385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2775/5563] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:55 2022] PUT /identity/v3/projects/fcca174d670f4749a9fe4be13f7a7914/users/42bbfbdf14dd46cdbd136a202c7c987e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:55.544857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.545210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.545500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.628796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] MFA Rules not processed for user `42bbfbdf14dd46cdbd136a202c7c987e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:55.634591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:55.760347 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2789/5564] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:55.765249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:55.915971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc6451-f114-4448-88e7-c532579f74bd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:55.935790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:55.937969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:55.939453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:55.939936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:55.940819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:55.942958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:56.057955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:56.058680 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2776/5565] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:55 2022] POST /identity/v3/projects => generated 367 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:56.086148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454b29-421a-448d-b218-d8fa1744f47f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:56.384635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:56.385322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:56.386892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:56.387344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:56.389007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:56.394832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:56.466412 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2790/5566] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:56 2022] POST /identity/v3/users => generated 290 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:56.469159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:56.483431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b628c-8c4a-4b22-b38a-c79dcfea86a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:56.503123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:56.509660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:56.510234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:56.510957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:56.512574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:56.520279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:56.563533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2777/5567] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:10:56.568131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:56.582386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683533-6359-45ab-994d-369b73ba7c89 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:56.609414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:56.610640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:56.611090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:56.611541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] PATH_INFO: `/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c/users/84f7411413c742a481f21ba2c820db6d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.115057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc1ee03f4714eb8a2dfea25d76c5c0c, user_id=84f7411413c742a481f21ba2c820db6d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.121732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.166680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2791/5568] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:56 2022] PUT /identity/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c/users/84f7411413c742a481f21ba2c820db6d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:57.171470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.189182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cdc14-7055-4a5f-8a4a-4050ea0eddcc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.325263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.326105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.326535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.326821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.327613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.329255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f6076-c018-46de-a15f-d3da124c0cb9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.349520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2778/5569] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:10:57.353800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.368179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001dda8-0224-44d5-bda0-af3462815e48 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.386372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.387287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.392784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.396688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] PATH_INFO: `/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c/users/84f7411413c742a481f21ba2c820db6d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.404271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc1ee03f4714eb8a2dfea25d76c5c0c, user_id=84f7411413c742a481f21ba2c820db6d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.414939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.473978 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2792/5570] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:57 2022] PUT /identity/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c/users/84f7411413c742a481f21ba2c820db6d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:57.475199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d194ed-3536-4410-be25-580233be496d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.475672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d194ed-3536-4410-be25-580233be496d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.475947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d194ed-3536-4410-be25-580233be496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.543107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a3d194ed-3536-4410-be25-580233be496d None None] MFA Rules not processed for user `84f7411413c742a481f21ba2c820db6d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:10:57.547224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a3d194ed-3536-4410-be25-580233be496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:57.705933 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2779/5571] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:10:57.711116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.724821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d51c66-5728-43ff-998b-4853b92306da admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.729838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.731320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.731925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.732399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.736034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.738005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.765671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d194ed-3536-4410-be25-580233be496d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.771720 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2793/5572] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/roles => generated 235 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:57.775974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d194ed-3536-4410-be25-580233be496d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.797790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.798818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.799310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.799984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.800933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.803013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.841070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2780/5573] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/roles => generated 235 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:57.845815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.856815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71658-0dec-4d83-91fc-1ba290ffb93d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.866071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.867308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.867724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.868017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.875469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.882173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.915997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.922727 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2794/5574] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/roles => generated 234 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:57.933377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0007a4-e6ef-4358-8bd6-b747dda52dda tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:57.947989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:57.949575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:57.950039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:57.950491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:57.951548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:57.953596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:57.976972 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2781/5575] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/domains => generated 276 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:57.981028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:57.999521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbd341-668e-469f-870a-a02f50ac4674 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.097088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.098329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.099056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.099524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.100404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.102528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.167462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.168294 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2795/5576] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:10:57 2022] POST /identity/v3/projects => generated 400 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:58.185005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095d60-b592-4014-8e32-d8e84f1909ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.300321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.301396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.303059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.303562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.304791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.306027 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:58.306027 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:10:58.306027 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:10:58.308830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.332421 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2782/5577] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:10:58 2022] POST /identity/v3/groups => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:58.336832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.353872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba0d-6d7f-4ac6-a315-b01ca472ca30 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.362509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.363205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.363496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.363775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.364561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.366446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.403077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.414147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2796/5578] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:10:58 2022] POST /identity/v3/roles => generated 234 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:58.416078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa734d42-d4e6-48f6-910d-aa596525f99f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.422681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.423744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.424367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.424843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.425887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.432887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.487140 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2783/5579] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:10:58 2022] POST /identity/v3/users => generated 442 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:58.489080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.502199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa71e5-a05b-4caf-aa68-45d477ab5220 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.528115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.531506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.533608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.534137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.535652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.538244 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:58.538244 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:10:58.538244 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:10:58.541850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.574535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2797/5580] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:10:58 2022] POST /identity/v3/roles => generated 270 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:58.575636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.591736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016cb0f-541f-4d3f-a161-ef0df3634d1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.607085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.608002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.608325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.608636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/d5d0b6a90dd6436c878a9321d70b4d2a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.644472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=d5d0b6a90dd6436c878a9321d70b4d2a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.651376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.691354 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2784/5581] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:58 2022] PUT /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/d5d0b6a90dd6436c878a9321d70b4d2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:10:58.697687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:58.716604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417723a-1a6c-4cbc-bd1f-d5ed6fc3375a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:58.789802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:58.790805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:58.791905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:58.792403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:58.793461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Adding query filter params (scope.project.id=cccbd309a88d4da3bfda0c020aaf3711, user.id=b74dfb9531e84e19a8a206e10777e605) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:10:58.793950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:58.795150 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:58.795150 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:10:58.795150 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:10:58.796752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:58.989417 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2798/5582] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:10:58 2022] GET /identity/v3/role_assignments?scope.project.id=cccbd309a88d4da3bfda0c020aaf3711&user.id=b74dfb9531e84e19a8a206e10777e605&effective => generated 228 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:10:58.993094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:59.005510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c58b-ca49-45b0-a4c9-a153ffdb6c51 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:59.012848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:59.015035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:59.016088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:59.016594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/d5d0b6a90dd6436c878a9321d70b4d2a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:59.020422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=d5d0b6a90dd6436c878a9321d70b4d2a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:59.033205 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:59.033205 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:10:59.033205 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:10:59.035563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:59.044503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role d5d0b6a90dd6436c878a9321d70b4d2a was removed from user b74dfb9531e84e19a8a206e10777e605 on project cccbd309a88d4da3bfda0c020aaf3711. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:59.045066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:59.046022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:59.086520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2785/5583] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:10:58 2022] DELETE /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/d5d0b6a90dd6436c878a9321d70b4d2a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:59.090595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:59.092342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:59.114807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4869-2ba1-4266-bcba-41fa9e23cd69 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:59.342490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:59.343901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:59.344183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:59.350287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d5d0b6a90dd6436c878a9321d70b4d2a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:59.353562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d5d0b6a90dd6436c878a9321d70b4d2a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:59.364264 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:59.364264 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:10:59.364264 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:10:59.365725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:59.477810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role d5d0b6a90dd6436c878a9321d70b4d2a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:10:59.478891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:59.490638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:10:59.496169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2799/5584] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:10:59 2022] DELETE /identity/v3/roles/d5d0b6a90dd6436c878a9321d70b4d2a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:59.503560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:59.521703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb49ad9-d8e3-412b-b43f-1ac63c25655f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:59.649525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:59.650685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:59.651238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:59.652783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/fbb77232f2a84e089e48537b314b2ebc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:59.658330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=fbb77232f2a84e089e48537b314b2ebc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:59.661657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:59.691206 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2786/5585] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:10:59 2022] PUT /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/fbb77232f2a84e089e48537b314b2ebc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:10:59.697040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:59.701115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:10:59.734917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24d24-e6f1-41d8-acc2-1a3f018af159 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:10:59.851288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:10:59.852475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:10:59.852877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:10:59.853263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:10:59.859894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:10:59.862349 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:10:59.862349 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:10:59.862349 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:10:59.864204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:10:59.957237 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2800/5586] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:10:59 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 521 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:10:59.959351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:10:59.973198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2999a6-9108-444d-aa63-5e67bd210db3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:00.144547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:00.145348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:00.145994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:00.146483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:00.147547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Adding query filter params (scope.project.id=cccbd309a88d4da3bfda0c020aaf3711, user.id=b74dfb9531e84e19a8a206e10777e605) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:00.147975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:00.149212 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:00.149212 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:00.149212 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:00.154278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:00.257210 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2787/5587] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:10:59 2022] GET /identity/v3/role_assignments?scope.project.id=cccbd309a88d4da3bfda0c020aaf3711&user.id=b74dfb9531e84e19a8a206e10777e605&effective => generated 1061 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:00.258498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:00.272751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e6325-6308-46c0-86a4-5840e70d1381 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:00.289192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:00.290331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:00.290638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:00.290926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:00.297838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:00.298932 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:00.298932 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:00.298932 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:00.299836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:00.317948 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2801/5588] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:00 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:00.319225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:00.336751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5fa2-8b4b-40c1-a43b-92158bcbb9ef tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:00.474367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:00.475211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:00.475621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:00.476021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:00.477789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Adding query filter params (scope.project.id=cccbd309a88d4da3bfda0c020aaf3711, user.id=b74dfb9531e84e19a8a206e10777e605) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:00.481393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:00.483582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:00.618921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2788/5589] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:11:00 2022] GET /identity/v3/role_assignments?scope.project.id=cccbd309a88d4da3bfda0c020aaf3711&user.id=b74dfb9531e84e19a8a206e10777e605&effective => generated 577 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:00.623243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:00.638870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254576-0c62-4cad-8965-7859f80b46c2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:00.653005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:00.653951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:00.654249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:00.654536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:00.656423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:00.658376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:00.741301 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a.: keystone.exception.ImpliedRoleNotFound: fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a. Apr 02 21:11:00.743782 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2802/5590] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:00 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 137 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:00.747739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:00.763516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e656f-b5b8-4971-a4cb-cececb12e3b2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:00.785314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:00.786244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:00.786533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:00.786817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/fbb77232f2a84e089e48537b314b2ebc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:00.801256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=fbb77232f2a84e089e48537b314b2ebc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:00.807379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:00.835175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role fbb77232f2a84e089e48537b314b2ebc was removed from user b74dfb9531e84e19a8a206e10777e605 on project cccbd309a88d4da3bfda0c020aaf3711. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:00.835758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:00.836917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:00.888873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2789/5591] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:00 2022] DELETE /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/fbb77232f2a84e089e48537b314b2ebc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:00.895353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:00.898324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:00.922417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edba7f-69ac-40cc-93b0-274348a5e458 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.082599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.083417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.083718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.084002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.084907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.086737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.117360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2803/5592] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:00 2022] POST /identity/v3/roles => generated 272 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:01.119693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.144319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ff5f9-6926-4a92-8ca2-f43651e56d3c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.155665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.156364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.156815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.157105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.157851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Adding query filter params (domain_id=925c170f3ac44a899e05a093596bb676) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:01.158221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.159251 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:01.159251 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:01.159251 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:01.160150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.181710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2790/5593] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Apr 2 21:11:01 2022] GET /identity/v3/roles?domain_id=925c170f3ac44a899e05a093596bb676 => generated 409 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:01.183368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.197353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2980-0b7d-45f4-9c4e-98b5802ccbcf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.205046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.206221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.206686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.207139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/a4c3c8adfdf54f4f893af7401c134eb3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.208695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a4c3c8adfdf54f4f893af7401c134eb3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.210777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.283539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role a4c3c8adfdf54f4f893af7401c134eb3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:01.283989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:01.284887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:01.291892 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2804/5594] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:01 2022] DELETE /identity/v3/roles/a4c3c8adfdf54f4f893af7401c134eb3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:01.292119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.293890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:01.340222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271b95c-fe17-4af4-8bd8-ef51337e2f8b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.485879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.486570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.486922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.487202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.488017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Adding query filter params (domain_id=925c170f3ac44a899e05a093596bb676) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:01.488316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.506648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.539471 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2791/5595] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Apr 2 21:11:01 2022] GET /identity/v3/roles?domain_id=925c170f3ac44a899e05a093596bb676 => generated 148 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:01.543345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.557363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da005e87-9995-42d3-9644-17b5e4606d5c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.579135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.582575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.584986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.586653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/a4c3c8adfdf54f4f893af7401c134eb3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.633073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:01.642708 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Could not find role: a4c3c8adfdf54f4f893af7401c134eb3.: keystone.exception.RoleNotFound: Could not find role: a4c3c8adfdf54f4f893af7401c134eb3. Apr 02 21:11:01.649401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2805/5596] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:01 2022] DELETE /identity/v3/roles/a4c3c8adfdf54f4f893af7401c134eb3 => generated 110 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:01.650331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.665033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163214d7-7752-43c7-8ac8-28d310be20d9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.687454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.688718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.690571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.691451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.700001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=925c170f3ac44a899e05a093596bb676, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.703424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.728966 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2792/5597] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:01 2022] PUT /identity/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:01.733857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.746470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23a334-46ec-41e2-9fcb-a8b93df7f5de tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.819412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.820283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.820664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.820901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.825978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=925c170f3ac44a899e05a093596bb676, group_id=266bf314fee94a0db48817b0848b7556)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.827246 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:01.827246 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:01.827246 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:01.829181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.856637 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2806/5598] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Apr 2 21:11:01 2022] GET /identity/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles => generated 409 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:01.857176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.868412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382511e-b344-4ce6-9307-9dd626696a7e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.873109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.874094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.874377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.874656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.876915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=925c170f3ac44a899e05a093596bb676, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.878157 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:01.878157 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:01.878157 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:01.880065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.891139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2793/5599] 10.222.0.18 () {58 vars in 1464 bytes} [Sat Apr 2 21:11:01 2022] HEAD /identity/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:01.892675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.905803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073aba30-acc4-42e4-885b-608b539f1270 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:01.913285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:01.914795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:01.916032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:01.916615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:01.919466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=925c170f3ac44a899e05a093596bb676, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:01.921369 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:01.921369 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:01.921369 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:01.923920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:01.935457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role 35376810ac7042d19d82c9a992b4de85 was removed from group 266bf314fee94a0db48817b0848b7556 on domain 925c170f3ac44a899e05a093596bb676. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:01.935912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:01.937086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:01.957995 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2807/5600] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:01 2022] DELETE /identity/v3/domains/925c170f3ac44a899e05a093596bb676/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:01.964890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:01.972800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:02.013058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfcaa7-4e49-4e94-88a9-8a88388bb085 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:02.096469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:02.097419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:02.097781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:02.098098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:02.100539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:02.103563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:02.125285 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2794/5601] 10.222.0.18 () {60 vars in 1485 bytes} [Sat Apr 2 21:11:01 2022] PUT /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:02.129613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:02.144069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7fbb4-07c6-4764-b2dd-65092886165d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:02.296955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:02.303045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:02.304418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:02.304999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:02.310751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cccbd309a88d4da3bfda0c020aaf3711, group_id=266bf314fee94a0db48817b0848b7556)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:02.315787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f6fb8-5a4c-4117-b826-899dcd5ec577 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:02.354857 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2808/5602] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Apr 2 21:11:02 2022] GET /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles => generated 410 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:02.356917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:02.378180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ab15-564d-46e5-9591-be61c73e69d2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:02.393295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:02.397108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:02.397438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:02.397737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/groups/266bf314fee94a0db48817b0848b7556/users/b74dfb9531e84e19a8a206e10777e605` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:02.404034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=266bf314fee94a0db48817b0848b7556, user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:02.407559 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:02.407559 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:02.407559 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:02.414131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:02.512119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2795/5603] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:11:02 2022] PUT /identity/v3/groups/266bf314fee94a0db48817b0848b7556/users/b74dfb9531e84e19a8a206e10777e605 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:02.517018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212552-81f6-4178-9c37-1aef91110189 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:02.517316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212552-81f6-4178-9c37-1aef91110189 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:02.517658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212552-81f6-4178-9c37-1aef91110189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:02.630165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-54212552-81f6-4178-9c37-1aef91110189 None None] MFA Rules not processed for user `b74dfb9531e84e19a8a206e10777e605`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:02.632692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-54212552-81f6-4178-9c37-1aef91110189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:02.867774 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2809/5604] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3257 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:02.872558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.036001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76245-f397-4eaa-a0de-d6c3065cba0f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.051712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.053078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.053563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.054292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.057950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.071526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.087557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2796/5605] 10.222.0.18 () {58 vars in 1467 bytes} [Sat Apr 2 21:11:02 2022] HEAD /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:03.091929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54212552-81f6-4178-9c37-1aef91110189 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.112359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54212552-81f6-4178-9c37-1aef91110189 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.141295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.143560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.147663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.149049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.154893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.171659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.193634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role 35376810ac7042d19d82c9a992b4de85 was removed from group 266bf314fee94a0db48817b0848b7556 on project cccbd309a88d4da3bfda0c020aaf3711. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:03.193912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:03.197521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:03.220131 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2810/5606] 10.222.0.18 () {58 vars in 1469 bytes} [Sat Apr 2 21:11:03 2022] DELETE /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:03.225011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.226885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:03.264233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4ea36-a2b4-4cec-92f0-50dcf891d9ec tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.387698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.389946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.390241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.390526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/groups/266bf314fee94a0db48817b0848b7556/users/b74dfb9531e84e19a8a206e10777e605` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.392946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=266bf314fee94a0db48817b0848b7556, user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.396991 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:03.396991 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:03.396991 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:03.396991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.415185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:03.476046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2797/5607] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:11:03 2022] DELETE /identity/v3/groups/266bf314fee94a0db48817b0848b7556/users/b74dfb9531e84e19a8a206e10777e605 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:03.484039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.509407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1073db5-102e-46e6-8013-821c90514d3a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.686987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.688323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.689058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.689584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.692801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.695065 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:03.695065 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:03.695065 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:03.697902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.728779 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2811/5608] 10.222.0.18 () {60 vars in 1380 bytes} [Sat Apr 2 21:11:03 2022] PUT /identity/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:03.732822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.765577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f5f1-1983-49c7-9346-84ee38b40290 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.782940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.784146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.784146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.784355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.787129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=266bf314fee94a0db48817b0848b7556)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.788156 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:03.788156 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:03.788156 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:03.789082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.821782 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2798/5609] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:11:03 2022] GET /identity/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles => generated 375 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:03.826189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.842384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ac475-cbb5-407c-beeb-656f46068b40 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.864366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.865743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.867646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.868215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.872528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.874922 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:03.874922 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:03.874922 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:03.876296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.886590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2812/5610] 10.222.0.18 () {58 vars in 1362 bytes} [Sat Apr 2 21:11:03 2022] HEAD /identity/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:03.891169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.904687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9df3-7959-4821-8531-9dce9a9b4778 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.913774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.915908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.916997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.917252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.921685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=266bf314fee94a0db48817b0848b7556, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.923844 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:03.923844 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:03.923844 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:03.926439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:03.947158 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2799/5611] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Apr 2 21:11:03 2022] DELETE /identity/v3/system/groups/266bf314fee94a0db48817b0848b7556/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:03.952423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:03.966959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da22c7-1cf0-43d2-88e0-f798986f73b6 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:03.973301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:03.974386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:03.974684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:03.975020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:03.977843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=925c170f3ac44a899e05a093596bb676, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:03.981556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.009287 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2813/5612] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Apr 2 21:11:03 2022] PUT /identity/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.010790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.026054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb31c7-e113-40da-abf5-039968699ed2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.131365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.132262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.132652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.132942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.142051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=925c170f3ac44a899e05a093596bb676, user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.143117 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:04.143117 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:04.143117 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:04.144963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.163395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2800/5613] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Apr 2 21:11:04 2022] GET /identity/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles => generated 408 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:04.168348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.190810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1217-8241-4957-858a-cabbafd529c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.198615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.199654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.200015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.200369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.210721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=925c170f3ac44a899e05a093596bb676, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.216446 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:04.216446 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:04.216446 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:04.221516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.231546 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2814/5614] 10.222.0.18 () {58 vars in 1461 bytes} [Sat Apr 2 21:11:04 2022] HEAD /identity/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.235733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.247765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06615afe-acfb-45ee-9d16-7b546b90d133 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.259131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.261015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.261566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.262065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.266130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=925c170f3ac44a899e05a093596bb676, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.269394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.293356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role 35376810ac7042d19d82c9a992b4de85 was removed from user b74dfb9531e84e19a8a206e10777e605 on domain 925c170f3ac44a899e05a093596bb676. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:04.293960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:04.295089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:04.330809 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2801/5615] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Apr 2 21:11:04 2022] DELETE /identity/v3/domains/925c170f3ac44a899e05a093596bb676/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.335770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.339736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:04.374996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5504b-dbe4-4357-ade8-5b2a2dc0c788 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.503083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.504932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.505972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.506502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.511042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.516324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.548757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2815/5616] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:04 2022] PUT /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.553126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.568413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e4d9-82c8-4eaf-8789-5ba38c525e1f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.681079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.682295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.682796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.683252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.685598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.691122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.708136 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2802/5617] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Apr 2 21:11:04 2022] GET /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles => generated 409 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:04.711674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.727368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95b7d5-bc3e-4d4b-ac49-7714415d9323 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.735091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.736140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.736275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.736609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.742318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.747985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.765694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.766141 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2816/5618] 10.222.0.18 () {58 vars in 1464 bytes} [Sat Apr 2 21:11:04 2022] HEAD /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.784125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606aa9d9-807e-4931-a3db-d9cede8d7523 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:04.790979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:04.792250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:04.792885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:04.793376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:04.796761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cccbd309a88d4da3bfda0c020aaf3711, user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:04.799913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:04.807114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role 35376810ac7042d19d82c9a992b4de85 was removed from user b74dfb9531e84e19a8a206e10777e605 on project cccbd309a88d4da3bfda0c020aaf3711. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:04.807758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:04.808917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:04.833801 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2803/5619] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:04 2022] DELETE /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:04.848140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:04.851012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:04.880044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308a076-a668-4750-ad2a-fa0f450a2281 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.038254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.039296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.039595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.039881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.043716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.049579 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.049579 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:05.049579 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:05.050493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.062636 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2817/5620] 10.222.0.18 () {60 vars in 1377 bytes} [Sat Apr 2 21:11:04 2022] PUT /identity/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:05.064012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.089492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc581e92-f396-4835-bf1a-7748e1816113 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.104260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.105226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.105615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.106007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.107711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.109819 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.109819 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:05.109819 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:05.111204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.140141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.140400 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2804/5621] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:11:05 2022] GET /identity/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:05.151966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cbf0-e8d7-4c74-baee-0f62d76ad9d4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.180420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.182002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.182718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.183270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.188410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.192616 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.192616 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:05.192616 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:05.197980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.209825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.211489 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2818/5622] 10.222.0.18 () {58 vars in 1359 bytes} [Sat Apr 2 21:11:05 2022] HEAD /identity/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:05.225837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed76e6-e7cd-4acb-bd32-2bf2f95eb4c1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.240655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.243553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.244255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.248958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.258326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=b74dfb9531e84e19a8a206e10777e605, role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.262363 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.262363 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:05.262363 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:05.267528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.290264 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2805/5623] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Apr 2 21:11:05 2022] DELETE /identity/v3/system/users/b74dfb9531e84e19a8a206e10777e605/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:05.291131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.313531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d734-3f59-4b99-8659-3af0f71f8493 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.324260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.324260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.324260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.324826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.324826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.327478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.358024 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2819/5624] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:05 2022] POST /identity/v3/roles => generated 270 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:05.365407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.379778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701bb1-bb4d-44fe-a502-52d711b8f8ac tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.386837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.388156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.388762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.389873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.390961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.392256 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.392256 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:05.392256 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:05.393638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.425658 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2806/5625] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:05 2022] POST /identity/v3/roles => generated 269 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:05.425981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.446282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ce3a1-ccfa-4601-aaf6-383f28176d65 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.453584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.454665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.459317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.459317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/f3feec54e9304b2aafc6a59c3c1d181a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.463211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=f3feec54e9304b2aafc6a59c3c1d181a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.468631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.523169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2820/5626] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:05 2022] PUT /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/f3feec54e9304b2aafc6a59c3c1d181a => generated 530 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:05.529073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.559685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05014-8c25-4bf0-8d50-a6a2afa6824e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.655835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.656733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.657124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.657508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.658348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.660222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.684520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2807/5627] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:05 2022] POST /identity/v3/domains => generated 277 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:05.689804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.720099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75c46-4b01-4c35-a48c-8b275b1d601a tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.849827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.850806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.851308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.851889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.853555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.856533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:05.877480 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2821/5628] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:05 2022] POST /identity/v3/roles => generated 270 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:05.882543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:05.902814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7cdaa-a1de-410a-b586-ecf4ebab0dc4 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:05.918988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:05.925627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:05.926523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:05.928710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/eb453642f11b4bedb3903e09b75a0803` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:05.988418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=eb453642f11b4bedb3903e09b75a0803)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:05.988418 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:05.988418 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:05.988418 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:05.988418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:06.013605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2808/5629] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:05 2022] PUT /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/eb453642f11b4bedb3903e09b75a0803 => generated 531 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:06.015355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:06.032680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25848c2e-8daa-46e5-ad8c-2c7061c25293 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:06.166403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:06.167571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:06.168045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:06.168517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:06.172779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:06.174929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:06.217043 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2822/5630] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:06 2022] PUT /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/35376810ac7042d19d82c9a992b4de85 => generated 525 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:06.222132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:06.248195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a545b-2280-4c36-84a3-55ea3ef428e8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:06.390085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:06.391025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:06.391308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:06.391583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/35376810ac7042d19d82c9a992b4de85/implies/e8ae76c2a6d84b5f8da3d163208eb2e7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:06.394921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=35376810ac7042d19d82c9a992b4de85, implied_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:06.396662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:06.459256 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] e8ae76c2a6d84b5f8da3d163208eb2e7 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: e8ae76c2a6d84b5f8da3d163208eb2e7 cannot be an implied roles. Apr 02 21:11:06.464596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2809/5631] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:06 2022] PUT /identity/v3/roles/35376810ac7042d19d82c9a992b4de85/implies/e8ae76c2a6d84b5f8da3d163208eb2e7 => generated 116 bytes in 243 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:06.466295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:06.488112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef205-24a1-409c-823b-5b3d6581f931 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:06.503825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:06.504835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:06.505560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:06.506965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:06.512041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:06.518238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:06.543850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2823/5632] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:06 2022] DELETE /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:06.544072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:06.567258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b8ad-d4fe-4c77-9cd0-8ea20c007c78 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:06.705249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:06.706321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:06.706708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:06.707229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/eb453642f11b4bedb3903e09b75a0803` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:06.711799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=eb453642f11b4bedb3903e09b75a0803)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:06.713097 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:06.713097 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:06.713097 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:06.715638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:06.739547 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2810/5633] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:06 2022] DELETE /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/eb453642f11b4bedb3903e09b75a0803 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:06.743338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:06.761546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543aebd-944f-44a7-946b-dfb0cf2a0853 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:06.918704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:06.919953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:06.921187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:06.921665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/eb453642f11b4bedb3903e09b75a0803` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:06.923388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=eb453642f11b4bedb3903e09b75a0803)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:06.925716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:07.052677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role eb453642f11b4bedb3903e09b75a0803 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:07.053278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.060805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.069779 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2824/5634] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:06 2022] DELETE /identity/v3/roles/eb453642f11b4bedb3903e09b75a0803 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:07.075492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:07.077649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:07.110098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53012b-ff50-4d51-b7b7-fba3a1bfb217 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:07.335962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:07.336877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:07.337163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:07.337442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/451052580b624fdcad1843b4213a1f5a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:07.360606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=451052580b624fdcad1843b4213a1f5a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:07.362162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:07.391729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.392528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.460120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.461612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.469034 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2811/5635] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:07 2022] PATCH /identity/v3/domains/451052580b624fdcad1843b4213a1f5a => generated 278 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:07.473626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:07.511989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e99ae-d525-4040-97c4-9608652f2235 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:07.738419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:07.739714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:07.740219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:07.740778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/451052580b624fdcad1843b4213a1f5a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:07.755606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=451052580b624fdcad1843b4213a1f5a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:07.757860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:07.791846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.796714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '451052580b624fdcad1843b4213a1f5a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.914060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.923581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.937706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.953074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] The token cache is being invalidate because project 451052580b624fdcad1843b4213a1f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:07.953444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.955182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.975603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.983834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.984687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '451052580b624fdcad1843b4213a1f5a', 'request_id': 'req-c53c4938-e394-4b94-9cc2-e6935f06c72e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:07.996997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:07.997184 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2825/5636] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:07 2022] DELETE /identity/v3/domains/451052580b624fdcad1843b4213a1f5a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:07.998298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:08.024071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f457dcb-6653-4ded-9974-706978bcd64d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:08.125917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:08.126939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:08.127229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:08.127511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/f3feec54e9304b2aafc6a59c3c1d181a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:08.129501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e8ae76c2a6d84b5f8da3d163208eb2e7, implied_role_id=f3feec54e9304b2aafc6a59c3c1d181a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:08.131353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:08.163706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:08.165503 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2812/5637] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:07 2022] DELETE /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7/implies/f3feec54e9304b2aafc6a59c3c1d181a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:08.166589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:08.191887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c4938-e394-4b94-9cc2-e6935f06c72e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:08.329390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:08.330302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:08.330595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:08.330879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/f3feec54e9304b2aafc6a59c3c1d181a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:08.337458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f3feec54e9304b2aafc6a59c3c1d181a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:08.339133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:08.460760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role f3feec54e9304b2aafc6a59c3c1d181a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:08.461059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:08.462015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:08.464401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2826/5638] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:08 2022] DELETE /identity/v3/roles/f3feec54e9304b2aafc6a59c3c1d181a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:08.470177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:08.471301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:08.518069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe67b2e-ef47-4da4-904e-c610d4f844c7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:08.669806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:08.670750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:08.671041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:08.671326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:08.675417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=e8ae76c2a6d84b5f8da3d163208eb2e7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:08.676500 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:08.676500 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:08.676500 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:08.677457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:08.734204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role e8ae76c2a6d84b5f8da3d163208eb2e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:08.734933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:08.735938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:08.739600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2813/5639] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:08 2022] DELETE /identity/v3/roles/e8ae76c2a6d84b5f8da3d163208eb2e7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:08.743995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:08.761926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de5f89-b32a-4094-98fa-8711f7e737a8 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:08.883977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:08.886505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:08.888361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:08.888853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:08.892483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:08.895025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:08.957431 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2827/5640] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:08 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 521 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:08.961238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:08.962723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:08.992712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d298-2edf-4291-99a3-afa7e6e732cf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.142549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.143515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.143809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.144092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.146364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.147433 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:09.147433 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:09.147433 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:09.148343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.149376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.150285 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:09.150285 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:09.150285 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:09.151116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.168976 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2814/5641] 10.222.0.18 () {58 vars in 1344 bytes} [Sat Apr 2 21:11:08 2022] HEAD /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:09.175601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.198580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a621188-4ee8-44a4-85fa-9f183b792b3d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.215110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.216626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.216917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.217845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.223917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.227750 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:09.227750 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:09.227750 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:09.229857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.251768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2828/5642] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:11:09 2022] GET /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 521 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:09.255094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.265386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ff4bc-c46e-4452-951f-ad93890b7939 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.280879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.281929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.282118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.282404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.285439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.287068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.306953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2815/5643] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:09 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:09.311677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.327707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf714ac-1cac-4693-84fa-980a5499bb00 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.459160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.460131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.460390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.460782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.462507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.464143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.493521 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a.: keystone.exception.ImpliedRoleNotFound: fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a. Apr 02 21:11:09.494806 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2829/5644] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:11:09 2022] GET /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 137 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:11:09.499654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.522593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394efc13-3723-46f4-b67a-776ceffa26cc tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.530934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.531883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.532172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.532477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.534600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.536301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.584163 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1d4571f1-d07a-4aec-bee2-81108135cef9 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a.: keystone.exception.ImpliedRoleNotFound: fbb77232f2a84e089e48537b314b2ebc does not imply d5f2c48328ac4e8d99b26802fe20ff1a. Apr 02 21:11:09.589423 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2816/5645] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:09 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 137 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:09.590624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.610035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf23a-845b-4c59-9a02-f90ed0d94d3b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.622414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.623900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.624196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.624498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.626322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.628560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.650846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.651393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.652091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.697041 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2830/5646] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:09 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 521 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:09.705741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.708762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] MFA Rules not processed for user `d7ebf8694d674ee38bb5f58a3687a415`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:09.712643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:09.847875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad672b0-b81b-4dfc-8fdc-6ece029f6618 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:09.854980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:09.855585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:09.856198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:09.856545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:09.860180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:09.863456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:09.898776 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2817/5647] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:09.913609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2831/5648] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:09 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba => generated 520 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:09.918019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:09.934010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e630390-e01e-4b41-bfae-6ad768fd4e73 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:10.088114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:10.088114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:10.088114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:10.088503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:10.089885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d49d0379f1d64223922508f3534f85ba, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:10.091554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:10.146369 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2818/5649] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:09 2022] PUT /identity/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85 => generated 519 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:10.148956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:10.160986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152d037-9f77-47ed-9240-21390c202582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:10.308323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:10.309140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:10.309303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:10.309589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:10.310509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:10.312240 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:10.312240 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:10.312240 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:10.313188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:10.345120 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2832/5650] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:11:10 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:10.349352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:10.368918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f637-0e9c-4164-a783-f1f819d8396e tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:10.377379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:10.378204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:10.378539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:10.378789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:10.381339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=d49d0379f1d64223922508f3534f85ba, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:10.383263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:10.417325 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2819/5651] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:10 2022] DELETE /identity/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:10.421686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:10.437962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b003-a5ac-48cb-b279-22caa1fa5a88 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:10.634888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:10.636106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:10.636658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:10.637145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:10.639847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:10.641985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:10.662738 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2833/5652] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:10 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:10.667236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:10.696322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83b72-8a51-4fbe-80c0-ac3421f126a1 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:10.850675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:10.851626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:10.851921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:10.852211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:10.865428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:10.872099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:10.890632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2820/5653] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:10 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:10.895864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:10.911337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c785bb7-fd27-49f9-9f5d-ab316e3d5a94 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.070489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.071197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.071491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.071776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.075873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.078673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.094893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2834/5654] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:10 2022] GET /identity/v3/roles => generated 2322 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:11.099316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.110333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14020b-e903-4f1f-ad5e-23f6c8a50204 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.129543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.130041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.130496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.130923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.131824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.137173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.171671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2821/5655] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:11 2022] POST /identity/v3/roles => generated 235 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:11.175575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.188338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131407cf-e143-40a9-802a-12aca467835f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.197510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.202733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.203292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.203760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/a597e6bd8c694338aa55a9d206a92851` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.206169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:update_role(role_id=a597e6bd8c694338aa55a9d206a92851)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.208125 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:11.208125 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:11.208125 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:11.209467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.284185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2835/5656] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 21:11:11 2022] PATCH /identity/v3/roles/a597e6bd8c694338aa55a9d206a92851 => generated 237 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:11.287753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.302043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e066f7b-a7fd-482f-bce5-ec4aeb901a2b tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.320290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.321426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.321941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.322410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/a597e6bd8c694338aa55a9d206a92851` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.362885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:get_role(role_id=a597e6bd8c694338aa55a9d206a92851)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.364898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.366877 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2822/5657] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:11:11 2022] GET /identity/v3/roles/a597e6bd8c694338aa55a9d206a92851 => generated 237 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:11.370597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.396775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d83-6b61-4fce-ab62-72411c43dfa2 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.405827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.406765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.407060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.407937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.408754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.418532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.448204 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2836/5658] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:11 2022] GET /identity/v3/roles => generated 2550 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:11.451681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.463893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8be7-c829-4e83-864e-02a0e2ac0582 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.498255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.499951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.500348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.501400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/a597e6bd8c694338aa55a9d206a92851` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.503874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a597e6bd8c694338aa55a9d206a92851)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.506354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.545789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.548232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:11.657977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role a597e6bd8c694338aa55a9d206a92851 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:11.659399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:11.662533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:11.667984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2823/5659] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:11 2022] DELETE /identity/v3/roles/a597e6bd8c694338aa55a9d206a92851 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:11.677895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:11.680474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:11.688646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf566f6-6644-419a-86db-2770ae800983 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.815573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.816263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.816599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.816886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.818882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:11.881204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b133e-f7a1-4dd8-bce9-ddb03badfbe3 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:11.900544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:11.901506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:11.902011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:11.902207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:11.906998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.908704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.960014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:11.961482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:11.984797 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2837/5660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:11:12.005913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2824/5661] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:11 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 521 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:12.009973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.028160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9573d6f-d321-4c89-8884-90ead7b14fb7 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:12.176866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:12.177917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:12.178248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:12.178499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:12.185272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:12.190875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:12.245574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2838/5662] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:12 2022] PUT /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba => generated 520 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:12.251309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.291430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de6a4c-4132-40e2-9c76-cf4731c6da32 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:12.485551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:12.485551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:12.485551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:12.495485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:12.495485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d49d0379f1d64223922508f3534f85ba, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:12.495485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:12.582054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2825/5663] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Apr 2 21:11:12 2022] PUT /identity/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85 => generated 519 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:12.586383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.603469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c158b-830f-45d1-a869-c2406ca16073 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:12.789824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:12.791609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:12.792028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:12.792750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba/implies` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:12.799949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:12.808682 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:12.808682 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:12.808682 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:12.810932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:12.825100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2839/5664] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:12 2022] GET /identity/v3/roles/d49d0379f1d64223922508f3534f85ba/implies => generated 488 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:12.827541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.840710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289d31-0a06-4435-8cf2-a113b15a1b56 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:12.869446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:12.871666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:12.873325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:12.876691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:12.879108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=fbb77232f2a84e089e48537b314b2ebc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:12.883295 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:12.883295 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:12.883295 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:12.884754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:12.905983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.906663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2826/5665] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:12 2022] GET /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies => generated 660 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:12.925644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f606-f2a6-4d48-999b-1caf96058d9f tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:12.941255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:12.945406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:12.947606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:12.948241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:12.956598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=d49d0379f1d64223922508f3534f85ba, implied_role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:12.960712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:12.985400 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2840/5666] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:12 2022] DELETE /identity/v3/roles/d49d0379f1d64223922508f3534f85ba/implies/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:12.986649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:12.999910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33a2da-8712-497b-9d98-0d3ce89deb4c tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:13.120891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:13.124050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:13.126815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:13.128490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:13.133806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:13.139904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:13.161212 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2827/5667] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:12 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d49d0379f1d64223922508f3534f85ba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:13.165751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:13.187829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c23bc-362d-444d-8008-f858ede4e85d tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:13.354948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:13.357160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:13.358612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:13.359875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:13.364985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbb77232f2a84e089e48537b314b2ebc, implied_role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:13.368533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:13.388801 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2841/5668] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Apr 2 21:11:13 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc/implies/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:13.393998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:13.423842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e1245-67f3-4f10-8392-4cde54292b25 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:13.632166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:13.633117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:13.633408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:13.633698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/451052580b624fdcad1843b4213a1f5a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:13.653194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:13.678593 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Could not find domain: 451052580b624fdcad1843b4213a1f5a.: keystone.exception.DomainNotFound: Could not find domain: 451052580b624fdcad1843b4213a1f5a. Apr 02 21:11:13.682660 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2828/5669] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:13 2022] PATCH /identity/v3/domains/451052580b624fdcad1843b4213a1f5a => generated 112 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:13.684320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:13.706093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21fc9-ba8b-4205-ba6b-a802f1275305 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:13.723844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:13.724920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:13.727389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:13.729943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/users/b74dfb9531e84e19a8a206e10777e605` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:13.734939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b74dfb9531e84e19a8a206e10777e605)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:13.744099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:13.944818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:13.980739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:13.981983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:13.983836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.032939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74dfb9531e84e19a8a206e10777e605'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.090893 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2842/5670] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:13 2022] DELETE /identity/v3/users/b74dfb9531e84e19a8a206e10777e605 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:14.095674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:14.097696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:14.112060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38711dab-73a0-466d-bf59-7622d895fc14 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:14.256655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:14.258234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:14.259329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:14.259865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/35376810ac7042d19d82c9a992b4de85` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:14.263141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=35376810ac7042d19d82c9a992b4de85)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:14.267593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:14.404049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role 35376810ac7042d19d82c9a992b4de85 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:14.404650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.406639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.410536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2829/5671] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:14 2022] DELETE /identity/v3/roles/35376810ac7042d19d82c9a992b4de85 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:14.414948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:14.431634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82abede-01a4-4cd8-ac75-807c5b762214 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:14.558832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:14.561446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:14.562075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:14.562150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/groups/266bf314fee94a0db48817b0848b7556` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:14.563768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_group(group_id=266bf314fee94a0db48817b0848b7556)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:14.564787 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:14.564787 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:14.564787 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:14.566209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:14.680974 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2843/5672] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:14 2022] DELETE /identity/v3/groups/266bf314fee94a0db48817b0848b7556 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:14.685222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:14.687061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:14.711593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b80c-7960-45c3-9e41-9265dace55da tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:14.862330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:14.863322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:14.863615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:14.863906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/projects/cccbd309a88d4da3bfda0c020aaf3711` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:14.865625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cccbd309a88d4da3bfda0c020aaf3711)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:14.869094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:14.983708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccbd309a88d4da3bfda0c020aaf3711', 'request_id': 'req-379ecea7-b819-4ace-8f67-814b3d3cd9c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.990737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccbd309a88d4da3bfda0c020aaf3711', 'request_id': 'req-379ecea7-b819-4ace-8f67-814b3d3cd9c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:14.998881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccbd309a88d4da3bfda0c020aaf3711', 'request_id': 'req-379ecea7-b819-4ace-8f67-814b3d3cd9c5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.027664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] The token cache is being invalidate because project cccbd309a88d4da3bfda0c020aaf3711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:15.028009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.028680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.035168 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2830/5673] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:14 2022] DELETE /identity/v3/projects/cccbd309a88d4da3bfda0c020aaf3711 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:15.035484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:15.038553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:15.077218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da725496-1411-4cce-98b9-1a3ad820fca0 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:15.224140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:15.225468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:15.225905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:15.226358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:15.228090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=925c170f3ac44a899e05a093596bb676)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:15.230229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:15.269368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.270188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.311168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.311996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.316448 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2844/5674] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:15 2022] PATCH /identity/v3/domains/925c170f3ac44a899e05a093596bb676 => generated 277 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:15.321108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:15.339019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ecea7-b819-4ace-8f67-814b3d3cd9c5 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:15.445149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:15.445149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:15.445149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:15.445451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/domains/925c170f3ac44a899e05a093596bb676` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:15.474529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=925c170f3ac44a899e05a093596bb676)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:15.479621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:15.861201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.894168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '925c170f3ac44a899e05a093596bb676'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:15.997956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.013125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.025339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.097390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] The token cache is being invalidate because project 925c170f3ac44a899e05a093596bb676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:16.097711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.099548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.120200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.128568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.130508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '925c170f3ac44a899e05a093596bb676', 'request_id': 'req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.149492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2831/5675] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:15 2022] DELETE /identity/v3/domains/925c170f3ac44a899e05a093596bb676 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:16.152917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:16.157936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:16.276392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2e8e9-c4cd-4e23-a0d8-122aec7a81e7 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:16.469954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:16.473095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:16.473969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:16.475190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d49d0379f1d64223922508f3534f85ba` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:16.478796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d49d0379f1d64223922508f3534f85ba)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:16.481829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:16.587554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role d49d0379f1d64223922508f3534f85ba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:16.588034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.596835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.601076 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2845/5676] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:16 2022] DELETE /identity/v3/roles/d49d0379f1d64223922508f3534f85ba => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:16.605058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:16.608696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:16.654912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cf886-d22c-4b40-ba7e-5fc8f31a0962 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:16.824054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:16.833601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:16.833907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:16.834197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/d5f2c48328ac4e8d99b26802fe20ff1a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:16.840872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d5f2c48328ac4e8d99b26802fe20ff1a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:16.852154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:16.963582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role d5f2c48328ac4e8d99b26802fe20ff1a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:16.966672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.968188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:16.974184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2832/5677] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:16 2022] DELETE /identity/v3/roles/d5f2c48328ac4e8d99b26802fe20ff1a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:16.975145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:16.976739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:17.004902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a72-8ba3-4550-b9c9-2efa92801dbf tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:17.137165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f7411413c742a481f21ba2c820db6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:17.138420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:17.139515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:17.139992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] PATH_INFO: `/v3/roles/fbb77232f2a84e089e48537b314b2ebc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:17.153789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbb77232f2a84e089e48537b314b2ebc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:17.166438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:17.261000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invalidating the token cache because role fbb77232f2a84e089e48537b314b2ebc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:17.261296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.262017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.264073 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2846/5678] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:16 2022] DELETE /identity/v3/roles/fbb77232f2a84e089e48537b314b2ebc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:17.268512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:17.271099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:17.469471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf00fd-3b45-4e5d-ab33-0ac0dd7f21ca tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:17.523751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:17.525659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:17.625238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:17.626666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:17.627341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:17.629304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] PATH_INFO: `/v3/users/42bbfbdf14dd46cdbd136a202c7c987e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:17.631776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bbfbdf14dd46cdbd136a202c7c987e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:17.633982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:17.682770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69720cb-1d8a-45d6-b9a8-4c42e122ad71 tempest-RolesV3TestJSON-1994122254 tempest-RolesV3TestJSON-1994122254-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:17.704345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:17.705398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:17.708317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:17.708802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:17.713856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:17.766956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:17.768429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9e1ce-0e6f-481c-9b96-9209f76ea7ea service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:17.801606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bbfbdf14dd46cdbd136a202c7c987e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.817557 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2847/5679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:11:17.835871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bbfbdf14dd46cdbd136a202c7c987e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.836861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bbfbdf14dd46cdbd136a202c7c987e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.856520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bbfbdf14dd46cdbd136a202c7c987e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.875084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bbfbdf14dd46cdbd136a202c7c987e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:17.893130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:17.893508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:17.893754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:17.896163 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2833/5680] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:17 2022] DELETE /identity/v3/users/42bbfbdf14dd46cdbd136a202c7c987e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:17.928374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:17.934207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:18.118791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2848/5681] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:18.141136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:18.144287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:18.450975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81008479-8c75-4a27-9f2e-95a9f080a37f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:18.466304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:18.467802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:18.468344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:18.468937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:18.484697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:18.487146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:18.502758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2834/5682] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:19.655589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:19.660341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:19.721573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dae5f2-d880-4d17-ae8c-20f566322a88 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:19.748648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:19.750680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:19.753086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:19.754051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] PATH_INFO: `/v3/projects/fcca174d670f4749a9fe4be13f7a7914` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:19.758505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcca174d670f4749a9fe4be13f7a7914)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:19.761864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:19.962223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcca174d670f4749a9fe4be13f7a7914', 'request_id': 'req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:19.977917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcca174d670f4749a9fe4be13f7a7914', 'request_id': 'req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:19.994472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcca174d670f4749a9fe4be13f7a7914', 'request_id': 'req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.051359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] The token cache is being invalidate because project fcca174d670f4749a9fe4be13f7a7914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:20.053284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.054714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.066345 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2849/5683] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:19 2022] DELETE /identity/v3/projects/fcca174d670f4749a9fe4be13f7a7914 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:20.070442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:20.082131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052ed55-0f9a-4d28-8908-b787eac280f3 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:20.215763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:20.218112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:20.218561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:20.218854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] PATH_INFO: `/v3/users/84f7411413c742a481f21ba2c820db6d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:20.221444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f7411413c742a481f21ba2c820db6d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:20.231699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:20.275647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:20.277693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:20.327515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f7411413c742a481f21ba2c820db6d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.360680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f7411413c742a481f21ba2c820db6d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.361965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f7411413c742a481f21ba2c820db6d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.375439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f7411413c742a481f21ba2c820db6d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.383510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f7411413c742a481f21ba2c820db6d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:20.401894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2835/5684] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:20 2022] DELETE /identity/v3/users/84f7411413c742a481f21ba2c820db6d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:20.424646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8993c-6980-4a8b-8a45-ec51f7d9b095 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:20.549708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:20.549708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:20.550000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:20.550551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:20.553654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:20.632845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:20.633589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ed781-ab9a-4251-aace-dc802d7f7423 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:20.647795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2850/5685] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:21.634621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:21.636654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:21.662563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc97943-53d9-4e16-9912-a803eabbd7bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:21.674420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:21.676420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:21.676965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:21.677609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] PATH_INFO: `/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:21.681253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc1ee03f4714eb8a2dfea25d76c5c0c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:21.688502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:21.888378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'request_id': 'req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:21.909042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'request_id': 'req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:21.943967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc1ee03f4714eb8a2dfea25d76c5c0c', 'request_id': 'req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:21.973961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] The token cache is being invalidate because project 2dc1ee03f4714eb8a2dfea25d76c5c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:21.976741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:21.978657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-958e326d-dab0-4b8b-a2d1-3d40e434fd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:21.988268 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2836/5686] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:21 2022] DELETE /identity/v3/projects/2dc1ee03f4714eb8a2dfea25d76c5c0c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:21.990260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:21.990749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:21.991033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.037514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:22.039758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:22.252546 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2851/5687] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:22.259152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.259438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.266387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.293915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:22.296193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:22.315222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.316160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2837/5688] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:22.329541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf36a-efb2-4e7d-bc75-70acb7a031ab None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.336105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.338829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.339135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.339426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.340536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:22.340862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.344695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.375083 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2852/5689] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:22.378217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.401592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9671-974e-46e9-95af-d0ef1d3ab754 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.421544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.429022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.429022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.429022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.429022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.430681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.508254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2838/5690] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:22 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:22.509742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.523823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331bba-1ac0-40d3-9cad-a3217f0cb09b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.612680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.613374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.613662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.613944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.614697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.616987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.670191 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2853/5691] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:22 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:22.673850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.692908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8250a5-905d-4218-80ec-d09f35a1aa5c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.701919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.703967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.704859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.705209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.706146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.708903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.727485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.731571 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2839/5692] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:22.749751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616821b-e252-4e69-bd5a-d529f4cbec87 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.758731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.759437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.759719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.759992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.760825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.765815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee664f4-8feb-45df-91f0-70f3ab810210 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.780178 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2854/5693] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:11:22.784523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:22.795669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe678-be44-4157-af3d-a06bf785ebfb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:22.803207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:22.804266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.804691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.805142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] PATH_INFO: `/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/7cc33fbf39594e958544e293e7423487/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.831964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa45678cc6814dc2961e860c3e36f9df, user_id=7cc33fbf39594e958544e293e7423487, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:22.837150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:22.885980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:22.886276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:22.886565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:22.892686 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2840/5694] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:22 2022] PUT /identity/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/7cc33fbf39594e958544e293e7423487/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:22.934025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] MFA Rules not processed for user `7cc33fbf39594e958544e293e7423487`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:22.937223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:23.100598 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2855/5695] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:23.105587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.270722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf5-6fb9-4d9b-86ba-1a256395c88d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:23.296489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:23.296744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.297084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.297369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.297961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:23.300112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c973-27a5-47f6-b7df-685bb08492a0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:23.368364 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2841/5696] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:23 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:23.372120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.401949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60488-a29f-4045-86be-68ea4a43d7c8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:23.624125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:23.625292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.625581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.625860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.626555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:23.628523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:23.646390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.646869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.647293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.674571 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2856/5697] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:23 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:23.675696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.689224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed854e2-2a87-47a4-87df-a3b899a40625 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:23.691866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:23.693380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:23.697943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:23.699127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.699756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.700236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.701579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:23.704068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:23.728858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2857/5698] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:11:23.730071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.743402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e013e65-c5c8-434f-ad7d-cd8779197770 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:23.749236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:23.750655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.751309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.751792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] PATH_INFO: `/v3/projects/09b3815e751d467c914139287ae796bc/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.771956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3815e751d467c914139287ae796bc, user_id=a67de2a07ddf438f85987662e0c03ee9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:23.775457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:23.806710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2858/5699] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:23 2022] PUT /identity/v3/projects/09b3815e751d467c914139287ae796bc/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:23.811123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.836780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2842/5700] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:23.847628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:23.849886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:23.951763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df471847-797c-4c83-a27f-cb4a456ab45c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:23.964058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:23.964833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:23.965125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:23.965405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:23.966146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:23.969199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:23.998471 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2859/5701] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:24.001076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:24.014511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ceecf-b6e7-44b3-bbad-f66b51906724 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.020251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.021475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.021767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.022010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc2de-a5f3-41d1-900b-7c5fdd176f31 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.022117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] PATH_INFO: `/v3/projects/09b3815e751d467c914139287ae796bc/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.024099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3815e751d467c914139287ae796bc, user_id=a67de2a07ddf438f85987662e0c03ee9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.027155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941ec89-dc59-43eb-84f2-0a63054760d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:24.054540 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2860/5702] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:23 2022] PUT /identity/v3/projects/09b3815e751d467c914139287ae796bc/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:24.055715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.056015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.056305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.104518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] MFA Rules not processed for user `a67de2a07ddf438f85987662e0c03ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:24.108287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:24.153311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.154605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.157213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.159627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.275367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2861/5703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:24.281661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:24.325317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.332312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:24.364505 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2843/5704] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:11:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:11:24.455439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f561df-ce07-4da0-a1ef-cb52145a04c9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.486438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.487077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.487455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.488054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.488653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.491184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:24.572669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2862/5705] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:24 2022] POST /identity/v3/projects => generated 367 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:24.573883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:24.590242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d1661-2f5b-40a3-a973-a9ff21d71005 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.757888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.764516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.766144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.768000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.772468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.782098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:24.831314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2844/5706] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:24 2022] POST /identity/v3/users => generated 284 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:24.835154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:24.852592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b734-bccb-4110-8071-101411c44d20 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.881873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.882686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.882975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.883255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.884001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.893984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:24.938640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2863/5707] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:11:24.942551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:24.960997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae88e-4831-4257-b468-f4316ebe21aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:24.978338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:24.979177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:24.979475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:24.979901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:24.980707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:24.982387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e070ca-9f97-4544-84c8-c192b2306b8a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:25.004357 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2845/5708] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:25.009677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:25.020644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49277db-08ad-4e81-9605-9179ecc07aad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:25.050683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:25.051643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:25.051929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:25.052387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] PATH_INFO: `/v3/projects/d4f6e4b11e9f4d3d82a6bc08d5245c14/users/4a610037526249cf82ba67863d159f55/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:25.085252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f6e4b11e9f4d3d82a6bc08d5245c14, user_id=4a610037526249cf82ba67863d159f55, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:25.088061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:25.119614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2864/5709] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:25 2022] PUT /identity/v3/projects/d4f6e4b11e9f4d3d82a6bc08d5245c14/users/4a610037526249cf82ba67863d159f55/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:25.131766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:25.132339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:25.132791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:25.182373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] MFA Rules not processed for user `4a610037526249cf82ba67863d159f55`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:25.183891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:25.331577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2846/5710] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:25.336296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:25.476151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e90-ee50-4ff1-96dd-dfd2d7730bb1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:25.490171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:25.491059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:25.491341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:25.491636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:25.492394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:25.494067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:25.530523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2865/5711] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:25 2022] POST /identity/v3/domains => generated 277 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:25.531737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:25.551314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61334e-1294-4393-be9a-0c6d28f9b11a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:25.675717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:25.678994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:25.678994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:25.678994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:25.678994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:25.679632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:25.705335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2847/5712] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:25 2022] POST /identity/v3/roles => generated 239 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:25.709753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:25.740222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ced0a3-3c4d-470a-b6d6-527318a35465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:25.757608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:25.759359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:25.759359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:25.759613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/afb3ecac41004aa5b125cff0478824d2/users/4a610037526249cf82ba67863d159f55/roles/1070e00230c143dbb86e7a42c05142fd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:25.785392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=afb3ecac41004aa5b125cff0478824d2, user_id=4a610037526249cf82ba67863d159f55, role_id=1070e00230c143dbb86e7a42c05142fd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:25.788784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:25.820845 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2866/5713] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Apr 2 21:11:25 2022] PUT /identity/v3/domains/afb3ecac41004aa5b125cff0478824d2/users/4a610037526249cf82ba67863d159f55/roles/1070e00230c143dbb86e7a42c05142fd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:25.822924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:25.838544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5779b-cc64-4cb4-9086-b1e703297e34 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.000875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.001819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.002256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.002680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.003616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.005681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:26.049230 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2848/5714] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:25 2022] POST /identity/v3/domains => generated 276 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:26.052401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:26.066621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab977b-2949-44a6-887e-dcf5109e732a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.247534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.249469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.250004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.250462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.251371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.253197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:26.285153 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2867/5715] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:26 2022] POST /identity/v3/roles => generated 239 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:26.289351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:26.307291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e6237-0e15-4dba-b260-f592add6c5af tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.319804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.320786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.321373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.321800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.322685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.327307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:26.382899 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2849/5716] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:11:26 2022] POST /identity/v3/groups => generated 327 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:26.387277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:26.403129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a349c2-c414-4911-a3f9-4a202c49a542 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.417390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.418626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.420341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.420797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/ec9d769201bd470d8ed7caf65d811d9d/users/4a610037526249cf82ba67863d159f55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.440701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ec9d769201bd470d8ed7caf65d811d9d, user_id=4a610037526249cf82ba67863d159f55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.441984 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:26.441984 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:26.441984 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:26.443472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:26.507761 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2868/5717] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:11:26 2022] PUT /identity/v3/groups/ec9d769201bd470d8ed7caf65d811d9d/users/4a610037526249cf82ba67863d159f55 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:26.511984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:26.527199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81787de1-c95f-4581-9fb5-bc57cc12aa3b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.718559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.719746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.720166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.720959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/f68d832b89314b88837ce979d164c03b/groups/ec9d769201bd470d8ed7caf65d811d9d/roles/07ff1ba8e87742c2966587198e2246ab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.730087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f68d832b89314b88837ce979d164c03b, group_id=ec9d769201bd470d8ed7caf65d811d9d, role_id=07ff1ba8e87742c2966587198e2246ab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.733866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:26.764700 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2850/5718] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:26 2022] PUT /identity/v3/domains/f68d832b89314b88837ce979d164c03b/groups/ec9d769201bd470d8ed7caf65d811d9d/roles/07ff1ba8e87742c2966587198e2246ab => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:26.768872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:26.785284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df029-8314-4f24-83b1-06673e4a93da tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:26.953133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:26.954067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:26.954700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:26.955142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:26.958541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:26.962661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.017929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2869/5719] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:26 2022] POST /identity/v3/domains => generated 276 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:27.021624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.032913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef5b24-886b-4d3e-a033-7721ef125a03 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.164371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.165623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.166145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.166658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.167833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.169747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.212301 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2851/5720] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:27 2022] POST /identity/v3/roles => generated 239 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:27.213532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.241109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2f91a-5180-4f5f-b3c4-7f2eac86f1bb tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.258003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.259608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.260068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.260512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/956de79329744ee5972601e3751fab98/users/4a610037526249cf82ba67863d159f55/roles/632e3d50fe74480192868d15f93c8f26` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.305167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=956de79329744ee5972601e3751fab98, user_id=4a610037526249cf82ba67863d159f55, role_id=632e3d50fe74480192868d15f93c8f26)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.312939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.343271 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2870/5721] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Apr 2 21:11:27 2022] PUT /identity/v3/domains/956de79329744ee5972601e3751fab98/users/4a610037526249cf82ba67863d159f55/roles/632e3d50fe74480192868d15f93c8f26 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:27.347279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.365535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897672-0997-4709-b916-b8e83af0fc07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.556156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.556999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.557421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.557935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.558791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.562032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.603985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2852/5722] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:27 2022] POST /identity/v3/domains => generated 277 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:27.608172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.635989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478305b-1221-4767-8ad5-8e5d54f32d5f tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.637719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.644383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:27.749231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.750047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.750404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.750755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.751585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.753319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.777620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2871/5723] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:27 2022] POST /identity/v3/roles => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:27.781463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.801741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b3e2c-bc42-4515-97f1-72647796a2d2 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.811995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1f6ef-e1ac-4f71-90fe-06bbae71ddce tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.813176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.814038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.814406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.814765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.815585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.817388 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:27.817388 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:27.817388 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:27.820807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.827989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.830742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.832777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.833527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] PATH_INFO: `/v3/users/2fed8f5059c44a8fa1a9526e81fa73e8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.837360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fed8f5059c44a8fa1a9526e81fa73e8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.844063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.871916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2872/5724] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:11:27 2022] POST /identity/v3/groups => generated 326 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:27.873714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:27.893865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd75-2db7-4ec9-94ab-6624e7fef25b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:27.907593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:27.908778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:27.909144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:27.909570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/d93bb9731eff43a4a2a99edae390197f/users/4a610037526249cf82ba67863d159f55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:27.924278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d93bb9731eff43a4a2a99edae390197f, user_id=4a610037526249cf82ba67863d159f55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:27.926318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:27.979571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fed8f5059c44a8fa1a9526e81fa73e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:27.999186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fed8f5059c44a8fa1a9526e81fa73e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:28.000359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fed8f5059c44a8fa1a9526e81fa73e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:28.012231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fed8f5059c44a8fa1a9526e81fa73e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:28.024232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2873/5725] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:11:27 2022] PUT /identity/v3/groups/d93bb9731eff43a4a2a99edae390197f/users/4a610037526249cf82ba67863d159f55 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:28.024418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fed8f5059c44a8fa1a9526e81fa73e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:28.025665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:28.032498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:28.033794 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2853/5726] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:27 2022] DELETE /identity/v3/users/2fed8f5059c44a8fa1a9526e81fa73e8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:28.169154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1cae8-e5bd-4bc0-a495-7d3c97148330 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:28.307222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:28.312066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:28.312066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:28.312066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/7da49deed3294b039c7b3f7788ee033e/groups/d93bb9731eff43a4a2a99edae390197f/roles/c2430d835f47404699e0db9cf539be75` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:28.324870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7da49deed3294b039c7b3f7788ee033e, group_id=d93bb9731eff43a4a2a99edae390197f, role_id=c2430d835f47404699e0db9cf539be75)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:28.331059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:28.357068 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2874/5727] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:28 2022] PUT /identity/v3/domains/7da49deed3294b039c7b3f7788ee033e/groups/d93bb9731eff43a4a2a99edae390197f/roles/c2430d835f47404699e0db9cf539be75 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:28.361110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:28.362596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:28.608365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa868-ecfe-4ac5-8ebf-21dbe4dfa1c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:28.762946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:28.765519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:28.893897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a610037526249cf82ba67863d159f55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4f6e4b11e9f4d3d82a6bc08d5245c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:28.901516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:28.901889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:28.902194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] PATH_INFO: `/v3/auth/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:28.902920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:28.904020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:28.938079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80209c36-9533-4063-9019-ac73ed546e25 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:28.950780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:28.954423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:28.954726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:28.955016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] PATH_INFO: `/v3/projects/bb31a4915e1341839e229bc3786bb4b2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:28.959227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb31a4915e1341839e229bc3786bb4b2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:28.982210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:29.128553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb31a4915e1341839e229bc3786bb4b2', 'request_id': 'req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.141023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb31a4915e1341839e229bc3786bb4b2', 'request_id': 'req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.153093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2854/5728] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 21:11:28 2022] GET /identity/v3/auth/domains => generated 1174 bytes in 792 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:29.154118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.170374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb31a4915e1341839e229bc3786bb4b2', 'request_id': 'req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.189505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] The token cache is being invalidate because project bb31a4915e1341839e229bc3786bb4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:29.189869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.190589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-43492e36-6aa0-40e6-b4e3-95d9f2178ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.200564 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2875/5729] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:28 2022] DELETE /identity/v3/projects/bb31a4915e1341839e229bc3786bb4b2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:29.203197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41972c2-6341-496a-99fd-d64533136621 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.203483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41972c2-6341-496a-99fd-d64533136621 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.203765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41972c2-6341-496a-99fd-d64533136621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.251257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e41972c2-6341-496a-99fd-d64533136621 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:29.255127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e41972c2-6341-496a-99fd-d64533136621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:29.319531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1181-f690-46e6-9f68-33d84e2f4c30 tempest-TokensV3TestJSON-606897268 tempest-TokensV3TestJSON-606897268-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:29.347981 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2876/5730] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:29.357919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.358437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.358994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.399274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:29.403561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:29.447861 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2877/5731] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:29.453957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.462310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:29.463427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.463749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.464176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/7da49deed3294b039c7b3f7788ee033e/groups/d93bb9731eff43a4a2a99edae390197f/roles/c2430d835f47404699e0db9cf539be75` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.468711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a93e98-9ac7-47dd-a9d7-f74757e977f2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:29.475602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7da49deed3294b039c7b3f7788ee033e, group_id=d93bb9731eff43a4a2a99edae390197f, role_id=c2430d835f47404699e0db9cf539be75)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:29.480187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:29.482821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:29.483519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.485724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.486202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.487113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:29.487583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:29.492803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role c2430d835f47404699e0db9cf539be75 was removed from group d93bb9731eff43a4a2a99edae390197f on domain 7da49deed3294b039c7b3f7788ee033e. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:29.492803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.493149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.494616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:29.523817 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2855/5732] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:29 2022] DELETE /identity/v3/domains/7da49deed3294b039c7b3f7788ee033e/groups/d93bb9731eff43a4a2a99edae390197f/roles/c2430d835f47404699e0db9cf539be75 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:29.527780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.529819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:29.582056 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2878/5733] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:29.583273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.586376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:29.658004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe9654-0977-4bd6-a43b-ee6edc7458ce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:29.761663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba4aee-9f4f-444b-84dd-49170c3b00db tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:29.776582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:29.777527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.777819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.778104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/d93bb9731eff43a4a2a99edae390197f/users/4a610037526249cf82ba67863d159f55` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.797380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d93bb9731eff43a4a2a99edae390197f, user_id=4a610037526249cf82ba67863d159f55)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:29.802626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:29.815831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:29.816972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:29.817578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:29.818092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:29.819735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:29.824311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:29.824788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:29.847028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2856/5734] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:11:29 2022] DELETE /identity/v3/groups/d93bb9731eff43a4a2a99edae390197f/users/4a610037526249cf82ba67863d159f55 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:29.851175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.899277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2879/5735] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:29 2022] POST /identity/v3/projects => generated 385 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:29.902956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:29.994119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db0213-8bde-4e5a-b233-1fdf4e21239b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.042815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1be989-88e7-4100-8484-1a140e48034a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.056067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.056799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.057086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.057404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.058063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.060323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.103228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2880/5736] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:29 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:30.106804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.114097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.114996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.115283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.115579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/d93bb9731eff43a4a2a99edae390197f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.119105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d93bb9731eff43a4a2a99edae390197f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.120539 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:30.120539 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:11:30.120539 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:11:30.122474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.126929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a2ed7-2545-44ed-ae66-94a63b0e1b30 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.142198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.142896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.143198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.143461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.144200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.147588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.178250 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2881/5737] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:30 2022] GET /identity/v3/roles => generated 2341 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:30.182117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.198980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0308e16-c248-42a0-97cf-02c1818949b1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.212749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.214242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.214616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.216168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.218740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.222756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.246818 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2857/5738] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:29 2022] DELETE /identity/v3/groups/d93bb9731eff43a4a2a99edae390197f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:30.248027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.254771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2882/5739] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:30 2022] GET /identity/v3/roles => generated 2341 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:11:30.257282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.285045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55564-bdf4-4162-ac20-8884248e054a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.400062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953fcb3-a275-4d8c-b7ad-e7c1a5a9bf5c tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.406941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.408425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.408918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.409344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] PATH_INFO: `/v3/projects/5b35f02593444d7bbdccd00bacc80d91/users/7a73a60251ba40e289786434dd83c382/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.420845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.421762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.422111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.422395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles/c2430d835f47404699e0db9cf539be75` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.423978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c2430d835f47404699e0db9cf539be75)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.425649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.429069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b35f02593444d7bbdccd00bacc80d91, user_id=7a73a60251ba40e289786434dd83c382, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.432075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9ff86-426b-4a9e-9fa7-3912f550b4fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.494393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role c2430d835f47404699e0db9cf539be75 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:30.494692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.497054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.498926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2883/5740] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:30 2022] PUT /identity/v3/projects/5b35f02593444d7bbdccd00bacc80d91/users/7a73a60251ba40e289786434dd83c382/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:30.509838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.510378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2858/5741] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:30 2022] DELETE /identity/v3/roles/c2430d835f47404699e0db9cf539be75 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:30.510616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.511004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.514854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.517212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:30.584356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] MFA Rules not processed for user `7a73a60251ba40e289786434dd83c382`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:30.585649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:30.652929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaa7f2-05e6-4fa3-80d1-d50b66e28465 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.669202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.671893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.671893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.671893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/7da49deed3294b039c7b3f7788ee033e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.674245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7da49deed3294b039c7b3f7788ee033e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.675993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.713678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.714969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.741108 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2884/5742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:30.754889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.756490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:30.761385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.767253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.772508 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2859/5743] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:30 2022] PATCH /identity/v3/domains/7da49deed3294b039c7b3f7788ee033e => generated 278 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:30.776968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:30.778595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:30.908436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97c3a-3ba9-4ecc-a846-37955750e3a3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.913394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:30.914425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:30.914719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:30.914999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/7da49deed3294b039c7b3f7788ee033e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:30.933779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7da49deed3294b039c7b3f7788ee033e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:30.936277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:30.947985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce35a8d-51ce-40c3-b87b-abde6e5f93f1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:30.966201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:30.977958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7da49deed3294b039c7b3f7788ee033e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.039534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.061364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.085505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.163219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:31.164195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:31.165788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:31.167426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:31.174162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project 7da49deed3294b039c7b3f7788ee033e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:31.175228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.177617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:31.191761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.216031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.222834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.225515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7da49deed3294b039c7b3f7788ee033e', 'request_id': 'req-40ee3505-c09a-479e-8b64-ccd54e9287d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.238441 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2860/5744] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:30 2022] DELETE /identity/v3/domains/7da49deed3294b039c7b3f7788ee033e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:31.243846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:31.248638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:31.336226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:31.347013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:31.359791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2885/5745] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:31.387088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3505-c09a-479e-8b64-ccd54e9287d0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:31.395001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:31.395991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:31.396287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:31.396696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/956de79329744ee5972601e3751fab98/users/4a610037526249cf82ba67863d159f55/roles/632e3d50fe74480192868d15f93c8f26` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:31.400790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=956de79329744ee5972601e3751fab98, user_id=4a610037526249cf82ba67863d159f55, role_id=632e3d50fe74480192868d15f93c8f26)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:31.404422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:31.413933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 632e3d50fe74480192868d15f93c8f26 was removed from user 4a610037526249cf82ba67863d159f55 on domain 956de79329744ee5972601e3751fab98. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:31.414232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.415119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.448309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2861/5746] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Apr 2 21:11:31 2022] DELETE /identity/v3/domains/956de79329744ee5972601e3751fab98/users/4a610037526249cf82ba67863d159f55/roles/632e3d50fe74480192868d15f93c8f26 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:31.452945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:31.473204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03b1fe-1c11-4407-b598-a71ae2f398fb service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:31.570989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:31.571916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:31.572310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:31.572620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles/632e3d50fe74480192868d15f93c8f26` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:31.577035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_role(role_id=632e3d50fe74480192868d15f93c8f26)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:31.579947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:31.670533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 632e3d50fe74480192868d15f93c8f26 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:31.671102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.672023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.674500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2886/5747] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:31 2022] DELETE /identity/v3/roles/632e3d50fe74480192868d15f93c8f26 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:31.678773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:31.680661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:31.701904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87e7e-5db8-49b4-b27c-03ba0203eb0a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:31.854740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:31.855788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:31.856085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:31.856364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/956de79329744ee5972601e3751fab98` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:31.859646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=956de79329744ee5972601e3751fab98)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:31.861325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:31.911410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.914565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.963958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.964713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:31.969074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2862/5748] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:31 2022] PATCH /identity/v3/domains/956de79329744ee5972601e3751fab98 => generated 277 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:31.977535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:31.979233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:32.028336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c87ae-fc3e-4e20-98ec-785f7d0608b6 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:32.165939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:32.167430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:32.168176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:32.168737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/956de79329744ee5972601e3751fab98` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:32.183656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=956de79329744ee5972601e3751fab98)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:32.186541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:32.213418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.217494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '956de79329744ee5972601e3751fab98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.307314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.316109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.332125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.349625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project 956de79329744ee5972601e3751fab98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:32.350009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.351124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.369411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.374466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.375304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '956de79329744ee5972601e3751fab98', 'request_id': 'req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.386021 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2887/5749] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:31 2022] DELETE /identity/v3/domains/956de79329744ee5972601e3751fab98 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:32.397589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:32.399244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:32.441590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914f4d5-1bae-4230-aeb2-e4e82483a84d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:32.594736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:32.597436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:32.597945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:32.598435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/f68d832b89314b88837ce979d164c03b/groups/ec9d769201bd470d8ed7caf65d811d9d/roles/07ff1ba8e87742c2966587198e2246ab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:32.603038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f68d832b89314b88837ce979d164c03b, group_id=ec9d769201bd470d8ed7caf65d811d9d, role_id=07ff1ba8e87742c2966587198e2246ab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:32.616808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:32.632223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 07ff1ba8e87742c2966587198e2246ab was removed from group ec9d769201bd470d8ed7caf65d811d9d on domain f68d832b89314b88837ce979d164c03b. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:32.632560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.633324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.656875 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2863/5750] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:32 2022] DELETE /identity/v3/domains/f68d832b89314b88837ce979d164c03b/groups/ec9d769201bd470d8ed7caf65d811d9d/roles/07ff1ba8e87742c2966587198e2246ab => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:32.661168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:32.664900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:32.741645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f93d-3ed9-49b1-a01a-0d1ca4860c79 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:32.852092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:32.853087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:32.853437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:32.853727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/ec9d769201bd470d8ed7caf65d811d9d/users/4a610037526249cf82ba67863d159f55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:32.855494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ec9d769201bd470d8ed7caf65d811d9d, user_id=4a610037526249cf82ba67863d159f55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:32.856575 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:32.856575 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:32.856575 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:32.860214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:32.875102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:32.908567 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2888/5751] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:11:32 2022] DELETE /identity/v3/groups/ec9d769201bd470d8ed7caf65d811d9d/users/4a610037526249cf82ba67863d159f55 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:32.909259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:32.911035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:32.933844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a606-dafa-4c8e-b3d2-4e7823a7e62d tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:33.030276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:33.036296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:33.036646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:33.036936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/groups/ec9d769201bd470d8ed7caf65d811d9d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:33.041906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ec9d769201bd470d8ed7caf65d811d9d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:33.043877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:33.131822 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2864/5752] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:32 2022] DELETE /identity/v3/groups/ec9d769201bd470d8ed7caf65d811d9d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:33.135898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:33.157224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5381c7-d586-4b47-99fb-62b8b6a6a87e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:33.362219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:33.363030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:33.363513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:33.363805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles/07ff1ba8e87742c2966587198e2246ab` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:33.365414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07ff1ba8e87742c2966587198e2246ab)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:33.371885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:33.476876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 07ff1ba8e87742c2966587198e2246ab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:33.477205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.478680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.482756 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2889/5753] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:33 2022] DELETE /identity/v3/roles/07ff1ba8e87742c2966587198e2246ab => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:33.487536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:33.492122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:33.515914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fce973-07e0-401f-b014-627af276c5ae tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:33.677531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:33.678525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:33.678922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:33.679325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/f68d832b89314b88837ce979d164c03b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:33.681542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f68d832b89314b88837ce979d164c03b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:33.683320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:33.736433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.737434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.811762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.816146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:33.831154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:33.831726 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2865/5754] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:33 2022] PATCH /identity/v3/domains/f68d832b89314b88837ce979d164c03b => generated 277 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:33.851309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163161a-81b7-4e97-a923-590e1c5dda07 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:34.010746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:34.012120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:34.012626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:34.013649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/f68d832b89314b88837ce979d164c03b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:34.030507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f68d832b89314b88837ce979d164c03b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:34.032588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:34.085828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.091228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f68d832b89314b88837ce979d164c03b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.191002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.214245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.244029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.288199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project f68d832b89314b88837ce979d164c03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:34.288199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.288199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.311283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.319489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.320732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f68d832b89314b88837ce979d164c03b', 'request_id': 'req-26552912-d80e-4e6c-9fed-ec93a8b87f1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.329371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2890/5755] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:33 2022] DELETE /identity/v3/domains/f68d832b89314b88837ce979d164c03b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:34.333446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:34.335531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:34.366707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff628433-c5a6-4aa6-a1a4-62af0dac3584 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:34.500275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:34.502536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:34.505103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:34.505835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/afb3ecac41004aa5b125cff0478824d2/users/4a610037526249cf82ba67863d159f55/roles/1070e00230c143dbb86e7a42c05142fd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:34.516382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=afb3ecac41004aa5b125cff0478824d2, user_id=4a610037526249cf82ba67863d159f55, role_id=1070e00230c143dbb86e7a42c05142fd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:34.519365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:34.532347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 1070e00230c143dbb86e7a42c05142fd was removed from user 4a610037526249cf82ba67863d159f55 on domain afb3ecac41004aa5b125cff0478824d2. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:34.532951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.536686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:34.571557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2866/5756] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Apr 2 21:11:34 2022] DELETE /identity/v3/domains/afb3ecac41004aa5b125cff0478824d2/users/4a610037526249cf82ba67863d159f55/roles/1070e00230c143dbb86e7a42c05142fd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:34.575546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:34.577430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:34.603851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26552912-d80e-4e6c-9fed-ec93a8b87f1e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:34.808033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:34.815785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:34.816117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:34.816375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles/1070e00230c143dbb86e7a42c05142fd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:34.827848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1070e00230c143dbb86e7a42c05142fd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:34.840068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:35.036910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 1070e00230c143dbb86e7a42c05142fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:35.039928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.042543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.053228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2891/5757] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:34 2022] DELETE /identity/v3/roles/1070e00230c143dbb86e7a42c05142fd => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:35.057301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:35.060242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:35.106021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af59f-d7bc-4e4a-a1e3-bbb07c83bb87 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:35.316500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:35.317710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:35.317710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:35.317915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/afb3ecac41004aa5b125cff0478824d2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:35.346799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=afb3ecac41004aa5b125cff0478824d2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:35.348617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:35.376206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.377410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.455017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.458071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.471471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:35.473181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:35.473396 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2867/5758] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:35 2022] PATCH /identity/v3/domains/afb3ecac41004aa5b125cff0478824d2 => generated 278 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:35.511759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a5192-f0b5-4ca7-b92a-c9c3fe0884c0 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:35.848253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:35.861004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:35.861469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:35.861826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/afb3ecac41004aa5b125cff0478824d2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:35.902749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=afb3ecac41004aa5b125cff0478824d2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:35.905704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:35.976844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:35.999865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.150491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.182821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.203850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.227695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project afb3ecac41004aa5b125cff0478824d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:36.227920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.228741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.252876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.258486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.259618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'afb3ecac41004aa5b125cff0478824d2', 'request_id': 'req-356e06b5-1cb3-450e-9e6b-a2848791b070'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:36.269829 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2892/5759] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:35 2022] DELETE /identity/v3/domains/afb3ecac41004aa5b125cff0478824d2 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:36.275619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:36.277738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:36.310770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffb35-6dbc-4817-a9ac-cbee0b7bb4cd tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:36.614187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:36.614872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:36.615163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:36.615434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:36.616177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:36.617816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:36.708825 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2868/5760] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:36.713087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:36.715283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:36.748596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e06b5-1cb3-450e-9e6b-a2848791b070 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:36.760546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:36.762767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:36.763862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:36.764381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:36.804542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa45678cc6814dc2961e860c3e36f9df, user_id=a67de2a07ddf438f85987662e0c03ee9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:36.804542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:36.850511 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2893/5761] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:36 2022] PUT /identity/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:36.854679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:36.866834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa4872-864e-4c5b-8755-b23ea40915bf tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:37.130509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:37.131501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:37.131991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:37.132431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:37.133295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:37.134882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:37.258462 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2869/5762] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:11:36 2022] GET /identity/v3/auth/projects => generated 828 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:37.263134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:37.280366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d535-9505-431c-ba7d-9a2b769cf332 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:37.286136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:37.287204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:37.287520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:37.288096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:37.299078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=aa45678cc6814dc2961e860c3e36f9df, user_id=a67de2a07ddf438f85987662e0c03ee9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:37.314328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:37.342253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role 42bee24e8b3d4569a87041c383fcd39f was removed from user a67de2a07ddf438f85987662e0c03ee9 on project aa45678cc6814dc2961e860c3e36f9df. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:37.342557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:37.343349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:37.375416 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2894/5763] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Apr 2 21:11:37 2022] DELETE /identity/v3/projects/aa45678cc6814dc2961e860c3e36f9df/users/a67de2a07ddf438f85987662e0c03ee9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:37.382187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:37.384076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:37.407893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fc8f3-57ec-40db-9fc1-e160e87fec64 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:37.536090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:37.537697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:37.538423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:37.539619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:37.543244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:37.547886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:37.596086 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2870/5764] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:37 2022] POST /identity/v3/users => generated 323 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:37.600304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:37.629843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a34d-7d7d-4cd4-a103-858b4211c5e8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:37.654591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:37.655447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:37.655777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:37.656027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:37.656863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:37.658850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:37.764632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:37.780657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2895/5765] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:37 2022] POST /identity/v3/projects => generated 364 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:37.781602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30e3f-84fd-4c35-87e7-65eac99366b7 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:37.913117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:37.913959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:37.914253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:37.914531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:37.915231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:37.919120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:37.962623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2871/5766] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:37 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:37.964419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:37.979725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adab4-4362-41e1-b8fc-ffb042efe6ac tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:38.029984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:38.032861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:38.206615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:38.207309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.213799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.239612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.241374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:38.259666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:38.324862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2896/5767] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:11:37 2022] POST /identity/v3/roles => generated 239 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:38.328676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:38.366272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544510a2-f877-402f-ac07-3c46a4bcd786 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:38.368504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709cc8f-24e5-4bb6-bb03-67be907a479b tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:38.379734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:38.382815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.384223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.385335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:38.386323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/734818acf224406a925902e96ecfcfd3/users/a46b10f3b29f4548b98c44510284617f/roles/aa96771302c743448e5fde1e1cbeeecb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.388185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.389253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.389911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] PATH_INFO: `/v3/users/7a73a60251ba40e289786434dd83c382` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.393036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a73a60251ba40e289786434dd83c382)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:38.398802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:38.425427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(project_id=734818acf224406a925902e96ecfcfd3, user_id=a46b10f3b29f4548b98c44510284617f, role_id=aa96771302c743448e5fde1e1cbeeecb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:38.428922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:38.478329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2897/5768] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:38 2022] PUT /identity/v3/projects/734818acf224406a925902e96ecfcfd3/users/a46b10f3b29f4548b98c44510284617f/roles/aa96771302c743448e5fde1e1cbeeecb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:38.491070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:38.527086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a73a60251ba40e289786434dd83c382'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:38.546526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a73a60251ba40e289786434dd83c382'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:38.552337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a73a60251ba40e289786434dd83c382'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:38.567798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a73a60251ba40e289786434dd83c382'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:38.584548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-07c6d828-21f8-4c19-97f2-593a7ab6d2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a73a60251ba40e289786434dd83c382'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:38.595887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2872/5769] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:38 2022] DELETE /identity/v3/users/7a73a60251ba40e289786434dd83c382 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:38.597729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa02658-5c68-4708-a43f-740e491b8d9f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.598173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa02658-5c68-4708-a43f-740e491b8d9f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.598618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa02658-5c68-4708-a43f-740e491b8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.624573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ed851-5faf-43fb-b08a-2d47e12ba637 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:38.660785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dfa02658-5c68-4708-a43f-740e491b8d9f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:38.663372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfa02658-5c68-4708-a43f-740e491b8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:38.703328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:38.704346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.705003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.706904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/238f5b509b3a402d9040fe80ed4d59e3/users/a46b10f3b29f4548b98c44510284617f/roles/aa96771302c743448e5fde1e1cbeeecb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.712469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:create_grant(project_id=238f5b509b3a402d9040fe80ed4d59e3, user_id=a46b10f3b29f4548b98c44510284617f, role_id=aa96771302c743448e5fde1e1cbeeecb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:38.715850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287ef20-2d7f-40d9-86f6-a76aa8705355 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:38.742527 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2898/5770] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:38 2022] PUT /identity/v3/projects/238f5b509b3a402d9040fe80ed4d59e3/users/a46b10f3b29f4548b98c44510284617f/roles/aa96771302c743448e5fde1e1cbeeecb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:38.749286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.749565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.749934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.835179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] MFA Rules not processed for user `a46b10f3b29f4548b98c44510284617f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:38.839617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:38.846432 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2873/5771] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:38.849617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2899/5772] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:38 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:11:38.852836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:38.853231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:38.853612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:38.874475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] MFA Rules not processed for user `a46b10f3b29f4548b98c44510284617f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:38.875828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:38.925557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:38.927214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:39.019899 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2874/5773] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 02 21:11:39.020948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:39.029942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:39.049544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc400974-2dcb-4823-836a-cf04d9438586 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:39.060490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:39.061445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:39.061882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:39.063000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:39.179769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a4a0-a330-4206-aa2c-f05be6662d20 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:39.190504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:39.191656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:39.192150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:39.193513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:39.204379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:39.205972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:39.207192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:39.208244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b61ae0-5770-44cb-8d11-f1415e05cbcd service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:39.235371 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2875/5774] 10.222.0.18 () {56 vars in 1307 bytes} [Sat Apr 2 21:11:39 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:39.239185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2900/5775] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:39.243764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:39.244219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:39.244537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:39.266110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] MFA Rules not processed for user `a46b10f3b29f4548b98c44510284617f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:39.267281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:39.409163 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2901/5776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 02 21:11:39.413404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:39.427296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eecffb-c81a-438b-8205-4f89f39e808a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:39.440914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:39.442170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:39.442673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:39.443171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/roles/aa96771302c743448e5fde1e1cbeeecb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:39.446411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aa96771302c743448e5fde1e1cbeeecb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:39.452860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:39.544418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invalidating the token cache because role aa96771302c743448e5fde1e1cbeeecb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:39.544794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.545596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.553631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:39.555252 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2876/5777] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:39 2022] DELETE /identity/v3/roles/aa96771302c743448e5fde1e1cbeeecb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:39.570325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018c06-2f0c-4728-9b96-74ba995f86c9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:39.729082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:39.734333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:39.735437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:39.736414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/238f5b509b3a402d9040fe80ed4d59e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:39.740005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=238f5b509b3a402d9040fe80ed4d59e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:39.747999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:39.857809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238f5b509b3a402d9040fe80ed4d59e3', 'request_id': 'req-2a45939a-fa43-438d-8055-5d49b46fff86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.874236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238f5b509b3a402d9040fe80ed4d59e3', 'request_id': 'req-2a45939a-fa43-438d-8055-5d49b46fff86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.895196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238f5b509b3a402d9040fe80ed4d59e3', 'request_id': 'req-2a45939a-fa43-438d-8055-5d49b46fff86'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.923632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project 238f5b509b3a402d9040fe80ed4d59e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:39.926101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.927617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:39.931606 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2902/5778] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:39 2022] DELETE /identity/v3/projects/238f5b509b3a402d9040fe80ed4d59e3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:39.936737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:39.938927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:39.964729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f9fcb-295a-4dfd-b7e4-90d792ee4a75 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:40.094180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:40.095337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:40.095630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:40.096088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/238f5b509b3a402d9040fe80ed4d59e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:40.113714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=238f5b509b3a402d9040fe80ed4d59e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:40.115798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:40.156737 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Could not find project: 238f5b509b3a402d9040fe80ed4d59e3.: keystone.exception.ProjectNotFound: Could not find project: 238f5b509b3a402d9040fe80ed4d59e3. Apr 02 21:11:40.162069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:40.163554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:40.181676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2877/5779] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:39 2022] DELETE /identity/v3/projects/238f5b509b3a402d9040fe80ed4d59e3 => generated 113 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:40.187690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45939a-fa43-438d-8055-5d49b46fff86 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:40.202922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:40.203816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:40.204103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:40.204384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/projects/734818acf224406a925902e96ecfcfd3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:40.205864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=734818acf224406a925902e96ecfcfd3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:40.207787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:40.307940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734818acf224406a925902e96ecfcfd3', 'request_id': 'req-31c354d4-71e2-4588-927c-63f2c281c751'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.314396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734818acf224406a925902e96ecfcfd3', 'request_id': 'req-31c354d4-71e2-4588-927c-63f2c281c751'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.330965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734818acf224406a925902e96ecfcfd3', 'request_id': 'req-31c354d4-71e2-4588-927c-63f2c281c751'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.348525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] The token cache is being invalidate because project 734818acf224406a925902e96ecfcfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:40.348844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.351456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.362248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:40.362762 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2903/5780] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:40 2022] DELETE /identity/v3/projects/734818acf224406a925902e96ecfcfd3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:40.364337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:40.386764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7cdb-4cc1-4e58-853d-e917a49a57a8 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:40.545946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:40.548091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:40.548382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:40.549443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/users/a46b10f3b29f4548b98c44510284617f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:40.553363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a46b10f3b29f4548b98c44510284617f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:40.560014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:40.678303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46b10f3b29f4548b98c44510284617f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.712211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46b10f3b29f4548b98c44510284617f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.713129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46b10f3b29f4548b98c44510284617f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.735751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46b10f3b29f4548b98c44510284617f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.753248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46b10f3b29f4548b98c44510284617f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:40.765500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2878/5781] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:40 2022] DELETE /identity/v3/users/a46b10f3b29f4548b98c44510284617f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:40.771313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:40.789679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c354d4-71e2-4588-927c-63f2c281c751 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:40.811721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:40.813565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.041572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.042662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.042896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.043203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/7da49deed3294b039c7b3f7788ee033e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.061786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:41.079441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aff85-5b36-41c7-a8aa-c2cc7836397e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.085647 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Could not find domain: 7da49deed3294b039c7b3f7788ee033e.: keystone.exception.DomainNotFound: Could not find domain: 7da49deed3294b039c7b3f7788ee033e. Apr 02 21:11:41.096617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2904/5782] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:40 2022] PATCH /identity/v3/domains/7da49deed3294b039c7b3f7788ee033e => generated 112 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:41.101948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.105358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.108241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.108682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] PATH_INFO: `/v3/projects/5b35f02593444d7bbdccd00bacc80d91` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.113496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.115727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b35f02593444d7bbdccd00bacc80d91)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:41.116019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.126765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:41.156267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76621021-6766-4e05-8033-6b1d2c38138e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.186987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.188088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.188482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.189210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/956de79329744ee5972601e3751fab98` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.210566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:41.259411 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Could not find domain: 956de79329744ee5972601e3751fab98.: keystone.exception.DomainNotFound: Could not find domain: 956de79329744ee5972601e3751fab98. Apr 02 21:11:41.270539 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2905/5783] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:41 2022] PATCH /identity/v3/domains/956de79329744ee5972601e3751fab98 => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:41.272535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.291997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b35f02593444d7bbdccd00bacc80d91', 'request_id': 'req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.300986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0d5b-16f6-4bc3-9378-8acefd8d0c0e tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.320272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b35f02593444d7bbdccd00bacc80d91', 'request_id': 'req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.336293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b35f02593444d7bbdccd00bacc80d91', 'request_id': 'req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.367002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] The token cache is being invalidate because project 5b35f02593444d7bbdccd00bacc80d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:41.367469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.368322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b2bf0e9e-a508-4d13-8ee4-ed4434e479aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.382001 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2879/5784] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:40 2022] DELETE /identity/v3/projects/5b35f02593444d7bbdccd00bacc80d91 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:41.383744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abd5a-3122-4719-a483-0022e40ac731 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.386038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abd5a-3122-4719-a483-0022e40ac731 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.386501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75abd5a-3122-4719-a483-0022e40ac731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.451601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d75abd5a-3122-4719-a483-0022e40ac731 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:41.453783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d75abd5a-3122-4719-a483-0022e40ac731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.537625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.538780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.539332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.539823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/f68d832b89314b88837ce979d164c03b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.559468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:41.582479 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Could not find domain: f68d832b89314b88837ce979d164c03b.: keystone.exception.DomainNotFound: Could not find domain: f68d832b89314b88837ce979d164c03b. Apr 02 21:11:41.589057 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2906/5785] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:41 2022] PATCH /identity/v3/domains/f68d832b89314b88837ce979d164c03b => generated 112 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:41.590235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.595693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.626281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14533f-f232-47d7-94eb-159d524016e3 tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.640107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67de2a07ddf438f85987662e0c03ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09b3815e751d467c914139287ae796bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.640534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2880/5786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:41.641938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.643093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.643636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] PATH_INFO: `/v3/domains/afb3ecac41004aa5b125cff0478824d2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.648707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.649059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.649339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.669149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:41.690003 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Could not find domain: afb3ecac41004aa5b125cff0478824d2.: keystone.exception.DomainNotFound: Could not find domain: afb3ecac41004aa5b125cff0478824d2. Apr 02 21:11:41.698222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2907/5787] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:41 2022] PATCH /identity/v3/domains/afb3ecac41004aa5b125cff0478824d2 => generated 112 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:41.699261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:41.702143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.702468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.705169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.731797 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2881/5788] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:41.734091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.741105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c8cd7-61b3-4b13-b694-9b6c8aa6203a tempest-TokensV3TestJSON-1168025963 tempest-TokensV3TestJSON-1168025963-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.752228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fcae1-dbdd-49d8-8aab-d5fe6442529e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.754183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.755196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.755482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.755757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] PATH_INFO: `/v3/users/7cc33fbf39594e958544e293e7423487` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.759077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc33fbf39594e958544e293e7423487)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:41.761420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:41.766617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.767384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.767674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.767963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.768911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:41.769307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:41.774031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:41.811726 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2882/5789] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:41.812930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.843030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78fd0f-6cca-41fc-93c8-904075d1fdc3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:41.856743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:41.857509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:41.857797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:41.858092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:41.859511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:41.872937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:41.906629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc33fbf39594e958544e293e7423487'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.922520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc33fbf39594e958544e293e7423487'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.927646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc33fbf39594e958544e293e7423487'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.928343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc33fbf39594e958544e293e7423487'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:41.932505 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2883/5790] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:41 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:41.937230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:41.939038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:41.952064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-459d2ae0-8dcf-4643-9ef3-724c8c7a02ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc33fbf39594e958544e293e7423487'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:42.022496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2908/5791] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:41 2022] DELETE /identity/v3/users/7cc33fbf39594e958544e293e7423487 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:42.027350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.027466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.027670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.096507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:42.107301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:42.158052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d6e79-d988-4013-93b1-280f0485b526 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:42.310221 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2909/5792] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:42.372088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:42.372824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.373117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.373398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.374102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:42.376061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:42.415555 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2884/5793] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:41 2022] POST /identity/v3/users => generated 284 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:42.416447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:42.418413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:42.421843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:42.453298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6027f5e-7ace-4ab6-87c8-f3f2da136a5f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:42.476348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:42.477280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.477719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.478175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.479071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:42.480899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:42.536902 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2885/5794] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:42.537915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:42.576066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70fd5-1483-43e8-8c50-ec293a88e25e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:42.604853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:42.605548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.605838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.606122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.606930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:42.608628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:42.634791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7c4af-265e-439a-8602-e0635a4ec4f1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:42.651460 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2886/5795] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:42.654453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:42.655357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.656086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.656555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.658290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:42.689591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:42.694400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ce62-60e9-4253-889f-f4c5717db871 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:42.696430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aed711-9960-4f71-919b-adbbb5192296 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:42.718748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:42.719670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.719952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.720235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] PATH_INFO: `/v3/projects/79a31d86460e411285fa11f5d884aa63/users/d23991f7c8f846cb9566cae9e2cc6c59/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.736749 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2910/5796] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:42.761759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a31d86460e411285fa11f5d884aa63, user_id=d23991f7c8f846cb9566cae9e2cc6c59, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:42.765089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:42.792114 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2887/5797] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:42 2022] PUT /identity/v3/projects/79a31d86460e411285fa11f5d884aa63/users/d23991f7c8f846cb9566cae9e2cc6c59/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:42.802923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:42.803317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:42.803723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:42.838184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] MFA Rules not processed for user `d23991f7c8f846cb9566cae9e2cc6c59`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:42.839634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:42.993890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2911/5798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:42.995192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.135636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeed80-3dca-48d5-b2d1-d23520aee608 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.149378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.149862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.150151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.150428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.151139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:43.153926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:43.242543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2888/5799] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:43.242857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.282253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffcc52-db93-4be5-94cd-a2e61936eedf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.475630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.476315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.477190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.477479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.480864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:43.482737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:43.551533 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2912/5800] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:43 2022] POST /identity/v3/users => generated 290 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:43.553004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.566359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd881441-1d42-4421-a588-f1cd3ca8b4b5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.573248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.574196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.574667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.575638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.576551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:43.578496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:43.593063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2889/5801] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:43.597138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.615516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9b8a1-699c-40a6-b0af-170de3930f42 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.622821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.623749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.624072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.624654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] PATH_INFO: `/v3/projects/a5a725456b44443caddbf318df5fe4ae/users/b02fa4b8fbb64fbf8dc3d8e72acf1407/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.665791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a725456b44443caddbf318df5fe4ae, user_id=b02fa4b8fbb64fbf8dc3d8e72acf1407, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:43.668520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:43.689492 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2913/5802] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:43 2022] PUT /identity/v3/projects/a5a725456b44443caddbf318df5fe4ae/users/b02fa4b8fbb64fbf8dc3d8e72acf1407/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:43.693384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.707531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f65f5-7d4b-4aa6-b98b-d56c992e7eb1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.896285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.897050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.897338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.897621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.898357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:43.899983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481434d-b51a-4c39-a022-44819191c3ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:43.927557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2890/5803] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:43.933653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:43.957810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e288e3-5636-4915-8d03-6b7659bb1dac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:43.985815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:43.987736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:43.988212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:43.988929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] PATH_INFO: `/v3/projects/a5a725456b44443caddbf318df5fe4ae/users/b02fa4b8fbb64fbf8dc3d8e72acf1407/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:43.994990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a725456b44443caddbf318df5fe4ae, user_id=b02fa4b8fbb64fbf8dc3d8e72acf1407, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:44.001924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:44.023664 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2914/5804] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:43 2022] PUT /identity/v3/projects/a5a725456b44443caddbf318df5fe4ae/users/b02fa4b8fbb64fbf8dc3d8e72acf1407/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:44.037534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:44.038577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:44.038767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:44.093990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] MFA Rules not processed for user `b02fa4b8fbb64fbf8dc3d8e72acf1407`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:44.095661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:44.196014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2891/5805] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:44.200903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.220236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c5b9-6c4f-46cb-a3a3-3d3209c13bf4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:44.226014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:44.227202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:44.227983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:44.228511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:44.229747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:44.232504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:44.261799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2915/5806] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:11:44 2022] POST /identity/v3/domains => generated 276 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:44.263329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.275581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdba1e-10a8-4183-a3bd-975cd837c9c5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:44.417009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.420176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:44.468313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:44.469191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:44.469510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:44.469742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:44.470577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:44.473295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:44.514031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2892/5807] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:11:44 2022] POST /identity/v3/domains => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:44.521458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.635109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c0b77-58e6-4dfb-9112-378690da4a03 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:44.643609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:44.645308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:44.645956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:44.646855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:44.649218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:44.652162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:44.655016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e291-ba63-4541-9778-57ddc53dc0f2 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:44.723110 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2893/5808] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:11:44 2022] POST /identity/v3/domains => generated 276 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:44.726719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.801579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:44.802752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:44.803185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:44.803619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] PATH_INFO: `/v3/projects/aa45678cc6814dc2961e860c3e36f9df` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:44.805023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa45678cc6814dc2961e860c3e36f9df)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:44.808266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:44.916155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa45678cc6814dc2961e860c3e36f9df', 'request_id': 'req-cd903270-c270-490a-93a7-b77a2e129121'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:44.929968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa45678cc6814dc2961e860c3e36f9df', 'request_id': 'req-cd903270-c270-490a-93a7-b77a2e129121'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:44.951512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa45678cc6814dc2961e860c3e36f9df', 'request_id': 'req-cd903270-c270-490a-93a7-b77a2e129121'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:44.955543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703555c2-a93f-4fa3-9904-3d4f92a3de47 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:44.970067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] The token cache is being invalidate because project aa45678cc6814dc2961e860c3e36f9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:44.970745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:44.972402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:44.976233 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2916/5809] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:44 2022] DELETE /identity/v3/projects/aa45678cc6814dc2961e860c3e36f9df => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:44.980037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:44.989076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:45.087499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd903270-c270-490a-93a7-b77a2e129121 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:45.093255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:45.095045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:45.095450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:45.095838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] PATH_INFO: `/v3/users/a67de2a07ddf438f85987662e0c03ee9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:45.097254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67de2a07ddf438f85987662e0c03ee9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:45.099309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:45.111000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:45.111691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:45.111981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:45.112448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:45.113406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:45.118132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:45.157704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2894/5810] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Apr 2 21:11:44 2022] POST /identity/v3/domains => generated 279 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:45.162111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:45.166201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:45.193316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67de2a07ddf438f85987662e0c03ee9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.208802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67de2a07ddf438f85987662e0c03ee9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.209531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67de2a07ddf438f85987662e0c03ee9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.210706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67de2a07ddf438f85987662e0c03ee9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.242809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67de2a07ddf438f85987662e0c03ee9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.296489 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2917/5811] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:44 2022] DELETE /identity/v3/users/a67de2a07ddf438f85987662e0c03ee9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:45.319828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcad369-bf75-44b3-8271-9a82cb77c227 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:45.431420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:45.433579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:45.433946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:45.434595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/6e1bcac00b074168bf12e293e6ac55b6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:45.454153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6e1bcac00b074168bf12e293e6ac55b6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:45.456211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:45.513048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:45.514120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.515633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:45.540973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.612352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.624200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.632039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.658381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 6e1bcac00b074168bf12e293e6ac55b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:45.659222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.660256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.675605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.681284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.682436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6e1bcac00b074168bf12e293e6ac55b6', 'request_id': 'req-a8302988-63d4-4eca-871a-4881f357cefe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.682579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2a67-7783-4c72-b00c-618da5d11552 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:45.722703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2895/5812] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:45 2022] DELETE /identity/v3/domains/6e1bcac00b074168bf12e293e6ac55b6 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:45.730101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:45.731960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:45.760385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:45.761310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:45.761646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:45.761926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] PATH_INFO: `/v3/users/e5d1c36098a14436a0a10f4fb9937bf1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:45.764867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d1c36098a14436a0a10f4fb9937bf1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:45.767797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:45.845646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d1c36098a14436a0a10f4fb9937bf1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.862823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d1c36098a14436a0a10f4fb9937bf1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.863694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d1c36098a14436a0a10f4fb9937bf1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.864374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d1c36098a14436a0a10f4fb9937bf1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.884362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d1c36098a14436a0a10f4fb9937bf1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:45.889217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302988-63d4-4eca-871a-4881f357cefe tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:45.900502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:45.900753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:45.900923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:45.901286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:45.901948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:45.908319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:45.909801 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2918/5813] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:45 2022] DELETE /identity/v3/users/e5d1c36098a14436a0a10f4fb9937bf1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:45.946556 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2896/5814] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:45 2022] POST /identity/v3/domains => generated 249 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:45.949781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:45.952261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:46.114084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7fe72-7fa7-41d2-98cd-7b56ddaeab7e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:46.294902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:46.297117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:46.300007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:46.302580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/1e1409608aaf4b61af44aead84216383` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:46.313200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:46.316040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:46.359781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e1409608aaf4b61af44aead84216383)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:46.362934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:46.417937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.420598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.477194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.480063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.486301 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2919/5815] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:45 2022] PATCH /identity/v3/domains/1e1409608aaf4b61af44aead84216383 => generated 250 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:46.487336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:46.490037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749473-5781-4717-a862-b032e0db066c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:46.490835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:46.627404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5da5a1-a62a-4901-8efa-0ac0f2069192 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:46.634201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:46.636180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:46.636726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:46.637251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] PATH_INFO: `/v3/projects/09b3815e751d467c914139287ae796bc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:46.638842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b3815e751d467c914139287ae796bc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:46.639842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:46.641001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:46.641297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:46.641581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] PATH_INFO: `/v3/projects/76098fb9c22b4f84bb0afb2bbe66e858` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:46.642462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:46.642834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76098fb9c22b4f84bb0afb2bbe66e858)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:46.645295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:46.721308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b3815e751d467c914139287ae796bc', 'request_id': 'req-f1e9d45b-7373-40c6-b3da-f3395d897900'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.730500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b3815e751d467c914139287ae796bc', 'request_id': 'req-f1e9d45b-7373-40c6-b3da-f3395d897900'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.733223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76098fb9c22b4f84bb0afb2bbe66e858', 'request_id': 'req-52a87b24-5c62-48b6-af6b-93a4a819c318'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.741638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b3815e751d467c914139287ae796bc', 'request_id': 'req-f1e9d45b-7373-40c6-b3da-f3395d897900'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.749896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76098fb9c22b4f84bb0afb2bbe66e858', 'request_id': 'req-52a87b24-5c62-48b6-af6b-93a4a819c318'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.764598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76098fb9c22b4f84bb0afb2bbe66e858', 'request_id': 'req-52a87b24-5c62-48b6-af6b-93a4a819c318'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.769933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] The token cache is being invalidate because project 09b3815e751d467c914139287ae796bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:46.770303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.771067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.776059 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2897/5816] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:46 2022] DELETE /identity/v3/projects/09b3815e751d467c914139287ae796bc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:46.776059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:46.777606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:46.803479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] The token cache is being invalidate because project 76098fb9c22b4f84bb0afb2bbe66e858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:46.803776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.804562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:46.807768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2920/5817] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:46 2022] DELETE /identity/v3/projects/76098fb9c22b4f84bb0afb2bbe66e858 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:46.810226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:46.815517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:46.903741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d45b-7373-40c6-b3da-f3395d897900 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:46.946461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a87b24-5c62-48b6-af6b-93a4a819c318 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:46.955581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:46.958986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:46.959294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:46.959576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] PATH_INFO: `/v3/users/4a610037526249cf82ba67863d159f55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:46.962926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a610037526249cf82ba67863d159f55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:46.967458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:47.034468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:47.036655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:47.038268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:47.038867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/1e1409608aaf4b61af44aead84216383` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:47.073756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e1409608aaf4b61af44aead84216383)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:47.077593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:47.083900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.102055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.102698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.103404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.119338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.120344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a610037526249cf82ba67863d159f55'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.152204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e1409608aaf4b61af44aead84216383'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.155225 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2921/5818] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:46 2022] DELETE /identity/v3/users/4a610037526249cf82ba67863d159f55 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:47.159001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:47.162472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:47.280190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.300341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.326732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.330766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bce231-af24-4d69-8262-cb62ed026981 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:47.361166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 1e1409608aaf4b61af44aead84216383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:47.361474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.363085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.386274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.397235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.400362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e1409608aaf4b61af44aead84216383', 'request_id': 'req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.416824 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2898/5819] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:46 2022] DELETE /identity/v3/domains/1e1409608aaf4b61af44aead84216383 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:47.419013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:47.421262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:47.429790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:47.430692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:47.430977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:47.431255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] PATH_INFO: `/v3/users/21822f9161954586822cb38773536eb2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:47.432515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21822f9161954586822cb38773536eb2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:47.434820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:47.504696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21822f9161954586822cb38773536eb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.518419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21822f9161954586822cb38773536eb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.519231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21822f9161954586822cb38773536eb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.520764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21822f9161954586822cb38773536eb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.538436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21822f9161954586822cb38773536eb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.587463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2922/5820] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:47 2022] DELETE /identity/v3/users/21822f9161954586822cb38773536eb2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:47.605117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b09d-a4a9-4b05-a9cc-4b2f88961445 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:47.691636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:47.691636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:47.692087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:47.692309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:47.693104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:47.694775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:47.734979 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2899/5821] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:47 2022] POST /identity/v3/domains => generated 278 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:47.738023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:47.742930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:47.777712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa58a7-33ee-41ca-954f-ec2e135c8b90 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:47.851040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:47.851994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:47.852767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:47.853060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4a83ac9161e941618a35c203a908beeb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:47.865597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4a83ac9161e941618a35c203a908beeb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:47.867556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:47.905969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.909626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:47.932432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:47.935104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.029237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.033569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.038832 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2923/5822] 10.222.0.18 () {60 vars in 1249 bytes} [Sat Apr 2 21:11:47 2022] PATCH /identity/v3/domains/4a83ac9161e941618a35c203a908beeb => generated 279 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:48.039756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.042218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.175760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb1d49-92e8-482c-82a8-c202751e9fe5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.177573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8898d6-66d0-42c2-96cb-903fa278fc71 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.190826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.192275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.192275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.192565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] PATH_INFO: `/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.193682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7bc59b4f3b4d8c8afd76b7da34f899)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.195836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.197196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.198096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.198367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.198774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] PATH_INFO: `/v3/projects/d4f6e4b11e9f4d3d82a6bc08d5245c14` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.206484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f6e4b11e9f4d3d82a6bc08d5245c14)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.210221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.301743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7bc59b4f3b4d8c8afd76b7da34f899', 'request_id': 'req-5ee2ac96-b900-4a67-b288-352b0e961128'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.310848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7bc59b4f3b4d8c8afd76b7da34f899', 'request_id': 'req-5ee2ac96-b900-4a67-b288-352b0e961128'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.324825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7bc59b4f3b4d8c8afd76b7da34f899', 'request_id': 'req-5ee2ac96-b900-4a67-b288-352b0e961128'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.335193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f6e4b11e9f4d3d82a6bc08d5245c14', 'request_id': 'req-ebf1285d-4c20-4169-824f-6c604c1320ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.348689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] The token cache is being invalidate because project 5b7bc59b4f3b4d8c8afd76b7da34f899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:48.351182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.352414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f6e4b11e9f4d3d82a6bc08d5245c14', 'request_id': 'req-ebf1285d-4c20-4169-824f-6c604c1320ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.353602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.358924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2924/5823] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:48 2022] DELETE /identity/v3/projects/5b7bc59b4f3b4d8c8afd76b7da34f899 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:48.362150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.364921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.367972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f6e4b11e9f4d3d82a6bc08d5245c14', 'request_id': 'req-ebf1285d-4c20-4169-824f-6c604c1320ec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.400596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] The token cache is being invalidate because project d4f6e4b11e9f4d3d82a6bc08d5245c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:48.401058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.402916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ebf1285d-4c20-4169-824f-6c604c1320ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.405563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2900/5824] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:47 2022] DELETE /identity/v3/projects/d4f6e4b11e9f4d3d82a6bc08d5245c14 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:48.407151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.407542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.408951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.496662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ac96-b900-4a67-b288-352b0e961128 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.529539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:48.532442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.617861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.624401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.624725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.624993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4a83ac9161e941618a35c203a908beeb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.639629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=4a83ac9161e941618a35c203a908beeb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.642046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64197278-9f94-4b37-94d6-b6828bb6eec3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.649309 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2925/5825] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:48 2022] GET /identity/v3/domains/4a83ac9161e941618a35c203a908beeb => generated 279 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:48.654678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36af7-3291-4da1-aafb-07fef739b587 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.654972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36af7-3291-4da1-aafb-07fef739b587 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.655295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae36af7-3291-4da1-aafb-07fef739b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.677415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fae36af7-3291-4da1-aafb-07fef739b587 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:48.679074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fae36af7-3291-4da1-aafb-07fef739b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.694712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2901/5826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:48.695406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.698654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.731817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ef0c4-bea0-44d0-8190-808447c1231a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.748034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.751823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2926/5827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:48.753308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42379-7183-413d-8d58-8a16686ad531 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.753601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42379-7183-413d-8d58-8a16686ad531 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.753887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf42379-7183-413d-8d58-8a16686ad531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.761932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.762941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.766780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4a83ac9161e941618a35c203a908beeb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.769553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4a83ac9161e941618a35c203a908beeb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.771495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.774227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-adf42379-7183-413d-8d58-8a16686ad531 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:48.775655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-adf42379-7183-413d-8d58-8a16686ad531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.788100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2927/5828] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:48.788100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.788100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.788100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.807024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:48.808829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:48.821673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2928/5829] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:48.823085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.829430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.838714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e818ee-60b6-4e57-986a-dab3def8a2fe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.844113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4a83ac9161e941618a35c203a908beeb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.844275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.844970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.845251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.845529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.846459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:48.846771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.848666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.865335 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2929/5830] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:48.866967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.879277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd60389-413d-4c4a-b229-ca218568eb94 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.885615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:48.886357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:48.886647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:48.887085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:48.888368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:48.888715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:48.890535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:48.921669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2930/5831] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:48.922621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:48.950840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2ba9-c7ef-4f27-9bfd-008036cd5e76 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:48.953050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.973107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:48.986502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.009694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 4a83ac9161e941618a35c203a908beeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:49.009994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.011294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.027832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.035475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.037192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4a83ac9161e941618a35c203a908beeb', 'request_id': 'req-a99c8027-0670-461c-9704-8b396cff18a3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:49.049340 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2902/5832] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:48 2022] DELETE /identity/v3/domains/4a83ac9161e941618a35c203a908beeb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:49.050155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.056293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:49.085671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.090441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.094380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.094996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.097158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.103336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.162079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2931/5833] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:48 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:49.165074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.169737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:49.210458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8027-0670-461c-9704-8b396cff18a3 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.334625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.335324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.335616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.335897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.336647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.338775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.358425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415db78-9eff-4412-86f4-906833968277 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.364787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.365481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.365772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.366058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.366777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.369345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.391281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2932/5834] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 21:11:49 2022] GET /identity/v3/domains => generated 1345 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:49.391281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.391551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2903/5835] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:49 2022] POST /identity/v3/projects => generated 393 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:49.393742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.394517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:49.425663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e2ba-b679-416e-9566-b0fcc7fbf3d0 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.515712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897938ca-d1c0-4932-91ee-e373d937501f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.532961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.534120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.534422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.534710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4a83ac9161e941618a35c203a908beeb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.551660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:49.555977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.556789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.557266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.557775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.559123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.561358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.570697 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find domain: 4a83ac9161e941618a35c203a908beeb.: keystone.exception.DomainNotFound: Could not find domain: 4a83ac9161e941618a35c203a908beeb. Apr 02 21:11:49.572887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2904/5836] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:49 2022] PATCH /identity/v3/domains/4a83ac9161e941618a35c203a908beeb => generated 112 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:11:49.576297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.606289 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2933/5837] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:49 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:49.608058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.614845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80b625-a0a1-4c82-9e7b-f5e0987b9288 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.627662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.628361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.628677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.628963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.629654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221912-7cc5-4116-89c9-fcf1aa325056 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.629770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.634046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.644390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.645116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.645397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.645684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.647474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.650653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.684787 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2905/5838] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:49 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:49.685642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.696350 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2934/5839] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:49 2022] POST /identity/v3/domains => generated 276 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:49.697438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.704168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f776e-1480-427d-aeff-0a5e1dfb9260 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.803974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.804749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.804983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.805264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.806016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.807847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.825867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d555-fa8d-461d-9c97-82b40737a6aa tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.836814 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2906/5840] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:49.836814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.843304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.844403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.844924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.845408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.846552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.849696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.863303 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2935/5841] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:49.864426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.891289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a6b62-bb61-4119-9718-7c4f764ae5e1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.901139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.901870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.902877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.902877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.903199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.907477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.927703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2936/5842] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:49.927703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:49.952478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd069ae-1231-4f7a-be5c-b4e1deff3a40 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.953360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb804ca0-db4e-4a19-b823-6e2a57c6dc0d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:49.957768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.958671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.959085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.959647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.960447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.962664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:49.964938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:49.966002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:49.966463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:49.966894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:49.968703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:49.972818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.001776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2937/5843] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:50.003095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.007054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2907/5844] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:49 2022] POST /identity/v3/users => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:50.007917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.015825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76712d03-0287-4460-a75d-7404d7cab04c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.021148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.022144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc953-8eec-48fe-b4fb-a0caa6fee138 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.022658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.023097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.023629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] PATH_INFO: `/v3/projects/b0b5cf5b9c2f4bd997071853f0724424/users/106bbc9055cf4eef9b5fecb873c9385f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.027419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.028484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.029260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.029756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] PATH_INFO: `/v3/projects/01edd5c294b24e7485216be3ce48461e/users/9f35e431cbe04a639f4f23285b4e441f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.045981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b5cf5b9c2f4bd997071853f0724424, user_id=106bbc9055cf4eef9b5fecb873c9385f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.048913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.064271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01edd5c294b24e7485216be3ce48461e, user_id=9f35e431cbe04a639f4f23285b4e441f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.067883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d1521-0ae1-4b8a-a7f8-bc9f12844c91 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.069721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2938/5845] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:50 2022] PUT /identity/v3/projects/b0b5cf5b9c2f4bd997071853f0724424/users/106bbc9055cf4eef9b5fecb873c9385f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:50.070993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.096050 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2908/5846] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:50 2022] PUT /identity/v3/projects/01edd5c294b24e7485216be3ce48461e/users/9f35e431cbe04a639f4f23285b4e441f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:50.097492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cb6-22f5-470b-9370-bb52dd35f9cb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.099239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cb6-22f5-470b-9370-bb52dd35f9cb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.100745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6cb6-22f5-470b-9370-bb52dd35f9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.135517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-beaa6cb6-22f5-470b-9370-bb52dd35f9cb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:50.137265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-beaa6cb6-22f5-470b-9370-bb52dd35f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.238160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2909/5847] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:50.245359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968f5f-5284-4738-a2b2-e76f78b05999 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.250882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.251118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.251319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.317474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] MFA Rules not processed for user `9f35e431cbe04a639f4f23285b4e441f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:50.319899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.356684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.357367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.357650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.357927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.358647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.360744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.380195 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2939/5848] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:11:50 2022] POST /identity/v3/groups => generated 324 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:50.384113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.388492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.428799 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2910/5849] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:50.431302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.443648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cbb2a-6bb8-437f-aaba-d5161041bf78 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.453320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.454261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.454700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.455044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.457640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4df8d76313354ed09c5c3a0fb2646ea4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.459268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.477263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbc002-c310-42ac-a692-9d99ede712dd tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.481193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.481855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.482141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.482414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.483246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.484249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.494234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.494533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.504554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2940/5850] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:50.505423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.515351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97551825-e945-4264-a548-5c782520bc8a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.523722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.525267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.530300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2911/5851] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:50 2022] PATCH /identity/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4 => generated 277 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:50.534638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.536168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.595372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.596380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.596790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.597437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.598291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.599658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.635698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffd02a-5c3e-41d0-9ee8-23d6d0987fb4 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.642456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.643808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.644099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.644378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.657611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4df8d76313354ed09c5c3a0fb2646ea4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.659454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.689634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.709067 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2941/5852] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Apr 2 21:11:50 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 789 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:50.710847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:50.712800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.744066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99909-43e7-4044-bc19-f25135b4f5b3 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:50.751103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:50.752673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.754289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.754734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/0b455939102d4db584a8e82f9bd68f9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.769591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:get_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=0b455939102d4db584a8e82f9bd68f9b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:50.771585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f967-df70-415a-b6fd-5371c9121c71 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:50.776666 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2942/5853] 10.222.0.18 () {58 vars in 1391 bytes} [Sat Apr 2 21:11:50 2022] GET /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/0b455939102d4db584a8e82f9bd68f9b => generated 689 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:50.778505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:50.778954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:50.779322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:50.807038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] MFA Rules not processed for user `9f35e431cbe04a639f4f23285b4e441f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:50.808738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:50.889882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce1370c36d14a71af146cd73a7cd512'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.922324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce1370c36d14a71af146cd73a7cd512'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.923549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce1370c36d14a71af146cd73a7cd512'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.944160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce1370c36d14a71af146cd73a7cd512'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.952974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce1370c36d14a71af146cd73a7cd512'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:50.964969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.046956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2943/5854] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3417 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 02 21:11:51.046956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.047685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:51.054374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.061318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.067148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.082618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 4df8d76313354ed09c5c3a0fb2646ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:51.083019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.083959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.092749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.096613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.097355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4df8d76313354ed09c5c3a0fb2646ea4', 'request_id': 'req-b91a16b6-f122-4661-b679-60a5f10d6f4e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:51.103976 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2912/5855] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:50 2022] DELETE /identity/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:51.104947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.108411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:51.125517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d26ae7-2a77-4c03-bbf9-79494f76682b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.129712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.130391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.130684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.130953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.132856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:51.205333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a16b6-f122-4661-b679-60a5f10d6f4e tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.214080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.215060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.215360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.215817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/0b455939102d4db584a8e82f9bd68f9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.217306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=0b455939102d4db584a8e82f9bd68f9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.219042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.221375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.223796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.249324 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2913/5856] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:51 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/0b455939102d4db584a8e82f9bd68f9b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:51.249708 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2944/5857] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:51.250649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.254421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.255973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:51.274338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0a6e-4e72-42ec-88c6-54564698baa1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.291085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.292113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.292563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.292809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.294350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.295604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.331638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f761a-4a89-4b9f-b257-03bce42262ab service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.337064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.337955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.338248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.338530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.348219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=4df8d76313354ed09c5c3a0fb2646ea4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.350345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.372367 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4.: keystone.exception.DomainNotFound: Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4. Apr 02 21:11:51.374022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2945/5858] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4 => generated 112 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.377889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.398143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753956c-8314-44ff-93a4-88aebd5c47b5 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.405259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.406538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.407023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.407361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/users/5ce1370c36d14a71af146cd73a7cd512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.416082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:get_user(user_id=5ce1370c36d14a71af146cd73a7cd512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.421005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.441217 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find user: 5ce1370c36d14a71af146cd73a7cd512.: keystone.exception.UserNotFound: Could not find user: 5ce1370c36d14a71af146cd73a7cd512. Apr 02 21:11:51.444188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2946/5859] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/users/5ce1370c36d14a71af146cd73a7cd512 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.448341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.461377 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2914/5860] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:11:51 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 921 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:51.463123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.469897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193be16-a1b0-46a3-9bce-ddf41564b735 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.477819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.479232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.479789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.480492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/groups/23ebb2f6c9354fd78d87def0487926fa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.483319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc7b4e-c0e1-48e2-811e-06cdfcefab46 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.494095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:get_group(group_id=23ebb2f6c9354fd78d87def0487926fa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.496618 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:11:51.496618 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:11:51.496618 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:11:51.496618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.498938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.502198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.502769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.503234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/d77a01ed72d44248a4f5e9794a6e4712` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.511423 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find group: 23ebb2f6c9354fd78d87def0487926fa.: keystone.exception.GroupNotFound: Could not find group: 23ebb2f6c9354fd78d87def0487926fa. Apr 02 21:11:51.515969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=d77a01ed72d44248a4f5e9794a6e4712)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.516568 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2947/5861] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/groups/23ebb2f6c9354fd78d87def0487926fa => generated 111 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.517671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.519018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.530418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e8af6-7e87-4545-8797-4d9cf50d4299 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.538608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.540253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.540550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.540840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/groups/23ebb2f6c9354fd78d87def0487926fa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.547896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:51.552533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2915/5862] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:51 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/d77a01ed72d44248a4f5e9794a6e4712 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:51.557898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.558758 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find group: 23ebb2f6c9354fd78d87def0487926fa.: keystone.exception.GroupNotFound: Could not find group: 23ebb2f6c9354fd78d87def0487926fa. Apr 02 21:11:51.563738 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2948/5863] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:11:51 2022] DELETE /identity/v3/groups/23ebb2f6c9354fd78d87def0487926fa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.564847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.570825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a2823-2e48-4120-9473-7a01cf7019a1 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.576896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f94ed2-dc45-43d2-b829-8607da277084 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.584757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.585868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.586380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.586707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/users/5ce1370c36d14a71af146cd73a7cd512` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.590324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.592260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.592728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.593360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.594311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.595680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.597773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ce1370c36d14a71af146cd73a7cd512)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.599721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.622106 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find user: 5ce1370c36d14a71af146cd73a7cd512.: keystone.exception.UserNotFound: Could not find user: 5ce1370c36d14a71af146cd73a7cd512. Apr 02 21:11:51.628027 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2949/5864] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:51 2022] DELETE /identity/v3/users/5ce1370c36d14a71af146cd73a7cd512 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.628392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.641442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2dbb9-041a-431e-988d-452cf7445e5c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.647185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.648206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.648533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.648819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.659356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:51.670896 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4.: keystone.exception.DomainNotFound: Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4. Apr 02 21:11:51.676584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2950/5865] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:51 2022] PATCH /identity/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.677479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.691854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d7390-19ca-466c-837b-0249242465b9 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.697121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.697683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.698033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.698266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.699347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.701606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.708790 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2916/5866] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:11:51 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 812 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:51.709994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.723542 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2951/5867] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/domains => generated 1345 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:51.724099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbb256-d58b-4140-bfc0-62870d86e245 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.725121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.728698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.730229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.730520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.730795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/6d3572bc381c4e498253a9dfb290484d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.738005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8cca5-99fc-4d62-85e5-64661b9aeaf7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.740875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=6d3572bc381c4e498253a9dfb290484d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.742489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.751181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.752217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.752898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.753448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.754281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:51.755198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.757252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.772760 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2917/5868] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:51 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/6d3572bc381c4e498253a9dfb290484d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:51.779315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.785205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2952/5869] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:51.786437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.798228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1330ac9-3167-46ba-8c74-491b62424022 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.808542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.808542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.808542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.809126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.809231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adaf91-f7c0-42ee-abbf-5e92d96c6633 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.809323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-849238383) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:51.809323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.810885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.814921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.816417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.816973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.817434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.818972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.820568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:51.834318 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2953/5870] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Apr 2 21:11:51 2022] GET /identity/v3/domains?name=tempest-test_domain-849238383 => generated 407 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:51.839663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.854451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfedaed-2764-4f82-986d-dd421a812b64 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.870279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.872834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.872834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.873170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.890021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:51.900792 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-a78061bb-2a62-4db0-8cef-057555e05b69 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4.: keystone.exception.DomainNotFound: Could not find domain: 4df8d76313354ed09c5c3a0fb2646ea4. Apr 02 21:11:51.902374 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2954/5871] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:51 2022] PATCH /identity/v3/domains/4df8d76313354ed09c5c3a0fb2646ea4 => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:51.903832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.904124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.904407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.937012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] MFA Rules not processed for user `106bbc9055cf4eef9b5fecb873c9385f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:51.938935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:51.956591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2918/5872] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Apr 2 21:11:51 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 789 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:51.957813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:51.975052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e75eb-7665-4266-8d73-58f817a32abe tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:51.980962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:51.982937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:51.983230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:51.983641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/9ee8e70cf5c343d39ed68cb68574b664` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:51.995632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9ee8e70cf5c343d39ed68cb68574b664)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:51.998007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.019047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2955/5873] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:52.020670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.022034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.056535 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2919/5874] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:51 2022] PATCH /identity/v3/domains/9ee8e70cf5c343d39ed68cb68574b664 => generated 276 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:52.057426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.068900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcabe6-aac8-4052-a9cd-1cfd214b03c8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.073484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.074373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.074655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.075105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.075842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.077109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.097277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a924-1492-4597-afe4-afe01325d2c7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.102725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.103393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.103684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.104193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.106823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.127058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.128494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc2f98-14d3-47ca-9951-ed504c9d1fd8 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.143365 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2956/5875] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:52.144922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.145222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.145612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.150130 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2920/5876] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Apr 2 21:11:52 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 789 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:52.167259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.168017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] MFA Rules not processed for user `106bbc9055cf4eef9b5fecb873c9385f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:52.169856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.186740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2957/5877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:52.187622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.207445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acd1a6-7efa-4515-b9fd-cb95843ac942 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.207933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995f9c-9852-4c4e-8ab9-550a8121d11b tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.220485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.221413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.221703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.221986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.222693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.224337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.226696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.236640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.236941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.237229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/9ee8e70cf5c343d39ed68cb68574b664` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.263649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9ee8e70cf5c343d39ed68cb68574b664)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.265371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.270103 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2958/5878] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:11:52 2022] GET /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 1502 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:52.272235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.279400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.310942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.324430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29120e-d9ec-4239-a8dc-e60a8992d7e8 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.324925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.332426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.333339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.333621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.333899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.344222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.346131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.358333 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2959/5879] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:52.370240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.395146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d89d0e-0ccc-4efb-96dc-873d5a253626 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.405792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.406828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.407116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.407434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/c935366e09b242dcbca8743ca91c3f77` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.419624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=c935366e09b242dcbca8743ca91c3f77)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.421451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.428045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.462123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.470600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2960/5880] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:52 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/c935366e09b242dcbca8743ca91c3f77 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:52.472115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.474850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.496120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e009b-e437-4ba2-af66-b05295fdb104 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.500499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 9ee8e70cf5c343d39ed68cb68574b664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:52.500811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.501880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.534863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.542020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.542791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9ee8e70cf5c343d39ed68cb68574b664', 'request_id': 'req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.562740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2921/5881] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:52 2022] DELETE /identity/v3/domains/9ee8e70cf5c343d39ed68cb68574b664 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:52.563938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.568523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.585839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.586854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.587141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.587475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/056c1e364192409a9f2091917d64ab81` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.607040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=056c1e364192409a9f2091917d64ab81)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.608806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.656473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2961/5882] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:52 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/056c1e364192409a9f2091917d64ab81 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:52.664991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.667608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.705859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b114868-db5f-4c62-b0e9-4d11e2fefc06 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.716066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.717138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.717422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.717709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.718924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.720103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.737402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca9ea5-e3f7-4cac-96fe-3c9c79b4674c tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.750933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.756401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.756809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.757105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4772fd685ad84b72822b3e5702d56cad` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.789726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4772fd685ad84b72822b3e5702d56cad)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.791375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:52.842570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.844484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.847744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2962/5883] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Apr 2 21:11:52 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 788 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:52.851786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.854233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.883804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2bdd4-5ba0-44ee-a9eb-28f5d9066f16 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:52.911309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.911942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:52.916605 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2922/5884] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:52 2022] PATCH /identity/v3/domains/4772fd685ad84b72822b3e5702d56cad => generated 276 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:52.926141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:52.927738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:52.957290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:52.958615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:52.959078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:52.959502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:52.961282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:create_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:52.962950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.044548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2925c-ddff-46b1-b427-318a90bb3fe8 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.051286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.052154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.052445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.052755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/4772fd685ad84b72822b3e5702d56cad` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.065669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2963/5885] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Apr 2 21:11:52 2022] POST /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials => generated 788 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:53.069244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.069379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4772fd685ad84b72822b3e5702d56cad)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.070978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.071414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.084171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d887-00e1-4c7b-8467-6b0dadb4cef7 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.089983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.091910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.092429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.092739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.093647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Adding query filter params (name=tempest-application_credential-584190357) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:53.094067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.097254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.108410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.112301 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2964/5886] 10.222.0.18 () {58 vars in 1383 bytes} [Sat Apr 2 21:11:53 2022] GET /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials?name=tempest-application_credential-584190357 => generated 885 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:53.116045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.127238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4772fd685ad84b72822b3e5702d56cad'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.133118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31137feb-e585-4fe9-a54f-7233ba7daa23 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.141670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.142963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.143463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.144385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/ccf317c6c0a040e59ca033079b387f38` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.158554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=ccf317c6c0a040e59ca033079b387f38)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.161889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.187689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.201240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.210427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.231226 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2965/5887] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:53 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/ccf317c6c0a040e59ca033079b387f38 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:53.232892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 4772fd685ad84b72822b3e5702d56cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:53.233225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.234460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.235643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.238711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.258099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.265282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d623881-5fcf-4d63-9505-ffc066cbc846 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.265463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.266187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4772fd685ad84b72822b3e5702d56cad', 'request_id': 'req-286f0a8e-6107-4a15-965c-8e6894b46122'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.277109 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2923/5888] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:52 2022] DELETE /identity/v3/domains/4772fd685ad84b72822b3e5702d56cad => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:53.281281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.286235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.384491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f35e431cbe04a639f4f23285b4e441f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01edd5c294b24e7485216be3ce48461e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.388355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.389967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.390330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/17fb8466732a4a24a52822bffd156706` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.404327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f0a8e-6107-4a15-965c-8e6894b46122 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.409699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9f35e431cbe04a639f4f23285b4e441f, application_credential_id=17fb8466732a4a24a52822bffd156706)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.413936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.414691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.417375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.417739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.418247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/666a8a7b569747ebaba45094b6843af2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.433036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=666a8a7b569747ebaba45094b6843af2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.435599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.460594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.461311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.472803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2966/5889] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:11:53 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f/application_credentials/17fb8466732a4a24a52822bffd156706 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:53.477145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.480616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.511242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.512140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.519463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2924/5890] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:53 2022] PATCH /identity/v3/domains/666a8a7b569747ebaba45094b6843af2 => generated 277 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:53.520683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.522171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.621161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db223ad7-c52a-49a5-ae7f-d03e35c035d9 tempest-ApplicationCredentialsV3Test-2085649289 tempest-ApplicationCredentialsV3Test-2085649289-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.646758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8867-296a-4876-b5d4-e027d6ef3126 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.656209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02fa4b8fbb64fbf8dc3d8e72acf1407', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5a725456b44443caddbf318df5fe4ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.657391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.657751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.658114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] PATH_INFO: `/v3/domains/666a8a7b569747ebaba45094b6843af2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.675260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=666a8a7b569747ebaba45094b6843af2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.677429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.709570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.710546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.710915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.711294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] PATH_INFO: `/v3/users/9f35e431cbe04a639f4f23285b4e441f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.712882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f35e431cbe04a639f4f23285b4e441f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:53.715135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:53.720062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.733996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '666a8a7b569747ebaba45094b6843af2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.781541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f35e431cbe04a639f4f23285b4e441f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.790227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f35e431cbe04a639f4f23285b4e441f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.791029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f35e431cbe04a639f4f23285b4e441f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.791727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f35e431cbe04a639f4f23285b4e441f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.795909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.802631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-37b3ff70-9e96-4709-b937-d0e46bc3ca94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f35e431cbe04a639f4f23285b4e441f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.804768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.812116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.832406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] The token cache is being invalidate because project 666a8a7b569747ebaba45094b6843af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:53.832826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.833456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.843107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.846392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.847139 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2967/5891] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:53 2022] DELETE /identity/v3/users/9f35e431cbe04a639f4f23285b4e441f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:53.849050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '666a8a7b569747ebaba45094b6843af2', 'request_id': 'req-63247f68-d13c-476c-8e36-cdc5699a5ac7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:53.851456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.851749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.852032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:53.861142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2925/5892] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:53 2022] DELETE /identity/v3/domains/666a8a7b569747ebaba45094b6843af2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:53.865697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:53.871307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.893799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:53.895045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:53.988633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247f68-d13c-476c-8e36-cdc5699a5ac7 tempest-DomainsTestJSON-1164012236 tempest-DomainsTestJSON-1164012236-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:53.994791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2968/5893] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:53.997358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:53.998270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:53.998583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:53.998874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] PATH_INFO: `/v3/users/d23991f7c8f846cb9566cae9e2cc6c59` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.000115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23991f7c8f846cb9566cae9e2cc6c59)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:54.010056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:54.011857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:54.014341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.080613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23991f7c8f846cb9566cae9e2cc6c59'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:54.098961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23991f7c8f846cb9566cae9e2cc6c59'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:54.100180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23991f7c8f846cb9566cae9e2cc6c59'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:54.110068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23991f7c8f846cb9566cae9e2cc6c59'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:54.119914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ccf4bc91-39c8-4cd4-bb7a-ffbb0cbf8d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23991f7c8f846cb9566cae9e2cc6c59'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:54.126758 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2926/5894] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:53 2022] DELETE /identity/v3/users/d23991f7c8f846cb9566cae9e2cc6c59 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:54.131954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:54.132208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:54.134606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.135446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afe696-06fd-4255-baf3-2a3a16abdc55 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:54.160440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:54.161769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.253147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:54.254304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:54.254660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:54.255345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.257540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.271244 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2927/5895] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:54.275009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:54.277318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:54.280125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:54.281853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.292256 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2969/5896] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:11:54.299916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a6176-6cb3-437e-af7d-f6b04e80339e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:54.306649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:54.307519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:54.307814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:54.308097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.322518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:54.324240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:54.350742 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2928/5897] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:11:54.920380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:54.922151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.936525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105df13-d855-44c9-b6c4-fd36dab229d6 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:54.945214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:54.946517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:54.946911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:54.947363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] PATH_INFO: `/v3/projects/01edd5c294b24e7485216be3ce48461e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.949427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01edd5c294b24e7485216be3ce48461e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:54.952212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:54.954688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:54.956201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:54.975057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614b60-3941-4551-a00d-5a7d17b70054 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:54.979925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:54.980825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:54.981141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:54.981612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] PATH_INFO: `/v3/projects/79a31d86460e411285fa11f5d884aa63` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:54.982654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a31d86460e411285fa11f5d884aa63)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:54.984812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.008633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01edd5c294b24e7485216be3ce48461e', 'request_id': 'req-a39a0fab-0028-4782-a2f8-ec1ff17ad397'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.015340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01edd5c294b24e7485216be3ce48461e', 'request_id': 'req-a39a0fab-0028-4782-a2f8-ec1ff17ad397'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.022978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01edd5c294b24e7485216be3ce48461e', 'request_id': 'req-a39a0fab-0028-4782-a2f8-ec1ff17ad397'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.035041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] The token cache is being invalidate because project 01edd5c294b24e7485216be3ce48461e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:55.035421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.036172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a39a0fab-0028-4782-a2f8-ec1ff17ad397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.041629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2970/5898] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:54 2022] DELETE /identity/v3/projects/01edd5c294b24e7485216be3ce48461e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:55.043036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86817-cfc2-40ee-b76f-b6f1933ca15a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.044197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86817-cfc2-40ee-b76f-b6f1933ca15a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.044197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f86817-cfc2-40ee-b76f-b6f1933ca15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.051707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a31d86460e411285fa11f5d884aa63', 'request_id': 'req-aaa80bec-6d77-4797-833f-fd9f692c9ad5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.059189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a31d86460e411285fa11f5d884aa63', 'request_id': 'req-aaa80bec-6d77-4797-833f-fd9f692c9ad5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.065566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a31d86460e411285fa11f5d884aa63', 'request_id': 'req-aaa80bec-6d77-4797-833f-fd9f692c9ad5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.073689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-44f86817-cfc2-40ee-b76f-b6f1933ca15a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:55.075812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-44f86817-cfc2-40ee-b76f-b6f1933ca15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.084712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] The token cache is being invalidate because project 79a31d86460e411285fa11f5d884aa63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:55.086003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.086969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.091854 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2929/5899] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:54 2022] DELETE /identity/v3/projects/79a31d86460e411285fa11f5d884aa63 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:55.096755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.108396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.150937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2971/5900] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:55.160018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.160322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.160661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.181238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:55.182618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.193460 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2972/5901] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:55.199281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.207256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80bec-6d77-4797-833f-fd9f692c9ad5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.210424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a8eb9-b84c-4b1a-a37d-f78f507b6e5c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.213742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.214853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.215192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.215517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] PATH_INFO: `/v3/users/b02fa4b8fbb64fbf8dc3d8e72acf1407` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.216495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.216911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02fa4b8fbb64fbf8dc3d8e72acf1407)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.217214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.217505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.217782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.219111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.219473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:55.219786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.221646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.235357 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2973/5902] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:55.240670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.259558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2abb2-9cde-4a04-b8a4-b0c9b1c7a9be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.267911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.268867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.269166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.269566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.270810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.273326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.286007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02fa4b8fbb64fbf8dc3d8e72acf1407'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.311552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2974/5903] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:55.313532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02fa4b8fbb64fbf8dc3d8e72acf1407'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.315061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02fa4b8fbb64fbf8dc3d8e72acf1407'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.327792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.331334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02fa4b8fbb64fbf8dc3d8e72acf1407'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.345354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.359523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02fa4b8fbb64fbf8dc3d8e72acf1407'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:55.369125 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2930/5904] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:11:55 2022] DELETE /identity/v3/users/b02fa4b8fbb64fbf8dc3d8e72acf1407 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:55.475585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0703fe-3435-4c2d-8aef-9bdba23a9111 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.563508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.564615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.564984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.565459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.566239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.574393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.610356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2975/5905] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:55.611764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.630386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53d63-9137-4c76-8c52-d6f8e89971e1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.638773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.641803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.641803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.641803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.641803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.643372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.662966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.677379 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2931/5906] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:55.680027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f7a9d-c61a-4d71-bdcc-d65cf639d5c3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.689434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.690511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.691002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.692423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.693419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.695425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc96f-0860-4bad-99c5-3a7942f7adf5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.710192 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2976/5907] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:55.714406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.736838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359324c-8d57-421f-8402-906314d380c3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.745720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.747580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.748068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.748758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] PATH_INFO: `/v3/projects/75856dc4c50543f998ec0b93cb68a192/users/515547381c274371b34ad1ae5e03b8e9/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.770638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75856dc4c50543f998ec0b93cb68a192, user_id=515547381c274371b34ad1ae5e03b8e9, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.773635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:55.804159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.805142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2932/5908] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:55 2022] PUT /identity/v3/projects/75856dc4c50543f998ec0b93cb68a192/users/515547381c274371b34ad1ae5e03b8e9/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:55.805265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.805539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.845209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.847049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.857879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:55.862367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:55.956494 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2977/5909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:55.957513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:55.967292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c8aee-007c-4e24-961e-350ebaf41a3b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.970587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254270b1-b4f9-4204-ad0a-37444d387975 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:55.971489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73846ec9-4a89-4132-9050-8eabaa3f4e1d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.972378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846ec9-4a89-4132-9050-8eabaa3f4e1d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.972769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846ec9-4a89-4132-9050-8eabaa3f4e1d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.973050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73846ec9-4a89-4132-9050-8eabaa3f4e1d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.975960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:55.978642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:55.979146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:55.979615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] PATH_INFO: `/v3/projects/a5a725456b44443caddbf318df5fe4ae` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:55.981177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a725456b44443caddbf318df5fe4ae)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:55.983950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.016279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-73846ec9-4a89-4132-9050-8eabaa3f4e1d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.028581 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2978/5910] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:11:55 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:56.039634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a725456b44443caddbf318df5fe4ae', 'request_id': 'req-802ae428-b82a-4567-a801-0f551ae802ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.046131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a725456b44443caddbf318df5fe4ae', 'request_id': 'req-802ae428-b82a-4567-a801-0f551ae802ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.052101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a725456b44443caddbf318df5fe4ae', 'request_id': 'req-802ae428-b82a-4567-a801-0f551ae802ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.066925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] The token cache is being invalidate because project a5a725456b44443caddbf318df5fe4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:56.067219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.067880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-802ae428-b82a-4567-a801-0f551ae802ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:56.069705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2933/5911] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:11:55 2022] DELETE /identity/v3/projects/a5a725456b44443caddbf318df5fe4ae => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:56.075306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.075598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.075874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.096112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:56.097366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:56.163807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2979/5912] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:56.165550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.165901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.165973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.191222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:56.192772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:56.205941 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2934/5913] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:56.207124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.217421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e462d-41e1-47f0-9a56-49a387b690c4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.222428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.223101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.223384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.223662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.224386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:11:56.224735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.226498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.244805 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2980/5914] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:11:56.249940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.261465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6fe71-ee91-4107-9d95-aa2fa67efe40 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.268497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.268714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.268996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.269208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.270032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.271868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.303948 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2935/5915] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:56.308508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.320992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b1b51-21af-416b-9774-4c51041c4069 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.413227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.413962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.414315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.414565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.415258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.417369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.448540 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2981/5916] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:56.453340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.467789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b2852-b349-4029-b692-7c02e8208e72 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.473057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.473738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.474029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.474311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.475036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.476835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.488322 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2936/5917] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:56.492528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.503777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04af64-c341-4c9a-8c6d-945bd5f0a2e5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.509716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.510508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.510857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.511220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.512052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.513957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1cbc4-96a1-4f9c-9467-4b8b1ba3427f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.526369 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2982/5918] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:56.531091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.541693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b195-66de-4914-99ec-a054de95001d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.549848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.551421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.551771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.552134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] PATH_INFO: `/v3/projects/64a3bb61857042109e146283da987142/users/78d2d34c5b4543afa852554518160b98/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.571439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a3bb61857042109e146283da987142, user_id=78d2d34c5b4543afa852554518160b98, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.574172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.593940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2937/5919] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:56 2022] PUT /identity/v3/projects/64a3bb61857042109e146283da987142/users/78d2d34c5b4543afa852554518160b98/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:11:56.605719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.606673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.606963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.642951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] MFA Rules not processed for user `78d2d34c5b4543afa852554518160b98`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:56.644324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:56.722107 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2983/5920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:56.726069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.806610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526fae-d7aa-4b63-a392-43ec601e5dc6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.821155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.822404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.822404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.822638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.823234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.826077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:56.862584 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2938/5921] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:11:56.863823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:56.876544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9586f2-855a-4630-b466-4ac41e450814 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:56.967136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:56.967808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:56.968096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:56.968380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:56.969104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:56.971095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949189-8339-4408-b665-1b4dc4df66f1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.013977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2984/5922] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:11:56 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:57.015466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.035631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4efca0-4dba-484e-b788-ebeb8ee61908 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.035878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239aca0-d195-427f-8918-40f7bfb79197 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.036238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239aca0-d195-427f-8918-40f7bfb79197 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.036646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239aca0-d195-427f-8918-40f7bfb79197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.050672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.051369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.051658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.056762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.057810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:57.060817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e3359-3733-4ba8-b47a-04258dadbeff admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.079132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2239aca0-d195-427f-8918-40f7bfb79197 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:57.082557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2239aca0-d195-427f-8918-40f7bfb79197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:57.093831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2985/5923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:11:57.101968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2939/5924] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:11:57.102287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.102606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.102890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.104029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.105430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.105724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.163135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:57.165317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:57.168083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:57.169226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:57.311600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2986/5925] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:57.312030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.327284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc5ca-c5cf-41e0-85ce-e76432bc328f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.330934 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2940/5926] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:57.331822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.335731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:57.336811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.337745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.338160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.338890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] PATH_INFO: `/v3/projects/a9bdd108e019416fb32289a85a21c48d/users/74caef36f7b9452db0711641072852f3/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.361067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bdd108e019416fb32289a85a21c48d, user_id=74caef36f7b9452db0711641072852f3, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:57.364813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.414616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2987/5927] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:57 2022] PUT /identity/v3/projects/a9bdd108e019416fb32289a85a21c48d/users/74caef36f7b9452db0711641072852f3/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:57.418024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.465635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15627cdd-7cc9-4190-aaf8-ad1106745334 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.539263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801d80-df81-4132-a81c-016cab1639ca admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.549998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.551269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.551795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.552278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.564480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.565405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.565702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.566061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.626541 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 02 21:11:57.628389 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2988/5928] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 188 bytes in 213 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:11:57.629426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.704376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:57.706069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.729873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2941/5929] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:57.731432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.743088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06e115-23e7-4540-8266-fb721ce117fe service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.749154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.753546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.754017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.754327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.818754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5d25a-1092-48a9-b008-cc8e38bb1d8a tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.826259 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 02 21:11:57.828232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2942/5930] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 188 bytes in 98 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:11:57.832183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.834360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.835241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.835517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.835820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.836930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:57.841205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.851937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4be-33ea-4e62-97dd-74d451651431 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.866137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.868478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2989/5931] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:11:57.868607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.868916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.869218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.873512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:57.897148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf2ff-5808-43b0-8617-137fcf7bc38f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:57.916890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:57.919474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.919474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.919662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] PATH_INFO: `/v3/projects/a9bdd108e019416fb32289a85a21c48d/users/74caef36f7b9452db0711641072852f3/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.922447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bdd108e019416fb32289a85a21c48d, user_id=74caef36f7b9452db0711641072852f3, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:57.925159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deba36-a45f-4dc0-a7df-75642a1d69cd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:57.964406 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2990/5932] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:11:57 2022] PUT /identity/v3/projects/a9bdd108e019416fb32289a85a21c48d/users/74caef36f7b9452db0711641072852f3/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:57.966785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:57.967678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:57.967678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:57.981329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:58.002025 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2943/5933] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:58.038961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] MFA Rules not processed for user `74caef36f7b9452db0711641072852f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:58.042698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:58.222557 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2991/5934] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:11:58.227647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:58.371683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8c033-00f7-4caa-b8e4-b0e471251139 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:58.389620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:58.390705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:58.391867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:58.392166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:58.393495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:58.395317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:58.406353 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invalid input for field 'name': '' is too short Apr 02 21:11:58.406353 ncdv-master-1 devstack@keystone.service[97316]: Failed validating 'minLength' in schema['properties']['name']: Apr 02 21:11:58.406353 ncdv-master-1 devstack@keystone.service[97316]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 02 21:11:58.406353 ncdv-master-1 devstack@keystone.service[97316]: On instance['name']: Apr 02 21:11:58.406353 ncdv-master-1 devstack@keystone.service[97316]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 02 21:11:58.408762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2944/5935] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:58 2022] POST /identity/v3/domains => generated 283 bytes in 181 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 02 21:11:58.413576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:58.449186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68ef11-aa96-4bc5-860e-6c25849a7b67 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:58.470884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:58.471576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:58.471868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:58.472150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:58.475983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:58.477651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:58.492953 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 02 21:11:58.492953 ncdv-master-1 devstack@keystone.service[97317]: Failed validating 'maxLength' in schema['properties']['name']: Apr 02 21:11:58.492953 ncdv-master-1 devstack@keystone.service[97317]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 02 21:11:58.492953 ncdv-master-1 devstack@keystone.service[97317]: On instance['name']: Apr 02 21:11:58.492953 ncdv-master-1 devstack@keystone.service[97317]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 02 21:11:58.509965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2992/5936] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:58 2022] POST /identity/v3/domains => generated 412 bytes in 97 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Apr 02 21:11:58.515428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:58.532372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d4125-ca80-4928-8f35-727e505a1630 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:58.562845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:58.565681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:58.565681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:58.573074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:58.574206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:58.581423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:58.647762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2945/5937] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:58 2022] POST /identity/v3/domains => generated 277 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:58.651888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:58.674079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf045c38-d1a8-4005-b3f5-c42db6cc4a96 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:58.850681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:58.853161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:58.854232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:58.855310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/972b21a1e87045c8bf219e52cd81daa5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:58.874618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=972b21a1e87045c8bf219e52cd81daa5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:58.876347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:58.907575 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-488b0ff6-4676-40d1-ad8a-6700ee33abde tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Apr 02 21:11:58.907575 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2993/5938] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:58 2022] DELETE /identity/v3/domains/972b21a1e87045c8bf219e52cd81daa5 => generated 120 bytes in 256 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:11:58.911479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:58.922952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c6e5-8f75-47e8-ba8f-55edaae03856 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:58.931670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:58.932521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:58.932976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:58.933554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/972b21a1e87045c8bf219e52cd81daa5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:58.936082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=972b21a1e87045c8bf219e52cd81daa5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:58.937754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:58.971828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:58.972966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.008199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eceb6-5070-4b55-a54f-80fe8aa451d2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.008931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eceb6-5070-4b55-a54f-80fe8aa451d2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.009368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eceb6-5070-4b55-a54f-80fe8aa451d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.014765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.015696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.021981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2946/5939] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:58 2022] PATCH /identity/v3/domains/972b21a1e87045c8bf219e52cd81daa5 => generated 278 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:59.023116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.026559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.076819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f51eceb6-5070-4b55-a54f-80fe8aa451d2 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:59.080758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f51eceb6-5070-4b55-a54f-80fe8aa451d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.108647 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2994/5940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:11:59.113834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.114334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.114770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.120128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49e34-8135-45b8-9731-9e3783908224 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.126333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.127340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.129107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.129107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/972b21a1e87045c8bf219e52cd81daa5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.145836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=972b21a1e87045c8bf219e52cd81daa5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:59.147808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:59.153549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:11:59.156817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.183592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.197507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.230375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2995/5941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:11:59.234786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.247203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614330b7-1710-4d0e-ad0d-b3ed22716e28 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.254402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.256494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.256494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.256494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.289752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.300376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.308998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.325339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.334675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] The token cache is being invalidate because project 972b21a1e87045c8bf219e52cd81daa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:11:59.335025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.337654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2996/5942] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:11:59 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:59.340989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.352529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.358659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.373068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '972b21a1e87045c8bf219e52cd81daa5', 'request_id': 'req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.387680 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2947/5943] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:59 2022] DELETE /identity/v3/domains/972b21a1e87045c8bf219e52cd81daa5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:11:59.389136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.395030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.421674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9a37-82d0-41bd-8f7e-0e53286cf6ab tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.501727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.503161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.503913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.504423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/54ff5af491f94edb945677c72e817bdf` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.520016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:11:59.530537 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Could not find domain: 54ff5af491f94edb945677c72e817bdf.: keystone.exception.DomainNotFound: Could not find domain: 54ff5af491f94edb945677c72e817bdf. Apr 02 21:11:59.532105 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2997/5944] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:59 2022] DELETE /identity/v3/domains/54ff5af491f94edb945677c72e817bdf => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:11:59.536779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.548375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7987ee-80fc-4733-88a3-1a3f8bc0b482 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.557623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.559511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.559990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.560535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.561510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:59.563494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:59.601512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2948/5945] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:59 2022] POST /identity/v3/domains => generated 253 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:11:59.610881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.624587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18608-7727-43ba-a067-079188317bb8 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.739461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.740543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.741050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.741569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.742713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:59.744831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:59.757198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.sql.core [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1990227551' for key 'project.ixu_project_name_domain_id'") Apr 02 21:11:59.757198 ncdv-master-1 devstack@keystone.service[97317]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 02 21:11:59.757198 ncdv-master-1 devstack@keystone.service[97317]: [parameters: {'id': 'c99eded6da8846f8b89c9683227349c2', 'name': 'tempest-domain-dup-1990227551', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Apr 02 21:11:59.757198 ncdv-master-1 devstack@keystone.service[97317]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97317) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 02 21:11:59.766461 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1990227551.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1990227551. Apr 02 21:11:59.768124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2998/5946] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:11:59 2022] POST /identity/v3/domains => generated 212 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:11:59.772151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.787609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb52d54-7a5c-4205-8377-5564b0c81662 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.789813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.791890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.792505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.794608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:11:59.794905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:11:59.795225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/f86e0c44cb044fb0bf4f08752d61916e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:11:59.810220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f86e0c44cb044fb0bf4f08752d61916e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:11:59.811959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:11:59.845317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.847603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.899137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.900085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:11:59.901442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629102-1173-42a9-9935-b407ea433721 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:11:59.904135 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2949/5947] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:11:59 2022] PATCH /identity/v3/domains/f86e0c44cb044fb0bf4f08752d61916e => generated 254 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:11:59.909049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:11:59.911467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:11:59.998762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:11:59.999937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.000220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.000659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.003265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:00.030595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977bafb-f4c5-4c49-925b-0d8cbb6b19a1 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:00.032573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:00.035769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:00.036751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.037041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.037323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/f86e0c44cb044fb0bf4f08752d61916e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.038333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:00.063584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 2999/5948] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:00.064129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f86e0c44cb044fb0bf4f08752d61916e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:00.066979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:00.106849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.119330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.186582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.214073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.220965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.246537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] The token cache is being invalidate because project f86e0c44cb044fb0bf4f08752d61916e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:00.247082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.247964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.257628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.261535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.263295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d65aa046-1d0e-453b-9698-51432a89df53 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f86e0c44cb044fb0bf4f08752d61916e', 'request_id': 'req-d65aa046-1d0e-453b-9698-51432a89df53'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.275967 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2950/5949] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:11:59 2022] DELETE /identity/v3/domains/f86e0c44cb044fb0bf4f08752d61916e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:00.282693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:00.300090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5abc8-ead6-4f98-84a8-c750c9856809 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:00.350000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199555f5-45a9-44d3-a066-b676d70f79a3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.350567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199555f5-45a9-44d3-a066-b676d70f79a3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.350871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199555f5-45a9-44d3-a066-b676d70f79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.377314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-199555f5-45a9-44d3-a066-b676d70f79a3 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:00.378833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-199555f5-45a9-44d3-a066-b676d70f79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:00.391296 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2951/5950] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:00.395314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.398185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.398549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.404717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74caef36f7b9452db0711641072852f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9bdd108e019416fb32289a85a21c48d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:00.405981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.407088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.407530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] PATH_INFO: `/v3/domains/972b21a1e87045c8bf219e52cd81daa5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.416055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:12:00.424352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:00.426263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:00.427352 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Could not find domain: 972b21a1e87045c8bf219e52cd81daa5.: keystone.exception.DomainNotFound: Could not find domain: 972b21a1e87045c8bf219e52cd81daa5. Apr 02 21:12:00.432831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3000/5951] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:12:00 2022] PATCH /identity/v3/domains/972b21a1e87045c8bf219e52cd81daa5 => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:12:00.434816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:00.436917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:00.517439 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2952/5952] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:00.518886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:00.532110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cebb2b-8381-4215-adb9-bc4f8ecca690 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:00.537513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37658a-c8a3-4a20-b432-b8aa4ac56449 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:00.538908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37658a-c8a3-4a20-b432-b8aa4ac56449 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.539418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37658a-c8a3-4a20-b432-b8aa4ac56449 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.539797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37658a-c8a3-4a20-b432-b8aa4ac56449 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.554447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5d95-c3ca-4b23-a7d8-2533cf2e1039 tempest-DomainsNegativeTestJSON-549340826 tempest-DomainsNegativeTestJSON-549340826-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:00.563493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:00.565003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.565664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.566934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] PATH_INFO: `/v3/users/78d2d34c5b4543afa852554518160b98` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.568875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d2d34c5b4543afa852554518160b98)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:00.571567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:00.599753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1a37658a-c8a3-4a20-b432-b8aa4ac56449 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.622988 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2953/5953] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:00 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:00.674313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d2d34c5b4543afa852554518160b98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.684829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d2d34c5b4543afa852554518160b98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.686068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d2d34c5b4543afa852554518160b98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.686744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d2d34c5b4543afa852554518160b98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.695494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d2d34c5b4543afa852554518160b98'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:00.724883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3001/5954] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:00 2022] DELETE /identity/v3/users/78d2d34c5b4543afa852554518160b98 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:00.729691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:00.729962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:00.730248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:00.754244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:00.755542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:00.898671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2954/5955] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:00.908601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:00.910409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:01.014470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94184e0-2692-4561-838f-9abbbf2a81db admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:01.018336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:01.019000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.019287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.019573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.030723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:01.032338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:01.043881 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3002/5956] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:01.457735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:01.461299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:01.475264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0951b-517a-4c69-98b4-6da00d4e7848 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:01.483228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:01.484273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.485180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.485180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] PATH_INFO: `/v3/projects/64a3bb61857042109e146283da987142` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.486516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a3bb61857042109e146283da987142)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:01.488927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:01.552284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a3bb61857042109e146283da987142', 'request_id': 'req-7fdc30bf-2bcf-4501-9178-24eab6135159'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.560568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a3bb61857042109e146283da987142', 'request_id': 'req-7fdc30bf-2bcf-4501-9178-24eab6135159'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.574089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a3bb61857042109e146283da987142', 'request_id': 'req-7fdc30bf-2bcf-4501-9178-24eab6135159'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.608813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] The token cache is being invalidate because project 64a3bb61857042109e146283da987142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:01.609770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.610515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7fdc30bf-2bcf-4501-9178-24eab6135159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.615271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2955/5957] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:01 2022] DELETE /identity/v3/projects/64a3bb61857042109e146283da987142 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:01.616583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:01.627397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd11d5-188e-4b10-8c29-996c6ce929d5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.628307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd11d5-188e-4b10-8c29-996c6ce929d5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.628695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd11d5-188e-4b10-8c29-996c6ce929d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.628957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9d17d-a35b-4bab-a5da-110028a8a1c5 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:01.657237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0ebd11d5-188e-4b10-8c29-996c6ce929d5 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:01.659665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ebd11d5-188e-4b10-8c29-996c6ce929d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:01.665955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2956/5958] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:01.693242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.693778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.694460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.726179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:01.728641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:01.740225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:01.741017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.741638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.742329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] PATH_INFO: `/v3/users/74caef36f7b9452db0711641072852f3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.746198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74caef36f7b9452db0711641072852f3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:01.748773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:01.825158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74caef36f7b9452db0711641072852f3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.839492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74caef36f7b9452db0711641072852f3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.840943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74caef36f7b9452db0711641072852f3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.843373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2957/5959] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:01.843657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74caef36f7b9452db0711641072852f3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.847723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:01.857036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352071-20db-4aef-8fa1-edda0ebd11fe None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:01.859354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74caef36f7b9452db0711641072852f3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.862433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fbcf8-c7d8-4ede-a139-0b0490aeb80e tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:01.863779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbcf8-c7d8-4ede-a139-0b0490aeb80e tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:01.864136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbcf8-c7d8-4ede-a139-0b0490aeb80e tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:01.864680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fbcf8-c7d8-4ede-a139-0b0490aeb80e tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:01.891626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3003/5960] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:01 2022] DELETE /identity/v3/users/74caef36f7b9452db0711641072852f3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:01.935736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f2fbcf8-c7d8-4ede-a139-0b0490aeb80e tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:01.956998 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2958/5961] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:01 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:02.897152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:02.899389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:02.959438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224527-392c-4ed5-878c-6d9998bcea96 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:02.960372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224527-392c-4ed5-878c-6d9998bcea96 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:02.960823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc224527-392c-4ed5-878c-6d9998bcea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.005295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fc224527-392c-4ed5-878c-6d9998bcea96 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:03.007091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc224527-392c-4ed5-878c-6d9998bcea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:03.015233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2959/5962] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:12:03.040337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247918c-7b89-45f2-92f6-891037adf20d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.045984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.046859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.047152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.047435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] PATH_INFO: `/v3/projects/a9bdd108e019416fb32289a85a21c48d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.048770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bdd108e019416fb32289a85a21c48d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.053309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.116942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bdd108e019416fb32289a85a21c48d', 'request_id': 'req-9a15634f-3748-42a8-b79c-cabd84692ddd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:03.131674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bdd108e019416fb32289a85a21c48d', 'request_id': 'req-9a15634f-3748-42a8-b79c-cabd84692ddd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:03.145274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bdd108e019416fb32289a85a21c48d', 'request_id': 'req-9a15634f-3748-42a8-b79c-cabd84692ddd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:03.163867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] The token cache is being invalidate because project a9bdd108e019416fb32289a85a21c48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:03.164224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:03.164852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9a15634f-3748-42a8-b79c-cabd84692ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:03.168526 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3004/5963] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:02 2022] DELETE /identity/v3/projects/a9bdd108e019416fb32289a85a21c48d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:03.171417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.171871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.172245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.207339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:03.208919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:03.331444 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2960/5964] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:03.333345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.335138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.335533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.363455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:03.365497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:03.378213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3005/5965] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:03.382695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.399970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22daa-caa9-49ac-85ae-2e7e55533028 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.412393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.413243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.413713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.414107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.414968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:03.415671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.419805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.444986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2961/5966] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:03.446179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.471526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcee6e-c517-4837-a73d-d039fb0880dd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.492982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.494577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.494577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.494577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.495381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.498580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.568223 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3006/5967] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:03 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:03.572317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.590784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a3db-2246-436d-99e1-72466eb217de admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.755827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.758649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.759102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.759871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.760872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.764561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.814932 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2962/5968] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:03 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:03.818768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.832531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd76e2-2b58-40d8-84f9-458733a6a7e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.842270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.842969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.843254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.843530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.844261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.846240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.864824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3007/5969] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:03.865343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.879050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8433e2d-12b1-4047-9fd8-997ec5b9f756 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.884738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.885542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.886614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.886614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.886957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.889626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6fd59-5342-493c-b7eb-e03a66f562a2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:03.921620 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2963/5970] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:03.922840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:03.938224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107310-c631-46b7-a82c-dcd9869a7620 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:03.954130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:03.955142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:03.955583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:03.955874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] PATH_INFO: `/v3/projects/bae97a06f9074f58b95b197c4118107b/users/472930a7e6ab4c3b8196f5aba8e698a2/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:03.984487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae97a06f9074f58b95b197c4118107b, user_id=472930a7e6ab4c3b8196f5aba8e698a2, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:03.987219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c178b-04f7-4bf5-8eb6-2c272b2a90f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:04.011919 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3008/5971] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:03 2022] PUT /identity/v3/projects/bae97a06f9074f58b95b197c4118107b/users/472930a7e6ab4c3b8196f5aba8e698a2/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:04.021244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d81e4-0e1f-40d2-b74f-7cb5536bf9e7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.022147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d81e4-0e1f-40d2-b74f-7cb5536bf9e7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.024838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d81e4-0e1f-40d2-b74f-7cb5536bf9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.028997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.029624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.030196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.084861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-db1d81e4-0e1f-40d2-b74f-7cb5536bf9e7 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:04.086684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db1d81e4-0e1f-40d2-b74f-7cb5536bf9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:04.129231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] MFA Rules not processed for user `472930a7e6ab4c3b8196f5aba8e698a2`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:04.130472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:04.235635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2964/5972] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:04.237771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0af98-74e4-467f-bb06-b605178e0884 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.238257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0af98-74e4-467f-bb06-b605178e0884 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.238695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0af98-74e4-467f-bb06-b605178e0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.268760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e6c0af98-74e4-467f-bb06-b605178e0884 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:04.270197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6c0af98-74e4-467f-bb06-b605178e0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:04.280335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2965/5973] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:04.282151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68001bb-fd00-41bd-a7cd-802a8099e7ad None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.282602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68001bb-fd00-41bd-a7cd-802a8099e7ad None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.283039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68001bb-fd00-41bd-a7cd-802a8099e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.294236 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3009/5974] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:04.299519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:04.413745 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-d68001bb-fd00-41bd-a7cd-802a8099e7ad None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:12:04.416475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2966/5975] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 135 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 02 21:12:04.421550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737645a7-d69e-400a-ad0a-0915d14da849 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.421846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737645a7-d69e-400a-ad0a-0915d14da849 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.422180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737645a7-d69e-400a-ad0a-0915d14da849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.434645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8aef03-8d9d-43b1-bad2-0a11e20a69fc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:04.459126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:04.459501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.459886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.460300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.461146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:04.463398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:04.499858 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-737645a7-d69e-400a-ad0a-0915d14da849 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:12:04.509563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2967/5976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 89 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Apr 02 21:12:04.514586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.515091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.515511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.522763 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3010/5977] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:04.523849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:04.569886 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:12:04.582664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2968/5978] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 72 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 02 21:12:04.673993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596a7-9619-4522-987d-3fe33f31ba42 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:04.688064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:04.688812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.689791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.690083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.698926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:04.701568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:04.746890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3011/5979] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:04 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:04.750934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:04.765879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec843-885b-40e0-8d51-c577d3349876 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:04.770769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:04.771448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.771736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.772019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.772784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:04.774389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:04.789575 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2969/5980] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:04.790657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:04.805935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684ef9-ed0a-4a44-9945-7f173d8034c6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:04.815570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:04.818072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:04.818451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:04.818807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] PATH_INFO: `/v3/projects/24d28d1552324b0390b2ad8d387fa01d/users/ff3c1d43707943179b22e07f2856f3a4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:04.844352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d28d1552324b0390b2ad8d387fa01d, user_id=ff3c1d43707943179b22e07f2856f3a4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:04.847932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:04.875211 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3012/5981] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:04 2022] PUT /identity/v3/projects/24d28d1552324b0390b2ad8d387fa01d/users/ff3c1d43707943179b22e07f2856f3a4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:04.876725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:04.896448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e854c32-11c0-43d2-af82-59001a4b8deb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.022264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.022956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.023239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.023800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.024572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.026711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a894a-d538-41c3-b30f-ac519f8ace2d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.054504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.061152 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2970/5982] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:05.088346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2db15-7278-4d17-a767-3b10bde72b56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.117286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.120316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.120880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.121944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] PATH_INFO: `/v3/projects/24d28d1552324b0390b2ad8d387fa01d/users/ff3c1d43707943179b22e07f2856f3a4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.124111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d28d1552324b0390b2ad8d387fa01d, user_id=ff3c1d43707943179b22e07f2856f3a4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.126944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.152517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3013/5983] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:05 2022] PUT /identity/v3/projects/24d28d1552324b0390b2ad8d387fa01d/users/ff3c1d43707943179b22e07f2856f3a4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:05.166566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.166871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.167135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.240700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] MFA Rules not processed for user `ff3c1d43707943179b22e07f2856f3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:05.241998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:05.415738 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2971/5984] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:05.419044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.433234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732aa1-2a2f-4c26-9750-ea179b19182b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.439281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.440139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.440619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.441080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.441913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.445947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.497273 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3014/5985] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:05 2022] POST /identity/v3/projects => generated 358 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:05.501909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.513716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b3cf2-e25f-4bcc-b135-fb717dca7406 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.628491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.629675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.630180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.630556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-320787390` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.639528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=c58642e40bc94e7a8944050bb298722b, value=tempest-tag-320787390)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.643193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.709595 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-320787390. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:12:05.709595 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:12:05.709595 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:12:05.747019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2972/5986] 10.222.0.18 () {60 vars in 1329 bytes} [Sat Apr 2 21:12:05 2022] PUT /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-320787390 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Apr 02 21:12:05.751911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.767173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb8d53-be20-4017-8009-c2a5805bea18 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.782208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.783356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.783795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.784218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-320787390` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.798202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=c58642e40bc94e7a8944050bb298722b, value=tempest-tag-320787390)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.801330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.818853 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3015/5987] 10.222.0.18 () {58 vars in 1310 bytes} [Sat Apr 2 21:12:05 2022] GET /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-320787390 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:05.823415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.842460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e797-1997-4fdd-8ec4-bc99aa6d90d3 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.851492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.852553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.852949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.853341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.858412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=c58642e40bc94e7a8944050bb298722b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.860740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:05.957173 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2973/5988] 10.222.0.18 () {60 vars in 1264 bytes} [Sat Apr 2 21:12:05 2022] PUT /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags => generated 139 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:05.958008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:05.969626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1dc30-6d1b-41f7-bb06-5ed161dd7f2f tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:05.975638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:05.976892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:05.977426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:05.977916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:05.993544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=c58642e40bc94e7a8944050bb298722b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:05.997101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.016072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.027276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b8122-827d-4c61-b122-f81cf8b71302 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:06.028559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3016/5989] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:12:05 2022] GET /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags => generated 139 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:06.033848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:06.036894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:06.036894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:06.036894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-1460636452` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:06.037895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=c58642e40bc94e7a8944050bb298722b, value=tempest-tag-1460636452)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:06.041002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.095810 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1460636452. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:12:06.095810 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:12:06.095810 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:12:06.107112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.108389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2974/5990] 10.222.0.18 () {58 vars in 1316 bytes} [Sat Apr 2 21:12:06 2022] DELETE /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-1460636452 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:06.124386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075f8-ea0e-4d4c-9522-659e1fbaa51b tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:06.136070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:06.137401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:06.137844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:06.138304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-1460636452` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:06.152734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=c58642e40bc94e7a8944050bb298722b, value=tempest-tag-1460636452)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:06.155045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.185704 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Could not find project tag: tempest-tag-1460636452.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1460636452. Apr 02 21:12:06.186982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3017/5991] 10.222.0.18 () {58 vars in 1313 bytes} [Sat Apr 2 21:12:06 2022] GET /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags/tempest-tag-1460636452 => generated 107 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:12:06.191674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.209131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c72ae0-ad3a-4d3b-a367-6d8205219c6d tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:06.223410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:06.224593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:06.225035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:06.225470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:06.227033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=c58642e40bc94e7a8944050bb298722b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:06.229730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.316855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2975/5992] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:12:06 2022] DELETE /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:06.318554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.333404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531cbbc-c74a-4794-885c-6cc95c20f5b9 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:06.346475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:06.348554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:06.348954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:06.351524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b/tags` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:06.423578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=c58642e40bc94e7a8944050bb298722b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:06.431078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.471996 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3018/5993] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:12:06 2022] GET /identity/v3/projects/c58642e40bc94e7a8944050bb298722b/tags => generated 66 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:12:06.476480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.495342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9efb31-f554-409c-bb3b-e174a55653f2 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:06.511487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff3c1d43707943179b22e07f2856f3a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24d28d1552324b0390b2ad8d387fa01d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:06.513691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:06.513999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:06.514292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] PATH_INFO: `/v3/projects/c58642e40bc94e7a8944050bb298722b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:06.517366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c58642e40bc94e7a8944050bb298722b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:06.519326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:06.662004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58642e40bc94e7a8944050bb298722b', 'request_id': 'req-a430a259-77e9-4d62-9679-bd3392dccc56'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:06.700813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58642e40bc94e7a8944050bb298722b', 'request_id': 'req-a430a259-77e9-4d62-9679-bd3392dccc56'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:06.724700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58642e40bc94e7a8944050bb298722b', 'request_id': 'req-a430a259-77e9-4d62-9679-bd3392dccc56'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:06.762571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] The token cache is being invalidate because project c58642e40bc94e7a8944050bb298722b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:06.762993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:06.763647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a430a259-77e9-4d62-9679-bd3392dccc56 tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:06.766165 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2976/5994] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:06 2022] DELETE /identity/v3/projects/c58642e40bc94e7a8944050bb298722b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:06.772040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:06.774167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:06.907195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4bb25-204b-426b-aeeb-223f64bd90df tempest-IdentityV3ProjectTagsTest-1216621147 tempest-IdentityV3ProjectTagsTest-1216621147-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:07.042367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:07.043313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:07.043596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:07.043873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] PATH_INFO: `/v3/users/472930a7e6ab4c3b8196f5aba8e698a2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:07.047456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472930a7e6ab4c3b8196f5aba8e698a2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:07.050365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:07.127767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472930a7e6ab4c3b8196f5aba8e698a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:07.143500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472930a7e6ab4c3b8196f5aba8e698a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:07.145348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472930a7e6ab4c3b8196f5aba8e698a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:07.147039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472930a7e6ab4c3b8196f5aba8e698a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:07.171511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472930a7e6ab4c3b8196f5aba8e698a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:07.201226 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3019/5995] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:06 2022] DELETE /identity/v3/users/472930a7e6ab4c3b8196f5aba8e698a2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:07.203252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:07.203846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:07.204239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:07.236779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:07.239025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:07.358921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2977/5996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:07.366183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:07.367641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:07.537934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6a3fb-4c0c-4503-893d-61b1b18c5119 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:07.544173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:07.544966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:07.545899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:07.546201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:07.565764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:07.576822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:07.604313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3020/5997] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:08.554212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:08.557225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:08.580377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779a9bf-c8c9-4b99-a40e-142d17f44948 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:08.589068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:08.590079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:08.590372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:08.592674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] PATH_INFO: `/v3/projects/bae97a06f9074f58b95b197c4118107b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:08.594522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae97a06f9074f58b95b197c4118107b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:08.598856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:08.690358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae97a06f9074f58b95b197c4118107b', 'request_id': 'req-d7750c69-a9a5-4d94-8de7-be4a77014a97'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:08.698457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae97a06f9074f58b95b197c4118107b', 'request_id': 'req-d7750c69-a9a5-4d94-8de7-be4a77014a97'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:08.715762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae97a06f9074f58b95b197c4118107b', 'request_id': 'req-d7750c69-a9a5-4d94-8de7-be4a77014a97'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:08.749966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] The token cache is being invalidate because project bae97a06f9074f58b95b197c4118107b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:08.750435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:08.752933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:08.756276 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2978/5998] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:08 2022] DELETE /identity/v3/projects/bae97a06f9074f58b95b197c4118107b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:08.759908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:08.774880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ee644-ca43-42e3-9f10-bca50d655900 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:08.866217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:08.867264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:08.867618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:08.867969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] PATH_INFO: `/v3/users/ff3c1d43707943179b22e07f2856f3a4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:08.869305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3c1d43707943179b22e07f2856f3a4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:08.872717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:08.988472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3c1d43707943179b22e07f2856f3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.005771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3c1d43707943179b22e07f2856f3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.006958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3c1d43707943179b22e07f2856f3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.008125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3c1d43707943179b22e07f2856f3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.042758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16ba98b6-9b85-432a-94bc-ed6cb030d5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3c1d43707943179b22e07f2856f3a4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.094176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3021/5999] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:08 2022] DELETE /identity/v3/users/ff3c1d43707943179b22e07f2856f3a4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:09.355944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:09.359535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:09.375378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750c69-a9a5-4d94-8de7-be4a77014a97 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:09.545245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:09.546153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:09.546485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:09.546991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] PATH_INFO: `/v3/users/335fbcc3a06743aca0e49eb4f945ba08` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:09.548751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335fbcc3a06743aca0e49eb4f945ba08)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:09.550700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:09.624091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335fbcc3a06743aca0e49eb4f945ba08'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.644807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335fbcc3a06743aca0e49eb4f945ba08'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.645804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335fbcc3a06743aca0e49eb4f945ba08'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.657178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335fbcc3a06743aca0e49eb4f945ba08'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.680913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335fbcc3a06743aca0e49eb4f945ba08'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.696960 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2979/6000] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:09 2022] DELETE /identity/v3/users/335fbcc3a06743aca0e49eb4f945ba08 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:09.702292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:09.702593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:09.702898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:09.718240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:09.733928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:09.766021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:09.769298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:09.827905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d14ce-8fac-4a10-85b5-18447fae6dc7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:09.833236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:09.834422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:09.835059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:09.835548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] PATH_INFO: `/v3/projects/24d28d1552324b0390b2ad8d387fa01d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:09.837046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d28d1552324b0390b2ad8d387fa01d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:09.839372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:09.859389 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3022/6001] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:09.869189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:09.873780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:09.928272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d28d1552324b0390b2ad8d387fa01d', 'request_id': 'req-d188b780-023a-4345-a959-18e456281ed4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.946143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d28d1552324b0390b2ad8d387fa01d', 'request_id': 'req-d188b780-023a-4345-a959-18e456281ed4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.959903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d28d1552324b0390b2ad8d387fa01d', 'request_id': 'req-d188b780-023a-4345-a959-18e456281ed4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.974292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3515-4b15-470d-9d9e-e4a684be6905 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:09.986439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] The token cache is being invalidate because project 24d28d1552324b0390b2ad8d387fa01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:09.986731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.987713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d188b780-023a-4345-a959-18e456281ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:09.995982 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2980/6002] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:09 2022] DELETE /identity/v3/projects/24d28d1552324b0390b2ad8d387fa01d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:09.997688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479d24-1ef3-4b24-9efa-7b397a12868b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:09.997982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479d24-1ef3-4b24-9efa-7b397a12868b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:09.998264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479d24-1ef3-4b24-9efa-7b397a12868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.032429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-42479d24-1ef3-4b24-9efa-7b397a12868b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:10.045487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-42479d24-1ef3-4b24-9efa-7b397a12868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.051194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.051848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.052137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.052490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.054271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.110846 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2981/6003] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:10.119162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.119468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.119728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.140825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:10.142059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.143500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.145246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.154491 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2982/6004] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:10.155393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.160258 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3023/6005] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:10.177490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77350538-7e52-4321-aeeb-77e9e434fc4a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.188074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.189125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.189528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.190167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.191148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:10.191634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.194961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.211463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2983/6006] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:10.216334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.227631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca15e-1d11-4d45-985c-04526b4693fe service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.240617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.241582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.241859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.242137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.242977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.244959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.280977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3024/6007] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:10.283380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.294678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc6ef4-406e-406e-99b8-28ed1cbe5362 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.379201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.382468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.382468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.382468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.382468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.392500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.392763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.394786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.436363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2984/6008] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:10.437878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.442062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a035541-37f1-4de0-ba36-ccc1f023cdc7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.458351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15842-3339-47bd-bd28-0ab14daae775 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.463549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.463765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.463880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.464171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.464470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.464887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.465172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.465409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.465528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] PATH_INFO: `/v3/projects/7568e68b76ba4608936b1cd4ed8033fa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.466636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7568e68b76ba4608936b1cd4ed8033fa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.469188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.469622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.482097 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2985/6009] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:10.486367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.499713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907022b2-7e2c-46ca-858b-567f01381234 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.506721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.507869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.508262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.508681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] PATH_INFO: `/v3/projects/3783866f686049828c97f69f878b5b44/users/63ee604c2e464c37b3d160c2f329ab8f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.529132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3783866f686049828c97f69f878b5b44, user_id=63ee604c2e464c37b3d160c2f329ab8f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.532049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.534190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7568e68b76ba4608936b1cd4ed8033fa', 'request_id': 'req-a5afc85a-fb11-46ea-98de-b1ac438e462d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:10.543320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7568e68b76ba4608936b1cd4ed8033fa', 'request_id': 'req-a5afc85a-fb11-46ea-98de-b1ac438e462d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:10.553469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7568e68b76ba4608936b1cd4ed8033fa', 'request_id': 'req-a5afc85a-fb11-46ea-98de-b1ac438e462d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:10.555579 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2986/6010] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:10 2022] PUT /identity/v3/projects/3783866f686049828c97f69f878b5b44/users/63ee604c2e464c37b3d160c2f329ab8f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:10.560310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.571816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] The token cache is being invalidate because project 7568e68b76ba4608936b1cd4ed8033fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:10.572109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:10.572803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a5afc85a-fb11-46ea-98de-b1ac438e462d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:10.574681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3025/6011] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:10 2022] DELETE /identity/v3/projects/7568e68b76ba4608936b1cd4ed8033fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:10.579786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0ba4-a2d4-4df0-91a4-fc635a8a7c09 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.580629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0ba4-a2d4-4df0-91a4-fc635a8a7c09 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.581358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0ba4-a2d4-4df0-91a4-fc635a8a7c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.603269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e9ea0ba4-a2d4-4df0-91a4-fc635a8a7c09 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:10.604704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9ea0ba4-a2d4-4df0-91a4-fc635a8a7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.644551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb519-5e93-487a-9331-a88bea33c495 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.658705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.659295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.659728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.660016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.660788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.666994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.676433 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3026/6012] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:10.686250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164288-db39-4ef1-a995-42313b097410 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.686580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164288-db39-4ef1-a995-42313b097410 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.686865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164288-db39-4ef1-a995-42313b097410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.704604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2987/6013] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:10.705832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.707802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.720782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a1164288-db39-4ef1-a995-42313b097410 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:10.722174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a1164288-db39-4ef1-a995-42313b097410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.725333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ddfab-3ebc-40c1-a743-e1218cc8f921 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.731481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.732378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.732876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.733168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] PATH_INFO: `/v3/projects/3783866f686049828c97f69f878b5b44/users/63ee604c2e464c37b3d160c2f329ab8f/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.736610 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3027/6014] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:10.737139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3783866f686049828c97f69f878b5b44, user_id=63ee604c2e464c37b3d160c2f329ab8f, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.738095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1164288-db39-4ef1-a995-42313b097410 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.739963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0803-007c-4622-83d3-d5d6ab52c029 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.751141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1164288-db39-4ef1-a995-42313b097410 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.764426 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2988/6015] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:10 2022] PUT /identity/v3/projects/3783866f686049828c97f69f878b5b44/users/63ee604c2e464c37b3d160c2f329ab8f/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:10.782217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.782571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.783020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.822240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] MFA Rules not processed for user `63ee604c2e464c37b3d160c2f329ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:10.823489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:10.826057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.827039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.827461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.827878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.830456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:10.830456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.832226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.850878 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3028/6016] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:10.852369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.864067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121e7b-498c-4feb-9740-a598399af45e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.869281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.869954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.870242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.870522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.871872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.874077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.907790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3029/6017] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/projects => generated 353 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:10.909094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.914589 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2989/6018] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:10.918750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:10.931645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d716b8-3b57-4ca2-a8fa-0cce767f4276 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.990840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e19f46-17d5-4d5f-975c-3ee87e172466 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:10.995196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:10.996415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:10.996849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:10.997128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:10.997837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:10.999734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:10.999851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.000664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.001051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.001472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.002380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.004367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.036580 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2990/6020] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:11.036760 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3030/6020] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:10 2022] POST /identity/v3/users => generated 277 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:11.037182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.038883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.055338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aa1c2-3ad8-49e1-83b8-ea366d07019d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.113211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93680-c6f5-47be-9bbc-c3f9835b9338 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.118931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.119611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.119979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.120280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.125565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.125565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.138572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2991/6021] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:11.142651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.158964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbd5ab-fef6-4c0f-817e-ba29a41d8994 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.171430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.172910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.174416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.175417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.177476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.180784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.185239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.186981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.188311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.191262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.191909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.196045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.202185 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2992/6022] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:11.207705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.226574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d60ab-9579-47f4-a3f9-622e9b2d47e4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.243023 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3031/6023] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:11 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:11.244234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.249489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.250555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.253827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.253827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] PATH_INFO: `/v3/projects/795304c20988423aaed6e4a9516b371a/users/6f8ea779956847f8bf21d3cc49e55445/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.272265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2e308-1dd7-47f5-bdea-ac149b1de5a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.282656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.283664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.284097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.284673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.285972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.288909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.291616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=795304c20988423aaed6e4a9516b371a, user_id=6f8ea779956847f8bf21d3cc49e55445, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.296614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b07611-4318-40be-a41b-d60b6645e41c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.303699 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3032/6024] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:11.308186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.328751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deca11e-1297-4b19-bd9a-24cf61cc993b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.336699 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2993/6025] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:11 2022] PUT /identity/v3/projects/795304c20988423aaed6e4a9516b371a/users/6f8ea779956847f8bf21d3cc49e55445/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:11.348304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1821-5701-4495-a939-725777740620 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.348770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1821-5701-4495-a939-725777740620 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.349419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc1821-5701-4495-a939-725777740620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.386977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d8bc1821-5701-4495-a939-725777740620 None None] MFA Rules not processed for user `6f8ea779956847f8bf21d3cc49e55445`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:11.388398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8bc1821-5701-4495-a939-725777740620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:11.535043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.535977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.536436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.536921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.537796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.540367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.557176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3033/6026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:11.561647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.568496 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2994/6027] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:11.579027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6066d-d919-4810-9f21-72363e3a3b4d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.584006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc1821-5701-4495-a939-725777740620 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.585644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8bc1821-5701-4495-a939-725777740620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:11.586233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.587146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.587432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.587710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] PATH_INFO: `/v3/projects/318b8fe0638541349f4a2173906fc4e7/users/87e9eab22b2b47138bce703aef3bde2a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.620402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=318b8fe0638541349f4a2173906fc4e7, user_id=87e9eab22b2b47138bce703aef3bde2a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.624611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7310bdf-c7ba-47b0-b887-3fcb3c7df52a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.670283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc1821-5701-4495-a939-725777740620 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.687327 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3034/6028] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:11 2022] PUT /identity/v3/projects/318b8fe0638541349f4a2173906fc4e7/users/87e9eab22b2b47138bce703aef3bde2a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:11.692173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.695429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.695723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.733725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] MFA Rules not processed for user `87e9eab22b2b47138bce703aef3bde2a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:11.735251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:11.741393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.742028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.742391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.742739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:11.835994 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3035/6029] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:11.851079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:11.854856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:11.880908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:11.882365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8852543-5314-4efd-82d2-2b3c765e940d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:11.897416 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2995/6030] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:11.941923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53decf7f-af51-4f84-b8d7-cb5cef69fb36 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:11.958184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:11.959003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:11.959364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:11.959730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:12.059724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:12.061558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:12.075433 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3036/6031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:12.775834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd8ce-d8be-440f-be8c-7477dd68f912 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:12.776330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd8ce-d8be-440f-be8c-7477dd68f912 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:12.776414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dd8ce-d8be-440f-be8c-7477dd68f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:12.820843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f19dd8ce-d8be-440f-be8c-7477dd68f912 None None] MFA Rules not processed for user `106bbc9055cf4eef9b5fecb873c9385f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:12.822110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f19dd8ce-d8be-440f-be8c-7477dd68f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:12.912777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:12.949502 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2996/6032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:13.045945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e0f90-6560-4401-80a1-1f726ec1a39b service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:13.050799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:13.051776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:13.052258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:13.052762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] PATH_INFO: `/v3/users/63ee604c2e464c37b3d160c2f329ab8f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:13.054211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ee604c2e464c37b3d160c2f329ab8f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:13.056513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:13.155783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ee604c2e464c37b3d160c2f329ab8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:13.171501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ee604c2e464c37b3d160c2f329ab8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:13.172414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ee604c2e464c37b3d160c2f329ab8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:13.173265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ee604c2e464c37b3d160c2f329ab8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:13.202731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ee604c2e464c37b3d160c2f329ab8f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:13.257891 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3037/6033] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:12 2022] DELETE /identity/v3/users/63ee604c2e464c37b3d160c2f329ab8f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:13.261018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:13.268900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:13.272144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:13.344497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:13.346956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:13.478159 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2997/6034] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:13.489380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:13.491289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:13.610862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89cd45-2688-4a83-8d18-c21ea0222818 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:13.616418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:13.617429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:13.617738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:13.618018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:13.681105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:13.682732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:13.696483 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3038/6035] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:14.019798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:14.023558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.144161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738fcd-915a-4032-b106-8e0f5902ee04 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:14.149440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:14.150208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:14.150387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:14.150671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:14.153652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.173413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:14.175269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c5893-d02c-47b0-8ef2-b54cfcef7886 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:14.196550 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2998/6036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:14.302380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:14.305889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.335986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aa0f7-3fbb-4c1a-b186-a55b14cd3204 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:14.364731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:14.367067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:14.367363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:14.367658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] PATH_INFO: `/v3/projects/3783866f686049828c97f69f878b5b44` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:14.371111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3783866f686049828c97f69f878b5b44)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:14.373768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:14.438088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:14.438484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:14.438960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:14.467212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:14.468789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.512982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3783866f686049828c97f69f878b5b44', 'request_id': 'req-212614dc-9c38-430e-b66b-2d28455628d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.523489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3783866f686049828c97f69f878b5b44', 'request_id': 'req-212614dc-9c38-430e-b66b-2d28455628d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.536236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3783866f686049828c97f69f878b5b44', 'request_id': 'req-212614dc-9c38-430e-b66b-2d28455628d7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.551918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] The token cache is being invalidate because project 3783866f686049828c97f69f878b5b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:14.552493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.553418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.555560 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3039/6037] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:14 2022] DELETE /identity/v3/projects/3783866f686049828c97f69f878b5b44 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:14.560047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:14.564330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.588390 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 2999/6038] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:14.609309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:14.610988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.682907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212614dc-9c38-430e-b66b-2d28455628d7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:14.689780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:14.690748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:14.691105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:14.691496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] PATH_INFO: `/v3/users/87e9eab22b2b47138bce703aef3bde2a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:14.692823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e9eab22b2b47138bce703aef3bde2a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:14.695134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:14.724554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff34e0-7c09-4156-8700-38b8a89f9bc0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:14.753333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e9eab22b2b47138bce703aef3bde2a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.762829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e9eab22b2b47138bce703aef3bde2a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.763697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e9eab22b2b47138bce703aef3bde2a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.764566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e9eab22b2b47138bce703aef3bde2a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.771750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e9eab22b2b47138bce703aef3bde2a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:14.803750 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3040/6039] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:14 2022] DELETE /identity/v3/users/87e9eab22b2b47138bce703aef3bde2a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:14.804673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:14.805458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:14.805759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:14.806198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:14.809129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:14.903839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:14.905157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:14.916985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3000/6040] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:12:15.364007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:15.366465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.495181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:15.497852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.530272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429667-942e-4c87-9b63-925ab110dec6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:15.536318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f293-e742-4f24-aafe-efe2f2f4c9f8 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:15.555267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:15.556905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.557347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.561546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] PATH_INFO: `/v3/users/6f8ea779956847f8bf21d3cc49e55445` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:15.564980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8ea779956847f8bf21d3cc49e55445)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:15.567881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:15.577492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:15.578618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.579054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.579638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] PATH_INFO: `/v3/projects/318b8fe0638541349f4a2173906fc4e7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:15.581220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] RBAC: Authorizing `identity:delete_project(project_id=318b8fe0638541349f4a2173906fc4e7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:15.583462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:15.684665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318b8fe0638541349f4a2173906fc4e7', 'request_id': 'req-507409ac-ab03-4e88-8c0b-44f6aa8c657e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.692141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318b8fe0638541349f4a2173906fc4e7', 'request_id': 'req-507409ac-ab03-4e88-8c0b-44f6aa8c657e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.692961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8ea779956847f8bf21d3cc49e55445'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.703237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8ea779956847f8bf21d3cc49e55445'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.705445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8ea779956847f8bf21d3cc49e55445'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.706928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8ea779956847f8bf21d3cc49e55445'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.708339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318b8fe0638541349f4a2173906fc4e7', 'request_id': 'req-507409ac-ab03-4e88-8c0b-44f6aa8c657e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.717304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-64b12a88-febb-4c35-a3aa-81d8dd0cbb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8ea779956847f8bf21d3cc49e55445'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.728938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] The token cache is being invalidate because project 318b8fe0638541349f4a2173906fc4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:15.729563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.730505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-507409ac-ab03-4e88-8c0b-44f6aa8c657e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:15.732429 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3001/6041] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:15 2022] DELETE /identity/v3/projects/318b8fe0638541349f4a2173906fc4e7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:15.747096 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3041/6042] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:15 2022] DELETE /identity/v3/users/6f8ea779956847f8bf21d3cc49e55445 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:15.748693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249173fc-16e9-43a4-b4bf-4f6bff434f1a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.748986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249173fc-16e9-43a4-b4bf-4f6bff434f1a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.749349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249173fc-16e9-43a4-b4bf-4f6bff434f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:15.750814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.751113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.751376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:15.809987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-249173fc-16e9-43a4-b4bf-4f6bff434f1a None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:15.811111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-249173fc-16e9-43a4-b4bf-4f6bff434f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.820299 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3042/6043] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:15 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:15.821331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:15.822454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0a87-5434-4231-afcb-20d29eab644a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.822575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.823403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0a87-5434-4231-afcb-20d29eab644a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.824962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0a87-5434-4231-afcb-20d29eab644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:15.849292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9fb0a87-5434-4231-afcb-20d29eab644a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:15.850713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9fb0a87-5434-4231-afcb-20d29eab644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.935274 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3002/6044] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:15.938471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:15.944990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:15.976043 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3043/6045] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:15.977706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:15.978730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:15.978730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.023789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:16.024830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.048373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3044/6046] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:16.048373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.048373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.125945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498453a3-a4d7-4f08-965a-d4bc5649c5a9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.135195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959088c8-9e08-4b91-ac79-2f66bb2ddafa tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.136394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959088c8-9e08-4b91-ac79-2f66bb2ddafa tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.137788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959088c8-9e08-4b91-ac79-2f66bb2ddafa tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.138080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959088c8-9e08-4b91-ac79-2f66bb2ddafa tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.149240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a312d3-9ece-4bad-b4e7-162197e636c2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.154057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.155310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.156500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.156998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.171307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.173699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.194885 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3045/6047] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:16.196240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.211510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ba3d3-063e-441e-8085-45d6ff70aff1 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.218034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.218745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.219032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.219793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.221065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:16.221445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.223807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.230661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-959088c8-9e08-4b91-ac79-2f66bb2ddafa tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.241853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3003/6048] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:15 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:16.244671 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3046/6049] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:16.245227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.245227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.245548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.248415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.271577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89715-183d-4a7d-ada6-147916a0bc0a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.278892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.279809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:16.279936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.280265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.280734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.280913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.281617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.286516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.341375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3047/6050] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:16.341812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.385516 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3004/6051] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:16.387367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.388758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.436709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a562-bd7e-4e88-b93b-a539df893527 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.451042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.452161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.453811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.454974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.456211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.459960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.490531 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3048/6052] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:16.491703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.494845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.521894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc46415-fee4-438f-91ca-f1198d0e1ac9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.532412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eda410-4fe5-43ff-8967-dbf1120b7d82 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.535266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.536236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.536632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.537040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] PATH_INFO: `/v3/projects/795304c20988423aaed6e4a9516b371a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.538643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=795304c20988423aaed6e4a9516b371a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.540571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.617665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.618766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.619280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.620024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.633297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795304c20988423aaed6e4a9516b371a', 'request_id': 'req-c83f8bc1-87a3-461a-952c-8cf66070d41c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.641893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795304c20988423aaed6e4a9516b371a', 'request_id': 'req-c83f8bc1-87a3-461a-952c-8cf66070d41c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.656007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795304c20988423aaed6e4a9516b371a', 'request_id': 'req-c83f8bc1-87a3-461a-952c-8cf66070d41c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.678414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] The token cache is being invalidate because project 795304c20988423aaed6e4a9516b371a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:16.678705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.680878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:16.685092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.689593 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3049/6053] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:16 2022] DELETE /identity/v3/projects/795304c20988423aaed6e4a9516b371a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:16.689737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e2555-2db5-4f11-a93f-65c5a15db689 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.690316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.696129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3005/6054] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:12:16.696501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.697580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba246-6311-417d-9914-2df26b310c5c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.697877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba246-6311-417d-9914-2df26b310c5c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.699147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ba246-6311-417d-9914-2df26b310c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.728604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-468ba246-6311-417d-9914-2df26b310c5c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:16.729966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-468ba246-6311-417d-9914-2df26b310c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.809211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f8bc1-87a3-461a-952c-8cf66070d41c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.814317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.815007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.815560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.815846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.816105 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3006/6055] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:16.816766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.817968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.818361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.818476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.818827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.833714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3050/6056] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:16.834886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.841923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:16.843273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:16.846967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c436b0-592b-4af0-99ce-ed70bb65eb94 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.851861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.852784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.853068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.853348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] PATH_INFO: `/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4/users/ce3c8155f94f43469fabd7b5797bc8e1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.861186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3007/6057] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:16.872874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3660bf129d614cc6b3ecdb6644b7ebb4, user_id=ce3c8155f94f43469fabd7b5797bc8e1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.875869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.879851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.889766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f26a2-0df2-48d7-9636-35aed2f319a1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.898876 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3051/6058] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:16 2022] PUT /identity/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4/users/ce3c8155f94f43469fabd7b5797bc8e1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:16.903230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.960060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:16.960793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:16.961141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:16.961689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:16.962147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:16.962464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:16.964133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:16.980124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3008/6059] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:16.984540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:16.988700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d712-fea2-4fdc-8e4c-bf578c10ec83 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.997692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0991b3d-6b17-4a6f-af75-d54e9b7656bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:16.999543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.000295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.001190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.001190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.001695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.003392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.004351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.005400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.005712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.006130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.006860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.008957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.023395 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3052/6060] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:17.024673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.041665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401f51-8442-4c1a-b466-e0e69fcc75d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.049259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.050444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.050785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.051154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] PATH_INFO: `/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4/users/ce3c8155f94f43469fabd7b5797bc8e1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.053764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3660bf129d614cc6b3ecdb6644b7ebb4, user_id=ce3c8155f94f43469fabd7b5797bc8e1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.056863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1df0e-4a6b-4037-ae57-68e96989adb0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.064615 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3009/6061] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:16 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:17.068649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.071453 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3053/6062] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:17 2022] PUT /identity/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4/users/ce3c8155f94f43469fabd7b5797bc8e1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:17.083825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b428b9-35fe-403e-abfd-d22bcc447354 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.084119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b428b9-35fe-403e-abfd-d22bcc447354 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.084464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b428b9-35fe-403e-abfd-d22bcc447354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.134062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e9b428b9-35fe-403e-abfd-d22bcc447354 None None] MFA Rules not processed for user `ce3c8155f94f43469fabd7b5797bc8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:17.137029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9b428b9-35fe-403e-abfd-d22bcc447354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.164929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726d6b3-0fb2-455b-9fc5-a4fba721016a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.231902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.233587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.234301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.234464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.235274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.240003 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3054/6063] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:17.240160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.240253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.240253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.240253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.258972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:17.260159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.264304 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3010/6064] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:17.264304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.275026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4458d1e-57b3-41bf-a7ef-57ce989c0f38 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.281779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.282507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.282798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.283078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.283762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.285743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d335ae-8f8c-437f-a2c4-f0b045ce1de9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.315008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3011/6065] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:17.316913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.317204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.317483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.319624 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3055/6066] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:17.320576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.332820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d3cd-9956-48bb-84cb-7f08de1dbe78 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.339270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:17.340495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.344129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3012/6067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:17.345011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.403072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.404194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.404513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.404966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.406911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.408971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.410388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7457c6-7d5f-41b2-9fb6-3d35a1ecd809 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.415055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.415730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.416028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.416303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.417022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.419788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fe2ff-c976-4059-ab69-a7ae253466d6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.420603 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3056/6068] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:17.421331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.423169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.446671 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3013/6069] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:17.448127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.448418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.448733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.457999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.510840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdca817-d082-43f3-ba0d-300bf6523ca7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.518858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.519533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.519825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.520110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.540303 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 02 21:12:17.541716 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3014/6070] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:12:17.545314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.561540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ba1f1-1a06-437c-9898-c5d5aa8d6e16 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.566445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.567117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.567403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.567685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.568415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.570051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.582335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3015/6071] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:17.583238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.590876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.592418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab2661-8276-4f5f-a8e9-54c42def279b service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.593655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35430cb6-6909-4b6d-a3e3-703c05bba6cb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.601209 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3057/6072] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:17.602564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.602858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.603502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.605860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.606957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.607465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.607846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.608985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.610906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.623562 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3016/6073] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:17.627721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.640178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdef92-1839-4060-933d-936139d15a72 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.647562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.648932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.649588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.649962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] PATH_INFO: `/v3/projects/93976f138574468d9d95622db5fa30af/users/4a7cf6e6711943319ec2c6f21db2204a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.663743 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:12:17.668515 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3058/6074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 65 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 02 21:12:17.668515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.671865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93976f138574468d9d95622db5fa30af, user_id=4a7cf6e6711943319ec2c6f21db2204a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.676657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.690341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3f2f-7b91-4d9f-8112-9158ef5f1c87 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.696855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.697589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.697882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.698164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.698970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.701176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a49d4e-71a2-4f9b-80db-9627ee29d0d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.716706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3059/6076] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:17.718646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf66a5-f23e-48c8-a858-c441ac070600 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.719218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf66a5-f23e-48c8-a858-c441ac070600 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.719695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf66a5-f23e-48c8-a858-c441ac070600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.725828 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3017/6076] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:17 2022] PUT /identity/v3/projects/93976f138574468d9d95622db5fa30af/users/4a7cf6e6711943319ec2c6f21db2204a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:17.726853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.773081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c4cf66a5-f23e-48c8-a858-c441ac070600 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:17.774447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c4cf66a5-f23e-48c8-a858-c441ac070600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.859825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8764f06-a084-4a50-90c5-383cb22c5a89 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.867022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3060/6077] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:17.868205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee6c6f-8d4f-4527-81b2-76e2e0df408f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.868693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee6c6f-8d4f-4527-81b2-76e2e0df408f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.870322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee6c6f-8d4f-4527-81b2-76e2e0df408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.874793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:17.875722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.876008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.876287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] PATH_INFO: `/v3/projects/b6cc76ab97dc4b3681828e8321f3a623/users/53d6043f8215405ab7fb084dce0cb841/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:17.894602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cc76ab97dc4b3681828e8321f3a623, user_id=53d6043f8215405ab7fb084dce0cb841, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:17.897101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:17.904010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ecee6c6f-8d4f-4527-81b2-76e2e0df408f None None] MFA Rules not processed for user `4a7cf6e6711943319ec2c6f21db2204a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:17.905250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ecee6c6f-8d4f-4527-81b2-76e2e0df408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:17.915874 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3018/6078] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:17 2022] PUT /identity/v3/projects/b6cc76ab97dc4b3681828e8321f3a623/users/53d6043f8215405ab7fb084dce0cb841/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:17.917053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:17.993949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3061/6079] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:17.994465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2dd44-157a-4f9b-81a4-62d0b8ad2d2a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:17.995220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:17.995518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:17.996388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.005238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.006259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.006559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.007078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.028681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] MFA Rules not processed for user `53d6043f8215405ab7fb084dce0cb841`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:18.030145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.065297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.078886 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3019/6080] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:18.079882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:18.081913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.143342 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3062/6081] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:18.156739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:18.158376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.173949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5aa7c-ebc4-40a0-91e2-bc8faece48db tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:18.178894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.179702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.180177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.180416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.238160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47dd83-a2a9-428b-a6ff-c94879fc530c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:18.242973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.243782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.244073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.244378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.259209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:18.261807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:18.275993 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3020/6082] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:18.289521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:18.342884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:18.344981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b438b5-e07b-4c7e-bbb0-962581499b0c service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:18.356737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3063/6083] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:18.369787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe1c5-a300-4bc1-b0f6-a7c49fdd47fa service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:18.395342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.397791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.399013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.399474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] PATH_INFO: `/v3/users/4a7cf6e6711943319ec2c6f21db2204a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.404161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7cf6e6711943319ec2c6f21db2204a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:18.408730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:18.501051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7cf6e6711943319ec2c6f21db2204a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.525169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7cf6e6711943319ec2c6f21db2204a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.526355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7cf6e6711943319ec2c6f21db2204a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.536927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7cf6e6711943319ec2c6f21db2204a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.545517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7cf6e6711943319ec2c6f21db2204a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:18.553026 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3021/6084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:18 2022] DELETE /identity/v3/users/4a7cf6e6711943319ec2c6f21db2204a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:18.558719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.559180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.559608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.580543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:18.582680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.656512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3064/6085] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:18.667921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:18.669780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.718887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:18.721396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.765811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e3091-43c7-4713-808e-1d801807aa1b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:18.772369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.773856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.774632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.775393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.796137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:18.798485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:18.811019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab73f0-296e-457d-b081-9138b0a157b4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:18.823446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:18.824546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:18.826845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:18.827734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:18.828633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3022/6086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:18.838285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:18.865525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:18.867883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f7886-074a-459b-80c5-dcb90d178900 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:18.892418 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3065/6087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:19.037840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.039954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.055324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d5e5-40d0-4502-914b-4cf67ae790fa service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.064182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.064624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.065041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.065376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] PATH_INFO: `/v3/users/ce3c8155f94f43469fabd7b5797bc8e1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.066649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3c8155f94f43469fabd7b5797bc8e1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:19.068697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:19.082682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f7fe6-e56e-4c89-ab1d-de467cc58bed None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.083061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f7fe6-e56e-4c89-ab1d-de467cc58bed None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.083362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f7fe6-e56e-4c89-ab1d-de467cc58bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.116694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-998f7fe6-e56e-4c89-ab1d-de467cc58bed None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:19.122646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-998f7fe6-e56e-4c89-ab1d-de467cc58bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.131232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3066/6088] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:12:19.137220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.138674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.140322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.158670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3c8155f94f43469fabd7b5797bc8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.181025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:19.182520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.186999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3c8155f94f43469fabd7b5797bc8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.187730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3c8155f94f43469fabd7b5797bc8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.197837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3c8155f94f43469fabd7b5797bc8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.208166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb07f543-149e-442c-87d4-3c9494c62560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3c8155f94f43469fabd7b5797bc8e1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.218741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3023/6089] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:19 2022] DELETE /identity/v3/users/ce3c8155f94f43469fabd7b5797bc8e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:19.222841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.223318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.224211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.257834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:19.259375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.261510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3067/6090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:19.265753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.275312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214431-68ac-4196-aec9-2622bc46ffa2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.349710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.350825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.351326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.351722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.352549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3024/6091] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:19.376314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.380248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.438024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.457126 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3068/6092] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:19.459038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.461815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.488777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f814e-27c6-4548-aedd-c7e206d8965d tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.498270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.499162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.499651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.499934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] PATH_INFO: `/v3/projects/93976f138574468d9d95622db5fa30af` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.501220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93976f138574468d9d95622db5fa30af)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:19.504046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:19.506751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067ac5-c4df-4fcb-9ff8-7693d3b1847a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.511968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.513159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.513739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.514329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.526452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:19.529030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241551c-3b25-4214-ba09-b807ddf2f6e6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:19.543300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3025/6093] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:19.567880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93976f138574468d9d95622db5fa30af', 'request_id': 'req-134918fa-0c74-4a3a-b914-58d712300a66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.586392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93976f138574468d9d95622db5fa30af', 'request_id': 'req-134918fa-0c74-4a3a-b914-58d712300a66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.601447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93976f138574468d9d95622db5fa30af', 'request_id': 'req-134918fa-0c74-4a3a-b914-58d712300a66'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.639130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] The token cache is being invalidate because project 93976f138574468d9d95622db5fa30af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:19.639427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.642112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-134918fa-0c74-4a3a-b914-58d712300a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:19.643182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3069/6094] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:19 2022] DELETE /identity/v3/projects/93976f138574468d9d95622db5fa30af => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:19.648602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f740-532d-43da-9990-53aad71f2161 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.649502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f740-532d-43da-9990-53aad71f2161 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.649989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f740-532d-43da-9990-53aad71f2161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.670424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b374f740-532d-43da-9990-53aad71f2161 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:19.672032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b374f740-532d-43da-9990-53aad71f2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.753624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3026/6095] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:19.763103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.763836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.764133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.787510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:19.788774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:19.797944 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3070/6096] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:19.804375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f740-532d-43da-9990-53aad71f2161 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.820566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f740-532d-43da-9990-53aad71f2161 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.827660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.828513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.828691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.828948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.829681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:19.829992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:19.833666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:19.854250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3027/6097] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:19.856289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.875232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfb5c4-e95e-4932-bcee-5aa29efa795c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:19.885126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:19.885852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:19.887212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:19.887212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:19.887968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:19.890371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:19.928259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3071/6098] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:19.929399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:19.942410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf78504-be3d-40f5-a274-52379ddb9d46 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.016884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.017917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.017917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.018098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.019413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.021961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.053473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3028/6099] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:19 2022] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:20.054822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.069422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd5669-89fb-44b6-8ff2-f1f63606d413 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.076571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.077936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.078209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.078893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.079735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.082387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.089119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.091254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.101374 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3072/6100] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:20.110791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e8bac-278e-4d2e-8502-a2f5bc82bbb6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.117518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.118509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.118891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.119244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] PATH_INFO: `/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.121741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3660bf129d614cc6b3ecdb6644b7ebb4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.124321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.127332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.159200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511cdce-510c-424f-b8c4-f1837b4ac450 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.166199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.166895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.167416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.167738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.168527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.171688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.191218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3073/6101] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:20.195580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3660bf129d614cc6b3ecdb6644b7ebb4', 'request_id': 'req-11759bf6-e9cc-40e0-92b4-815fb9046e22'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.197257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.207834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3660bf129d614cc6b3ecdb6644b7ebb4', 'request_id': 'req-11759bf6-e9cc-40e0-92b4-815fb9046e22'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.210174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573981a-2297-4677-b954-03b716dce4b0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.215934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3660bf129d614cc6b3ecdb6644b7ebb4', 'request_id': 'req-11759bf6-e9cc-40e0-92b4-815fb9046e22'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.239624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] The token cache is being invalidate because project 3660bf129d614cc6b3ecdb6644b7ebb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:20.240055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.240826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.243873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3029/6102] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:20 2022] DELETE /identity/v3/projects/3660bf129d614cc6b3ecdb6644b7ebb4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:20.249476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.253336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.287002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.288718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.289111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.289595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] PATH_INFO: `/v3/projects/52b2cba228394367afb66dc3bb162a88/users/7b4e7dfac3eb428da27163cb0f2cd00f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.309397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b2cba228394367afb66dc3bb162a88, user_id=7b4e7dfac3eb428da27163cb0f2cd00f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.314141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3821193-4dd2-483d-ba48-6fbb3343ab12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.339233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759bf6-e9cc-40e0-92b4-815fb9046e22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.344534 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3074/6103] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:20 2022] PUT /identity/v3/projects/52b2cba228394367afb66dc3bb162a88/users/7b4e7dfac3eb428da27163cb0f2cd00f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:20.352713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b910-b77c-4519-80a2-6ff993dbd745 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.354098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b910-b77c-4519-80a2-6ff993dbd745 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.354727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5b910-b77c-4519-80a2-6ff993dbd745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.387083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fdd5b910-b77c-4519-80a2-6ff993dbd745 None None] MFA Rules not processed for user `7b4e7dfac3eb428da27163cb0f2cd00f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:20.388387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fdd5b910-b77c-4519-80a2-6ff993dbd745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.435935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.437091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.438218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.445726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] PATH_INFO: `/v3/users/53d6043f8215405ab7fb084dce0cb841` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.447564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d6043f8215405ab7fb084dce0cb841)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.457035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.496724 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3075/6104] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:20.501699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.501970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.502319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.527302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:20.528824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.537329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3076/6105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:20.538834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.540028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.541871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d6043f8215405ab7fb084dce0cb841'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.558475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76788-e618-42d2-acab-f480ef0b424a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.562164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d6043f8215405ab7fb084dce0cb841'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.563246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d6043f8215405ab7fb084dce0cb841'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.564960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.565648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.566436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.566726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.567481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.570787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.579420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d6043f8215405ab7fb084dce0cb841'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.602528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-063b2992-2130-4cd4-8d55-1b40efe8c295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d6043f8215405ab7fb084dce0cb841'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.614580 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3030/6106] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:20 2022] DELETE /identity/v3/users/53d6043f8215405ab7fb084dce0cb841 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:20.617460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.617764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.618077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.622241 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3077/6107] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:20.624168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.628251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.645404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:20.648267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:20.743359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3031/6108] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:20.748329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.759493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e1ff0-83b4-40b6-ada8-d64d370828ae None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.765663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f113-5332-4825-9d02-25b2d49e304d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.766644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515547381c274371b34ad1ae5e03b8e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75856dc4c50543f998ec0b93cb68a192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.767682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.768159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.768476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9/password` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.771403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.772082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.772375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.772736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.773440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.775453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.803088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3078/6109] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:20.807184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.821258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb79fb-a3cc-4322-8b00-70b909dd46f9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.835927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.837785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.839949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.840429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.848939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.851615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.854452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:20.871313 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3032/6110] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:12:20 2022] POST /identity/v3/users/515547381c274371b34ad1ae5e03b8e9/password => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:20.872005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3079/6111] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:20.873090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.885944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135808a-997e-4092-a8a1-ece39f7687d8 tempest-IdentityV3UsersTest-1850349448 tempest-IdentityV3UsersTest-1850349448-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:20.892140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:20.893500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:20.893787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:20.894066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] PATH_INFO: `/v3/projects/9d664c6dd4634d1caee6d3514333c2ee/users/39c5e048400148148c9a7c554bdd4bab/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:20.912167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d664c6dd4634d1caee6d3514333c2ee, user_id=39c5e048400148148c9a7c554bdd4bab, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:20.915699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:20.932562 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3033/6112] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:20 2022] PUT /identity/v3/projects/9d664c6dd4634d1caee6d3514333c2ee/users/39c5e048400148148c9a7c554bdd4bab/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:20.937068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:20.947572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2591-d9b2-4dc4-ace2-742b3e85e45a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.024127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.026635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.034028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.034721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.035003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.035283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.036018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.037657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.050203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d91a-5b99-42f7-8dae-740f90008d73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.062212 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3080/6113] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:21.064772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.070651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.071562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.071873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.072163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] PATH_INFO: `/v3/projects/b6cc76ab97dc4b3681828e8321f3a623` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.076328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cc76ab97dc4b3681828e8321f3a623)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.079740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.087099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49008-b437-4172-8e99-0c427081e2bd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.093251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.094467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.094615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.095065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] PATH_INFO: `/v3/projects/9d664c6dd4634d1caee6d3514333c2ee/users/39c5e048400148148c9a7c554bdd4bab/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.097471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d664c6dd4634d1caee6d3514333c2ee, user_id=39c5e048400148148c9a7c554bdd4bab, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.100306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a5d61-2592-41b3-b57a-e8c7c49d749b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.116839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3081/6114] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:21 2022] PUT /identity/v3/projects/9d664c6dd4634d1caee6d3514333c2ee/users/39c5e048400148148c9a7c554bdd4bab/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:21.129181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.129440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.129744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.145768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cc76ab97dc4b3681828e8321f3a623', 'request_id': 'req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:21.153528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cc76ab97dc4b3681828e8321f3a623', 'request_id': 'req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:21.159842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] MFA Rules not processed for user `39c5e048400148148c9a7c554bdd4bab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:21.161252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.161467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cc76ab97dc4b3681828e8321f3a623', 'request_id': 'req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:21.177061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] The token cache is being invalidate because project b6cc76ab97dc4b3681828e8321f3a623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:21.178155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:21.180259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0616c733-5fc9-4b46-b35b-7f8ab9d1bb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:21.185804 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3034/6115] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:21 2022] DELETE /identity/v3/projects/b6cc76ab97dc4b3681828e8321f3a623 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:21.194080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f64c-9fc9-49d2-ac1c-1ab5955d02b3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.194585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f64c-9fc9-49d2-ac1c-1ab5955d02b3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.194952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f64c-9fc9-49d2-ac1c-1ab5955d02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.215191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6fb7f64c-9fc9-49d2-ac1c-1ab5955d02b3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:21.216424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6fb7f64c-9fc9-49d2-ac1c-1ab5955d02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.253215 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3082/6116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:21.265660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.268254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.296625 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3035/6117] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:21.299286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.299674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.299972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.327550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:21.328940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.339912 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3036/6118] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:21.343190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eb873-d45c-4219-aa00-ed975ba7715e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.344008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.346161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.346833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.347122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.347403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.353190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342b4ef-58cf-4c93-9d11-e06112248434 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.357686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.359350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.364147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.365341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.365637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.365921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.366651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:21.366967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.368655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.383256 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3037/6119] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:21.384769 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3083/6120] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:21.388657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.399665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30d6cf-7e3c-464e-92b9-a06220f91ed2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.409165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.409959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.410325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.410678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.411765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.413895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.443220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.444815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.446598 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3038/6121] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:21.450999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.462406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0718c62-1bfd-4d29-ae13-5ced043558ef service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.522705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7778e12-4509-4917-aeb9-c092ba813109 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.525647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.526310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.526759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.527056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.528237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.529088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.529210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.529385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.529668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.530358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.532309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.559962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3039/6122] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:21.560948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.571241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ac16c-983e-43fe-a92c-dcce437c1438 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.577360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.578110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.578466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.578820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.579821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.581364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.595510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.597011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.598970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3040/6123] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:21.602990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.614317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4167-6273-45a6-8bf0-71417bd2142c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.617257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3084/6124] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:21.621709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.622591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.623174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.623862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.629027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.630655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967afb2-ca38-46dd-9aaa-014f4ee3fba6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.645850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3041/6125] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:21.649755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.662329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76859e5-c8f5-485a-84a0-afa80abaa9d1 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.668036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.669032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.669414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.669763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] PATH_INFO: `/v3/projects/9cf65e4c94be42e88cc8b3f5eb50e03b/users/518f25b535244e50aa04d9e73bb0412f/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.686311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf65e4c94be42e88cc8b3f5eb50e03b, user_id=518f25b535244e50aa04d9e73bb0412f, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.689499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.706880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3085/6126] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:21 2022] PUT /identity/v3/projects/9cf65e4c94be42e88cc8b3f5eb50e03b/users/518f25b535244e50aa04d9e73bb0412f/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:21.718914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f632ad-7507-4ded-87d9-90f987db36fb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.719214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f632ad-7507-4ded-87d9-90f987db36fb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.719541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f632ad-7507-4ded-87d9-90f987db36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.754274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-18f632ad-7507-4ded-87d9-90f987db36fb None None] MFA Rules not processed for user `518f25b535244e50aa04d9e73bb0412f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:21.755750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-18f632ad-7507-4ded-87d9-90f987db36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.841156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3042/6127] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:21.853565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:21.856041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.877180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4222e2-8fad-4d98-a94d-10fa02175234 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.877510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4222e2-8fad-4d98-a94d-10fa02175234 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.877865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4222e2-8fad-4d98-a94d-10fa02175234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.913779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-aa4222e2-8fad-4d98-a94d-10fa02175234 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:21.915514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa4222e2-8fad-4d98-a94d-10fa02175234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:21.920904 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3043/6128] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:12:21.952868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5d1a8-1829-4705-aa82-e3d94bd19597 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:21.957859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:21.958528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:21.958980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:21.959316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:21.972019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:21.973838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:21.998367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3086/6129] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:22.116050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742545e2-a454-43c4-956e-62113f623c5c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.116547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742545e2-a454-43c4-956e-62113f623c5c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.117116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742545e2-a454-43c4-956e-62113f623c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.144181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-742545e2-a454-43c4-956e-62113f623c5c None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:22.145615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-742545e2-a454-43c4-956e-62113f623c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:22.212070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3044/6130] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:22.224091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:22.225542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:22.298247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363f5fb-52b3-4320-91ad-8b40a35db7a9 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:22.303886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:22.304559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.304849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.305134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.314440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:22.316037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61e562-c7dd-48f7-a1c2-4db6103e31d0 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:22.325103 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3087/6131] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:22.451041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.451768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.452097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.469928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:22.471189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:22.533069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3045/6132] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:22.691659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683fb09-043e-4525-82c9-d431e222bb9c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.692510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683fb09-043e-4525-82c9-d431e222bb9c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.692794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683fb09-043e-4525-82c9-d431e222bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.710284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4683fb09-043e-4525-82c9-d431e222bb9c None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:22.711555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4683fb09-043e-4525-82c9-d431e222bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:22.719069 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3088/6133] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:22.732147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:22.746883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0177d7-afdb-4a40-b253-4bc0a6b226e2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:22.751947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:22.752633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.752923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.753198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.761704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:22.763274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:22.771412 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3046/6134] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:22.926878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683188-d034-4800-b1bf-c8814255ed67 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:22.927172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683188-d034-4800-b1bf-c8814255ed67 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:22.927451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42683188-d034-4800-b1bf-c8814255ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:22.948052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42683188-d034-4800-b1bf-c8814255ed67 None None] MFA Rules not processed for user `515547381c274371b34ad1ae5e03b8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:22.960476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42683188-d034-4800-b1bf-c8814255ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.041731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3089/6135] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:23.043366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:23.045142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.158551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.159276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.159779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.160749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fa0f-129a-46f7-8f3a-0931a8b47b54 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:23.166545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:23.168098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.168386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.168831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] PATH_INFO: `/v3/users/515547381c274371b34ad1ae5e03b8e9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.177493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=515547381c274371b34ad1ae5e03b8e9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:23.178550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:23.201460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:23.202768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.249587 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3090/6136] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:23.265084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:23.272689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:23.284619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc120e-68ef-44b8-b8ea-d7c7ce2d1d24 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:23.291585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:23.292906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.293268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.293776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.297917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:23.298768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:23.308736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.310568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:23.326770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f475346c-867b-4b11-a800-5811e60bdbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515547381c274371b34ad1ae5e03b8e9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:23.331228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:23.333239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:23.341943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3047/6137] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:23 2022] DELETE /identity/v3/users/515547381c274371b34ad1ae5e03b8e9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:23.345288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447eaf-fd6b-411a-aa67-b19c91ef3883 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.345637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447eaf-fd6b-411a-aa67-b19c91ef3883 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.345969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447eaf-fd6b-411a-aa67-b19c91ef3883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.347281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3091/6138] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:23.375437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-29447eaf-fd6b-411a-aa67-b19c91ef3883 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:23.376689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-29447eaf-fd6b-411a-aa67-b19c91ef3883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.465907 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3048/6139] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:23.482250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:23.484219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.566622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e435-a391-4728-a7a4-48a68e39b80e service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:23.584223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.584552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.584855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.617985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:23.621878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.633732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:23.634755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.635231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.635697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.648020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:23.650335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:23.663771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3092/6140] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:23.713738 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3049/6141] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:23.729150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:23.731592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:23.833569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabcfa-6cd5-44bb-bd53-1f0a6383af87 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:23.841465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:23.853045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:23.853321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:23.853658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:23.866543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:23.868193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8c32a-f216-4d03-af47-a5ef352bec43 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:23.878225 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3093/6142] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:23.993501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:23.994906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.011407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1bb7-514e-4633-8bdc-215f3e3a2500 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.016721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.017794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.018191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.018339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] PATH_INFO: `/v3/projects/75856dc4c50543f998ec0b93cb68a192` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.020288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75856dc4c50543f998ec0b93cb68a192)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.022436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.074786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75856dc4c50543f998ec0b93cb68a192', 'request_id': 'req-4cdb9a22-3e21-44d4-b976-f1b000a717e7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:24.083042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75856dc4c50543f998ec0b93cb68a192', 'request_id': 'req-4cdb9a22-3e21-44d4-b976-f1b000a717e7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:24.088603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75856dc4c50543f998ec0b93cb68a192', 'request_id': 'req-4cdb9a22-3e21-44d4-b976-f1b000a717e7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:24.100914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] The token cache is being invalidate because project 75856dc4c50543f998ec0b93cb68a192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:24.101341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:24.102074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4cdb9a22-3e21-44d4-b976-f1b000a717e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:24.103748 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3050/6143] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:23 2022] DELETE /identity/v3/projects/75856dc4c50543f998ec0b93cb68a192 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:24.110106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec62fb-a70b-49d7-b659-635f8ada658d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.110405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec62fb-a70b-49d7-b659-635f8ada658d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.110688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec62fb-a70b-49d7-b659-635f8ada658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.129101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-baec62fb-a70b-49d7-b659-635f8ada658d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:24.130305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-baec62fb-a70b-49d7-b659-635f8ada658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.152089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.152387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.152713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.174767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:24.176968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.211339 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3094/6144] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:24.219457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.219971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.220324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.248960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:24.250466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.261211 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3051/6145] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:24.262815 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3095/6146] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:24.267307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.280370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.282160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.290625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de23c7-1d8a-4046-9a4e-0fc0d55f424e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.305075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.308713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.309019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.309304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.310473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:24.310790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.315283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.377573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac74f0-d61b-4db2-aa95-881e9e3681c2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.385354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.386067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.386356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.386642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.387931 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3052/6147] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:24.392271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.401247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.403676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.414338 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3096/6148] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:12:24.441631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5375338-d2d2-41b7-8d75-1e8727b2cd7d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.464859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.466073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.466508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.466795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.468335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.475256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ead0d6-0cbe-4dc2-b67f-0b352fc80bf1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.525934 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3053/6149] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:24.531139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.550348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5a972-c54e-42ca-9d30-d63a829b1512 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.657801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.657801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.657801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.658084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.658713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.661683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.702325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3097/6150] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:24.707106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.707598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.708073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.709465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.721485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c843c8-81a8-4171-9e9a-522d501b4c12 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.725771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.726613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.727131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.727516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.728501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.730856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.733236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:24.734987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.747019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3098/6151] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:24.748000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.760224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26c1b-1599-4b5a-82bd-0f250210fb07 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.770208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.770208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.770208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.770208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.770669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.772300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.784224 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3099/6152] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:24.788403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.804619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee35fd-d180-463f-9534-f14451aa7ac5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:24.811768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:24.813322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.813727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.814311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] PATH_INFO: `/v3/projects/398983d600e44a1ebb81f66aa02a8c29/users/6facd836093d460d8af91b351c644f87/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.835001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398983d600e44a1ebb81f66aa02a8c29, user_id=6facd836093d460d8af91b351c644f87, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:24.837710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc1c1-90e5-42b4-896d-c77ffb9cf5c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:24.853313 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3054/6153] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:24.868412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:24.885761 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3100/6154] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:24 2022] PUT /identity/v3/projects/398983d600e44a1ebb81f66aa02a8c29/users/6facd836093d460d8af91b351c644f87/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:24.887849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:24.888029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:24.888321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:24.919837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] MFA Rules not processed for user `6facd836093d460d8af91b351c644f87`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:24.921807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:24.963162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcefb9-dc23-4356-93cc-f9d5755c8fa3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.041773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.042492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.042782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.043061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.051450 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3101/6155] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:25.052686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.123375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.126541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.142105 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3055/6156] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:25.220889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d3de5-6f02-4a55-964f-70282c559dc7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.238366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.240221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.241847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.242137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.242913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.254568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.313686 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3102/6157] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:25 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:25.318462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.355390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a24e0-83c3-4b63-8f09-7bc4d94ef3cc service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.357542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.360083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.489503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.491589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4f81-cad0-4170-b87f-e95c6cb07446 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.494392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.496383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.496770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.497548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.500951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.504326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.505567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.505986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.506776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] PATH_INFO: `/v3/users/518f25b535244e50aa04d9e73bb0412f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.509828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518f25b535244e50aa04d9e73bb0412f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.513610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.566046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3056/6158] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:25 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:25.569353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.592835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fec2c-e88b-4b74-9482-307dd1ea7405 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.599019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.599636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.599994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.600422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.601175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.603211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.619414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3057/6159] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:25.621025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.622829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.626140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518f25b535244e50aa04d9e73bb0412f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.640391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518f25b535244e50aa04d9e73bb0412f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.641193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cca2f-7eb6-496b-9ebe-06242449fba6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.641312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518f25b535244e50aa04d9e73bb0412f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.642054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518f25b535244e50aa04d9e73bb0412f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.647544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.649086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.649479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.649872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] PATH_INFO: `/v3/users/7b4e7dfac3eb428da27163cb0f2cd00f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.651454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4e7dfac3eb428da27163cb0f2cd00f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.653860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.654875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518f25b535244e50aa04d9e73bb0412f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.720322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4e7dfac3eb428da27163cb0f2cd00f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.721000 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3103/6160] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:25 2022] DELETE /identity/v3/users/518f25b535244e50aa04d9e73bb0412f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:25.721980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.723438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.735591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4e7dfac3eb428da27163cb0f2cd00f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.736499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4e7dfac3eb428da27163cb0f2cd00f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.754667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4e7dfac3eb428da27163cb0f2cd00f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.773560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2504e859-d453-447a-9411-62eaa0343b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4e7dfac3eb428da27163cb0f2cd00f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:25.783805 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3058/6161] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:25 2022] DELETE /identity/v3/users/7b4e7dfac3eb428da27163cb0f2cd00f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:25.786342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5324242-3e48-4c89-a3d4-91b249a3cb30 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.786904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5324242-3e48-4c89-a3d4-91b249a3cb30 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.787415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5324242-3e48-4c89-a3d4-91b249a3cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.812350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e5324242-3e48-4c89-a3d4-91b249a3cb30 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:25.814350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5324242-3e48-4c89-a3d4-91b249a3cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.819755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c5b69-3a4d-4b9b-92e3-ca2895380238 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.893683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.894856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.895291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.895579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.896503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.898397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.899865 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3059/6162] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:25.902601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.903085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.903779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.921442 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3104/6163] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:25.921442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.922026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.931284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:25.932552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.941533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3060/6164] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:25.950641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:25.952768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:25.965835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3bd6-ff5c-4283-be29-432d7bbe3875 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.971434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.972343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.972666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.972946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] PATH_INFO: `/v3/projects/e24bbad401894a06b438b0d50656c3fb/users/44c2370981994e17aa28e92f46c112e4/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:25.989878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24bbad401894a06b438b0d50656c3fb, user_id=44c2370981994e17aa28e92f46c112e4, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:25.992627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:25.993366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2eb9-d23a-4f80-997e-d6e28f010a12 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:25.998034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:25.998924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:25.999320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:25.999734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.007834 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3061/6165] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:25 2022] PUT /identity/v3/projects/e24bbad401894a06b438b0d50656c3fb/users/44c2370981994e17aa28e92f46c112e4/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:26.008658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:26.016204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:26.018428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158636-94f3-4499-8d7e-00195fd2240c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:26.030307 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3105/6166] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:26.038911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.039553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.040041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.082259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef38ae-f8ba-49b8-828f-8e8fd086bd5f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:26.084924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] MFA Rules not processed for user `44c2370981994e17aa28e92f46c112e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:26.087216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.092757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:26.093449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.093737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.094015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.182320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:26.187361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:26.199338 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3106/6167] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:26.209143 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3062/6168] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:26.214615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:26.216088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.298350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f42eb4-14c2-43a7-8b7d-9b2fefb985b6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:26.305388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:26.306194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.306488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.306962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.310678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.411829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:26.416738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:26.429337 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3107/6169] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:26.531061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:26.532589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.561179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13cd2-0aa8-4059-b103-ebe527ee0882 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:26.570137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:26.571580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.572143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.572756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] PATH_INFO: `/v3/projects/9cf65e4c94be42e88cc8b3f5eb50e03b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.575642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf65e4c94be42e88cc8b3f5eb50e03b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:26.579521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:26.635573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:26.637285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.669198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf65e4c94be42e88cc8b3f5eb50e03b', 'request_id': 'req-8ba6ca8b-dc02-488f-983a-291ff36793bd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.677090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf65e4c94be42e88cc8b3f5eb50e03b', 'request_id': 'req-8ba6ca8b-dc02-488f-983a-291ff36793bd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.679549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dfcb0-8d96-4324-89af-c948393857db service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:26.684855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf65e4c94be42e88cc8b3f5eb50e03b', 'request_id': 'req-8ba6ca8b-dc02-488f-983a-291ff36793bd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.708052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] The token cache is being invalidate because project 9cf65e4c94be42e88cc8b3f5eb50e03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:26.708923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.709621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.712172 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3063/6170] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:26 2022] DELETE /identity/v3/projects/9cf65e4c94be42e88cc8b3f5eb50e03b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:26.712778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:26.714793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.791209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:26.795207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.795519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.795625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ca8b-dc02-488f-983a-291ff36793bd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:26.795815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] PATH_INFO: `/v3/projects/52b2cba228394367afb66dc3bb162a88` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.797910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b2cba228394367afb66dc3bb162a88)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:26.800380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618012-f212-4672-8037-0e7f220c964b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:26.801106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618012-f212-4672-8037-0e7f220c964b service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.801392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618012-f212-4672-8037-0e7f220c964b service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.801673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618012-f212-4672-8037-0e7f220c964b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:26.803760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-07618012-f212-4672-8037-0e7f220c964b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:26.803863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:26.909860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b2cba228394367afb66dc3bb162a88', 'request_id': 'req-b05ae888-a31f-4276-931c-cd1df6330948'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.924552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b2cba228394367afb66dc3bb162a88', 'request_id': 'req-b05ae888-a31f-4276-931c-cd1df6330948'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.939740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b2cba228394367afb66dc3bb162a88', 'request_id': 'req-b05ae888-a31f-4276-931c-cd1df6330948'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.955656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] The token cache is being invalidate because project 52b2cba228394367afb66dc3bb162a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:26.955957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.957159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b05ae888-a31f-4276-931c-cd1df6330948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:26.961683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3108/6171] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:26 2022] DELETE /identity/v3/projects/52b2cba228394367afb66dc3bb162a88 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:26.963000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190ce3-cf03-458b-bf45-fbe1e2f58f3f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:26.963285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190ce3-cf03-458b-bf45-fbe1e2f58f3f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:26.963572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190ce3-cf03-458b-bf45-fbe1e2f58f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.004412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618012-f212-4672-8037-0e7f220c964b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.008826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618012-f212-4672-8037-0e7f220c964b service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.021375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-64190ce3-cf03-458b-bf45-fbe1e2f58f3f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:27.022442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3064/6172] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:27.023394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-64190ce3-cf03-458b-bf45-fbe1e2f58f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.032714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618012-f212-4672-8037-0e7f220c964b service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.039025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-07618012-f212-4672-8037-0e7f220c964b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.064695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618012-f212-4672-8037-0e7f220c964b service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.142196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3109/6173] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:27.155019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.155318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.155602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.194205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:27.195499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.212713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3110/6174] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:27.213820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.227060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ff020-cc31-454f-84ba-cf4ce7ac122a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.238814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.239875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.240162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.240291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.240572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] PATH_INFO: `/v3/users/39c5e048400148148c9a7c554bdd4bab` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.242274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c5e048400148148c9a7c554bdd4bab)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.243320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.243665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.243956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.245961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:27.248964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.250129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.250690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.296286 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3111/6175] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:27.304653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.333770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d391e3d-27aa-4855-92ab-baf5e546627e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.344772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.345638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.346090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.346678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.348139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.351511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.387044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3112/6176] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:27.391187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.392219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c5e048400148148c9a7c554bdd4bab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.426537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c5e048400148148c9a7c554bdd4bab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.428348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c5e048400148148c9a7c554bdd4bab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.446824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c5e048400148148c9a7c554bdd4bab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.466156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c5e048400148148c9a7c554bdd4bab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.481551 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3065/6177] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:27 2022] DELETE /identity/v3/users/39c5e048400148148c9a7c554bdd4bab => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:27.525040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e7bcf-a30c-4d70-8569-24dcb2b297fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.610144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.611028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.611324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.611812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.611949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.612597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.613841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.614880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.632040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a3bbe-8ee8-4e07-94fc-df7b87aa7caa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.638606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.639520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.639822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.640153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] PATH_INFO: `/v3/users/6facd836093d460d8af91b351c644f87` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.641876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6facd836093d460d8af91b351c644f87)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.644021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.657646 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3113/6178] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:27 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:27.658863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.661520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.677525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e7b6-cdcb-47df-95c6-e11b3cb6fa88 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.684973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.686051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.686435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.686818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.687678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.690204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.702961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6facd836093d460d8af91b351c644f87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.709993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3114/6179] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:27.713354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.720147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6facd836093d460d8af91b351c644f87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.721477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6facd836093d460d8af91b351c644f87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.724743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903a41-47ae-4301-ac7e-b7e2d873ed00 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.731135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.731926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.732076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6facd836093d460d8af91b351c644f87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.732386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.732914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.733731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.735432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.740574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e68ba59e-6843-4fe4-94b3-48dc91f1a2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6facd836093d460d8af91b351c644f87'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:27.746446 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3115/6180] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:27.750789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3066/6181] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:27 2022] DELETE /identity/v3/users/6facd836093d460d8af91b351c644f87 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:27.753624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.753624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.755233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.755553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.755942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.768241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4455ce-90d5-4b70-ae2c-d67b8209181d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.780015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:27.781279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.835882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.837132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.837424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.837740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] PATH_INFO: `/v3/projects/aa59e803ec5349a68092d1220aee2a1e/users/8201801ddb7b458589ad01337bfc5f79/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.846411 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3067/6182] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:27.853235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa59e803ec5349a68092d1220aee2a1e, user_id=8201801ddb7b458589ad01337bfc5f79, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:27.856687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33401a-a6dc-45d2-b75d-fb134939add4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:27.857978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:27.859691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.872259 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3116/6183] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:27 2022] PUT /identity/v3/projects/aa59e803ec5349a68092d1220aee2a1e/users/8201801ddb7b458589ad01337bfc5f79/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:27.883410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.883761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.883993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.913311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] MFA Rules not processed for user `8201801ddb7b458589ad01337bfc5f79`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:27.914586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:27.934366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cbdcd-13dc-44f7-b112-2313497b7be8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:27.993262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:27.993936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:27.994228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:27.994509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:27.996429 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3117/6184] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:27.998630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.005097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.066123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.067619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.072031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3484a-61b0-4a73-be83-0ab03ebf47f5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.076927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.077795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.078084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.078367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] PATH_INFO: `/v3/projects/9d664c6dd4634d1caee6d3514333c2ee` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.079263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3068/6185] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:28.080197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.082472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d664c6dd4634d1caee6d3514333c2ee)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.084552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.091465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff7e55-cf77-4d38-bca8-8e6dfb8b00c1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.098534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.099209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.099502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.099787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.100696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.102870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.144757 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3069/6186] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:28.145864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.152726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d664c6dd4634d1caee6d3514333c2ee', 'request_id': 'req-b5217473-66de-42b0-9f0c-3031fc3e1cff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.160631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d664c6dd4634d1caee6d3514333c2ee', 'request_id': 'req-b5217473-66de-42b0-9f0c-3031fc3e1cff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.172384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d664c6dd4634d1caee6d3514333c2ee', 'request_id': 'req-b5217473-66de-42b0-9f0c-3031fc3e1cff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.208869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] The token cache is being invalidate because project 9d664c6dd4634d1caee6d3514333c2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:28.209230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.210282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b5217473-66de-42b0-9f0c-3031fc3e1cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.215477 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3118/6187] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:27 2022] DELETE /identity/v3/projects/9d664c6dd4634d1caee6d3514333c2ee => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:28.218301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e531d-8b50-4729-b074-882f84239386 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.218748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e531d-8b50-4729-b074-882f84239386 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.219162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e531d-8b50-4729-b074-882f84239386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.225271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967241a0-673e-479e-918d-9e4d9a657c8f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.231590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.232513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.233023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.233445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.234353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.236589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.251185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3d2e531d-8b50-4729-b074-882f84239386 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:28.255687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d2e531d-8b50-4729-b074-882f84239386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.269860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3070/6188] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:28.273641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.280932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3119/6189] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:28.284032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.290112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.290699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.291175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.300078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754e20-8853-47fc-a040-4969f2c4a584 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.306554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.309521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.310014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.310882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.311646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.314302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.332816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:28.333628 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3071/6190] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:28.335326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.335889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.349023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b4f8-a84f-4ccf-913a-f83946328203 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.350295 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3120/6191] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:28.351563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.354439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.355175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.355465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.356010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.356918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.358758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.367096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0e32e-713b-4494-ba79-f7fb2b6bd27b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.374617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.374784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3072/6192] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:28.375517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.375631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.375964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.376399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.377622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:28.378008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.379774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.385837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83885-e623-4a2d-9277-4d52b85d6c07 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.391741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.392838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.393128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.393412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] PATH_INFO: `/v3/projects/f551350b47174bf8a3af3bb8aa7f1daf/users/dd764b9cedcc421db687856a783dda37/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.400793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3121/6193] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:28.402462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.411438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f551350b47174bf8a3af3bb8aa7f1daf, user_id=dd764b9cedcc421db687856a783dda37, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.413807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54e4fd-c612-4af1-bc65-2eab7e2fd2be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.414075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.421529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.423617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.424128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.424742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.426076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.428292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.445298 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3073/6194] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:28 2022] PUT /identity/v3/projects/f551350b47174bf8a3af3bb8aa7f1daf/users/dd764b9cedcc421db687856a783dda37/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:28.490044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3122/6195] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:28.494718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.505875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.515832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.597211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed5310-5c36-48bf-b7d0-87c55b4d890f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.612232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4b83f-ceb7-4270-b11d-299eb40fe39b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.617528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.618650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.618927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.619253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] PATH_INFO: `/v3/projects/398983d600e44a1ebb81f66aa02a8c29` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.621064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398983d600e44a1ebb81f66aa02a8c29)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.623249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.666068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.667014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.669371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.670338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.671184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.673644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ed96d-4adf-47df-a95f-86a662274fc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.693537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398983d600e44a1ebb81f66aa02a8c29', 'request_id': 'req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.700634 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3074/6196] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:28.700794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398983d600e44a1ebb81f66aa02a8c29', 'request_id': 'req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.702275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.702848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.703182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.711425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398983d600e44a1ebb81f66aa02a8c29', 'request_id': 'req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.724599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] The token cache is being invalidate because project 398983d600e44a1ebb81f66aa02a8c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:28.724893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.725710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.727294 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3123/6197] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:28 2022] DELETE /identity/v3/projects/398983d600e44a1ebb81f66aa02a8c29 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:28.728062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.731642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.740942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] MFA Rules not processed for user `dd764b9cedcc421db687856a783dda37`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:28.742143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.795631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc799b-dee9-4ae3-9d36-010ebeb673d2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.801552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.802232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.802521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.802800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.803555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.805212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.807472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3075/6198] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:28.808956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.810517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.822028 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3124/6199] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:28.826458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.830513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23e4b1-da3e-424d-9860-ff9d8e4187db None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.835904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.836980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.837359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.837738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] PATH_INFO: `/v3/users/44c2370981994e17aa28e92f46c112e4` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.838835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a717-d7f2-4c72-9a8c-9ccc0e62a97f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.839682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2370981994e17aa28e92f46c112e4)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.841875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.845390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.846218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.846779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.847155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.848196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:28.850106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:28.862655 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3125/6200] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:28.863650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.865650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.903905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2370981994e17aa28e92f46c112e4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.918612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2370981994e17aa28e92f46c112e4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.919677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2370981994e17aa28e92f46c112e4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.931357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2370981994e17aa28e92f46c112e4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.939333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ffe7-aacc-4f55-97bf-cbd1c1bfb8e3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:28.941784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2370981994e17aa28e92f46c112e4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:28.944505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:28.945392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:28.945682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:28.945964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:28.948065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:28.949488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3076/6201] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:28 2022] DELETE /identity/v3/users/44c2370981994e17aa28e92f46c112e4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:28.950668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:28.952361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.026192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.028954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc44091-fee3-4f0e-9ab8-feae0dfb852d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.029145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9025cc9-50f6-4946-b07f-b729327b3e35 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.038290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.039730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.039865 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3126/6202] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:29.040066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.040415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] PATH_INFO: `/v3/projects/7500e92922264882be9952e74d592fbd/users/e471eef7d8df4a78b3d4470c07f57ea1/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.058974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7500e92922264882be9952e74d592fbd, user_id=e471eef7d8df4a78b3d4470c07f57ea1, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.062479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dcc46-496c-4d9d-9dda-9e0b10fdd40f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.078060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3077/6203] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:28 2022] PUT /identity/v3/projects/7500e92922264882be9952e74d592fbd/users/e471eef7d8df4a78b3d4470c07f57ea1/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:29.089645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.090019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.090312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.129639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] MFA Rules not processed for user `e471eef7d8df4a78b3d4470c07f57ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:29.134367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.164789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.165089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.165373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.187821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:29.190069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.221075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3127/6204] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:29.225484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.287704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3078/6205] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:29.288959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.290587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.340654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19341d-7d31-480d-beaf-8ad0b099f49d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.345560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.346230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.346527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.346807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.347512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.349456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.368673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cadd3-76d5-4b2f-a270-c1dcd134202c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.375845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.377026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.377497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.377823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] PATH_INFO: `/v3/projects/e24bbad401894a06b438b0d50656c3fb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.379163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24bbad401894a06b438b0d50656c3fb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.381303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.386456 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3128/6206] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:29.390162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.392826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.454227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24bbad401894a06b438b0d50656c3fb', 'request_id': 'req-91bbe198-12ef-49c2-9dc8-7d7654fd0450'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:29.465002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24bbad401894a06b438b0d50656c3fb', 'request_id': 'req-91bbe198-12ef-49c2-9dc8-7d7654fd0450'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:29.470999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24bbad401894a06b438b0d50656c3fb', 'request_id': 'req-91bbe198-12ef-49c2-9dc8-7d7654fd0450'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:29.483759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] The token cache is being invalidate because project e24bbad401894a06b438b0d50656c3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:29.484133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:29.485129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:29.486369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa363c9-60d8-4d1b-b548-bb6e625ad041 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.493729 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3079/6207] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:29 2022] DELETE /identity/v3/projects/e24bbad401894a06b438b0d50656c3fb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:29.493729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.493729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.565336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe198-12ef-49c2-9dc8-7d7654fd0450 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.570294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.571091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.571486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.571867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.572707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.572817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.574054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.574345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.575740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0d402-29b4-4148-9ef1-ffbcd43d057b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.575985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.578514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.609714 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3080/6208] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:29.609714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.609714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.609714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.632785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:29.634166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.649192 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3081/6209] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:29.649192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.658490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33112433-1c81-4ea3-b61c-92c4b00447fb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.663662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.664346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.664669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.664889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.664993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.665665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.666499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefe28d-980e-4628-a690-c78edd2a1e5d service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.667291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.675501 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3129/6210] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:29.677146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.677146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.677349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.677960 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3082/6211] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:29.682608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.698509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:29.700579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:29.701701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd62d-9d6f-4ac6-8260-4a3ab94d2632 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.708277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.709482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.709616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3130/6212] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:29.709928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.710282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] PATH_INFO: `/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7/users/df2c3781b05b46c1a71fdee48f1dfe56/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.717392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.727663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51da03f-59ca-4671-b214-19e61e6a12d2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.734480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.735324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.735717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.736102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.736962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:29.737082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f8e2f83d5f4f8c805aeed29019f2c7, user_id=df2c3781b05b46c1a71fdee48f1dfe56, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.737409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.739225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.740010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.757036 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3131/6213] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:29.762371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.777014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d8897-c920-4ca0-b8b9-31ed506b98dd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.779290 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3083/6214] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:29 2022] PUT /identity/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7/users/df2c3781b05b46c1a71fdee48f1dfe56/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:29.783343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.869162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.870094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.871238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.871632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.872397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.874683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.893080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c308-2ac3-4b36-8c93-14d0dd896945 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.898734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:29.899423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:29.899712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:29.900047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:29.900829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:29.903229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:29.918756 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3084/6215] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:29.919667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:29.930507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be167b-a4ff-4dc0-84c9-2ea6036b7e9a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:29.931969 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3132/6216] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:29.933920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.011100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.011990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.012272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.012594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] PATH_INFO: `/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7/users/df2c3781b05b46c1a71fdee48f1dfe56/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.014591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f8e2f83d5f4f8c805aeed29019f2c7, user_id=df2c3781b05b46c1a71fdee48f1dfe56, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.015640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaad57d-3a08-4c14-a643-ba43fbf54b3f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.017263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.020410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.021242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.021526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.021804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.022480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.024374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ac3f8-51b2-45f4-ade1-32399581042f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.027326 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3085/6217] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:29 2022] PUT /identity/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7/users/df2c3781b05b46c1a71fdee48f1dfe56/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:30.028116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.029728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.048899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3133/6218] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:29 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:30.048899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.048899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.048899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.074209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] MFA Rules not processed for user `df2c3781b05b46c1a71fdee48f1dfe56`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:30.075403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.090420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9494-6c63-417b-acdd-16bd0a6a9d49 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.094139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.094830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.095116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.095631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.097542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.141401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3134/6219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:30.142403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.159044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.160611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.169635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3086/6220] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:30.170744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.172159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.206290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e54cf-df99-4e73-9a0d-af8f771bcbad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.211081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.211749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.212032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.212309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.213266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.215513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.225740 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3135/6221] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:30.229637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.238530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443da1-851f-4ae4-a03a-b3a6c5319ab9 service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.241105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af46b8-e578-4432-8231-fdb99dbdc297 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.242772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.243473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.243759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.244291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.247174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.247834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.248117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.248393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.249445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.251034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fd311-1f06-40fb-8efe-fd38eacb83c5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.254924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.256362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.262123 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3136/6222] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:30.263354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.263854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.264036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.267450 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3087/6223] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:30.268233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.279844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a518-9cad-4f49-89ea-e1a5eb33eaa0 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.283178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:30.284528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.285394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.286568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.286568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.286919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] PATH_INFO: `/v3/projects/9b9fc08577c04e31899bce3654102dd5/users/086827f8c67744c9ba0410a0e610dc53/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.302794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9fc08577c04e31899bce3654102dd5, user_id=086827f8c67744c9ba0410a0e610dc53, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.305677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e77d15-e77e-46a8-8a05-f2707a67d16f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.328543 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3088/6224] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:30 2022] PUT /identity/v3/projects/9b9fc08577c04e31899bce3654102dd5/users/086827f8c67744c9ba0410a0e610dc53/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:30.334021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.334836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.335124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.349866 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3137/6225] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:30.364580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.366244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.366721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] MFA Rules not processed for user `086827f8c67744c9ba0410a0e610dc53`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:30.367863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.436513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3089/6226] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:30.444100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.459507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256d54f-7aa8-4da4-bfa4-6e834a640b76 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.514218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704d153-e7f4-4600-accb-29d365b93fb7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.519232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.519929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.520216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.520535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.521372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.523295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.528237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.529059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.529469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.529789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.551511 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3090/6227] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:30 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:30.556356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.606160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.608540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.619271 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3138/6228] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:12:30.632402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4ce8e-58a0-4a11-b4c0-7fe5e535e41d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.638777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.639459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.639737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.640001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.640724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.642672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.671761 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3091/6229] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:30 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:30.675616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.687995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04d8a-03e3-4937-b2a1-6f79ff1dd6c6 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.693361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.694173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.694540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.694897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.695630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.697275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.713340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3139/6230] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:30.718210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.730021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4cb35-01a7-4d95-bd76-f717833d92f8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.735632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.736737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.737211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.737503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] PATH_INFO: `/v3/projects/803193607ef44d1aae21c94d035ca32b/users/d70f9a65b0ef4b19b3e4a3a02ce05094/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.760569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803193607ef44d1aae21c94d035ca32b, user_id=d70f9a65b0ef4b19b3e4a3a02ce05094, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.763538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.764953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.766629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.785669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cb772-ab91-4012-9d29-a53b681df377 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.787248 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3092/6231] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:30 2022] PUT /identity/v3/projects/803193607ef44d1aae21c94d035ca32b/users/d70f9a65b0ef4b19b3e4a3a02ce05094/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:30.788674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.858538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.859433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.859795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.860001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] PATH_INFO: `/v3/users/8201801ddb7b458589ad01337bfc5f79` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.861267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8201801ddb7b458589ad01337bfc5f79)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.863261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.871217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a339ec3-25b0-483a-b491-de936eef6bd9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.876202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.876903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.877187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.877465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.878183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.879792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.890226 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3093/6232] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:30.891059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.901702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec8a3-d496-4953-a8b7-853538e08cec admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:30.906524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:30.907371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:30.907662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:30.907946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] PATH_INFO: `/v3/users/e471eef7d8df4a78b3d4470c07f57ea1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:30.909249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e471eef7d8df4a78b3d4470c07f57ea1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:30.911167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8201801ddb7b458589ad01337bfc5f79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.911306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:30.919030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8201801ddb7b458589ad01337bfc5f79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.919795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8201801ddb7b458589ad01337bfc5f79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.920424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8201801ddb7b458589ad01337bfc5f79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.927218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8201801ddb7b458589ad01337bfc5f79'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.945771 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3140/6233] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:30 2022] DELETE /identity/v3/users/8201801ddb7b458589ad01337bfc5f79 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:30.949133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:30.949133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:30.968564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e471eef7d8df4a78b3d4470c07f57ea1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.986936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e471eef7d8df4a78b3d4470c07f57ea1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.989003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e471eef7d8df4a78b3d4470c07f57ea1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:30.998498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e471eef7d8df4a78b3d4470c07f57ea1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.006254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d7af1d82-3fe6-4b38-bfa5-26d8f0bb8dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e471eef7d8df4a78b3d4470c07f57ea1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.016682 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3094/6234] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:30 2022] DELETE /identity/v3/users/e471eef7d8df4a78b3d4470c07f57ea1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:31.021130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcf3b-606a-46f1-8f0f-1ca19619ade9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.021423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcf3b-606a-46f1-8f0f-1ca19619ade9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.021709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dcf3b-606a-46f1-8f0f-1ca19619ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.034811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579598-ce28-4cf2-b2bb-618d44e2b7f7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.044326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-473dcf3b-606a-46f1-8f0f-1ca19619ade9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:31.045745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-473dcf3b-606a-46f1-8f0f-1ca19619ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.104102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.105378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.105664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.105941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] PATH_INFO: `/v3/projects/803193607ef44d1aae21c94d035ca32b/users/d70f9a65b0ef4b19b3e4a3a02ce05094/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.107983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803193607ef44d1aae21c94d035ca32b, user_id=d70f9a65b0ef4b19b3e4a3a02ce05094, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.111635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.118099 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3095/6235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:31.118099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affc41-3910-4903-8e7c-8e80a3742802 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.118099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affc41-3910-4903-8e7c-8e80a3742802 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.118099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2affc41-3910-4903-8e7c-8e80a3742802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.134048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3141/6236] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:30 2022] PUT /identity/v3/projects/803193607ef44d1aae21c94d035ca32b/users/d70f9a65b0ef4b19b3e4a3a02ce05094/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:31.134048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.136058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e2affc41-3910-4903-8e7c-8e80a3742802 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:31.136936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.137473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2affc41-3910-4903-8e7c-8e80a3742802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.203021 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3096/6237] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:31.204216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.204537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.204820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.216005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7790b5-191f-4b80-b242-96b753f08e16 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.220130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.220939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.221356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.221708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.232829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.232986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] MFA Rules not processed for user `d70f9a65b0ef4b19b3e4a3a02ce05094`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:31.234212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.234558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.246435 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3142/6238] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:31.247209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.248625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.261667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf27afb-152c-4ab9-8655-7ff0efc09293 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.267025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.267953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.268643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.268981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.282917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.285548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.301463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3143/6239] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:31.336228 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3097/6240] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:31.354422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.367353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce3e-5968-4c44-be75-55d84753451e service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.372558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.373434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.373862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.374262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.386391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.389122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.402344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3144/6241] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:31.640833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.642501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.658260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16134a41-7e60-4ef2-a407-190984ba4e4c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.663115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.664044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.664342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.664656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] PATH_INFO: `/v3/projects/7500e92922264882be9952e74d592fbd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.665864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7500e92922264882be9952e74d592fbd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.667872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.720532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7500e92922264882be9952e74d592fbd', 'request_id': 'req-5ca46640-ac8c-4483-a66a-ee8acfc68931'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.728587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7500e92922264882be9952e74d592fbd', 'request_id': 'req-5ca46640-ac8c-4483-a66a-ee8acfc68931'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.736892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7500e92922264882be9952e74d592fbd', 'request_id': 'req-5ca46640-ac8c-4483-a66a-ee8acfc68931'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.754259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] The token cache is being invalidate because project 7500e92922264882be9952e74d592fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:31.754593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.755546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.760356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3098/6242] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:31 2022] DELETE /identity/v3/projects/7500e92922264882be9952e74d592fbd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:31.761889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.773913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c523-42ee-4adf-8086-0374741b4284 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.839443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.840327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.840651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.840930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] PATH_INFO: `/v3/users/df2c3781b05b46c1a71fdee48f1dfe56` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.842143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2c3781b05b46c1a71fdee48f1dfe56)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.844097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.888092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:31.890037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:31.906043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca46640-ac8c-4483-a66a-ee8acfc68931 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:31.911017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:31.911893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:31.912559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:31.912559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] PATH_INFO: `/v3/projects/aa59e803ec5349a68092d1220aee2a1e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:31.913702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa59e803ec5349a68092d1220aee2a1e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:31.915604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2c3781b05b46c1a71fdee48f1dfe56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.915732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:31.933975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2c3781b05b46c1a71fdee48f1dfe56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.934832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2c3781b05b46c1a71fdee48f1dfe56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.935543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2c3781b05b46c1a71fdee48f1dfe56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.943638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2c3781b05b46c1a71fdee48f1dfe56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.963943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3145/6243] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:31 2022] DELETE /identity/v3/users/df2c3781b05b46c1a71fdee48f1dfe56 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:31.966964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa59e803ec5349a68092d1220aee2a1e', 'request_id': 'req-3065e440-c20c-41fb-83a8-0cdae9640682'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.973422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa59e803ec5349a68092d1220aee2a1e', 'request_id': 'req-3065e440-c20c-41fb-83a8-0cdae9640682'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.979773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa59e803ec5349a68092d1220aee2a1e', 'request_id': 'req-3065e440-c20c-41fb-83a8-0cdae9640682'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.997544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] The token cache is being invalidate because project aa59e803ec5349a68092d1220aee2a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:31.997837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:31.998525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.000112 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3099/6244] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:31 2022] DELETE /identity/v3/projects/aa59e803ec5349a68092d1220aee2a1e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:32.004159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.005631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.090666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96e21-3d9c-4e19-a3b7-834518572966 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:32.096707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:32.097682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.098048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.098412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] PATH_INFO: `/v3/users/dd764b9cedcc421db687856a783dda37` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.099964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd764b9cedcc421db687856a783dda37)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:32.102337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:32.167769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd764b9cedcc421db687856a783dda37'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.179627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd764b9cedcc421db687856a783dda37'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.180775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd764b9cedcc421db687856a783dda37'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.181455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd764b9cedcc421db687856a783dda37'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.194319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de1b8848-5a9b-4f0c-a2be-aa99afcf364c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd764b9cedcc421db687856a783dda37'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.216722 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3146/6245] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:32 2022] DELETE /identity/v3/users/dd764b9cedcc421db687856a783dda37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:32.287890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.289809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.380148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065e440-c20c-41fb-83a8-0cdae9640682 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:32.449988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:32.450914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.451210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.451493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] PATH_INFO: `/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.452889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f8e2f83d5f4f8c805aeed29019f2c7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:32.454848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:32.507400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f8e2f83d5f4f8c805aeed29019f2c7', 'request_id': 'req-3cc113e0-92bf-42a6-b1b2-cb89af660a24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.515112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f8e2f83d5f4f8c805aeed29019f2c7', 'request_id': 'req-3cc113e0-92bf-42a6-b1b2-cb89af660a24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.523148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f8e2f83d5f4f8c805aeed29019f2c7', 'request_id': 'req-3cc113e0-92bf-42a6-b1b2-cb89af660a24'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.544407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] The token cache is being invalidate because project 92f8e2f83d5f4f8c805aeed29019f2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:32.544723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.545616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.547727 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3100/6246] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:32 2022] DELETE /identity/v3/projects/92f8e2f83d5f4f8c805aeed29019f2c7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:32.552840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc376c1e-5131-45ed-8c53-23645ad6c8d1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.553499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc376c1e-5131-45ed-8c53-23645ad6c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.554186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc376c1e-5131-45ed-8c53-23645ad6c8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.574537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cc376c1e-5131-45ed-8c53-23645ad6c8d1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:32.575635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cc376c1e-5131-45ed-8c53-23645ad6c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.651007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.653057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.662391 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3147/6247] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:32.672003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.672300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.672631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.677490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc113e0-92bf-42a6-b1b2-cb89af660a24 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:32.688871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:32.689753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.690662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.690959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] PATH_INFO: `/v3/projects/f551350b47174bf8a3af3bb8aa7f1daf` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.692190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f551350b47174bf8a3af3bb8aa7f1daf)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:32.692845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:32.694416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:32.695084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.717945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3148/6248] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:32.721945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.732181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db244022-98b6-41ce-9949-93cf7a7b138e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:32.737007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:32.737753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.738206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.738550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.739336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:32.739757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:32.741470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:32.747690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f551350b47174bf8a3af3bb8aa7f1daf', 'request_id': 'req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.754355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f551350b47174bf8a3af3bb8aa7f1daf', 'request_id': 'req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.754617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3149/6249] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:32.758411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.763305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f551350b47174bf8a3af3bb8aa7f1daf', 'request_id': 'req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.770755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a8bb-372b-4b89-8775-74170f7556ec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:32.780713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] The token cache is being invalidate because project f551350b47174bf8a3af3bb8aa7f1daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:32.781070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.782267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e19aeba4-6a57-4ac3-9a2a-6c1ffa07486f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:32.784510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3101/6250] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:32 2022] DELETE /identity/v3/projects/f551350b47174bf8a3af3bb8aa7f1daf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:32.790269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5046-4f3a-44d0-a95c-4f2a27948488 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.790564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5046-4f3a-44d0-a95c-4f2a27948488 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.791054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5046-4f3a-44d0-a95c-4f2a27948488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.816582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58cf5046-4f3a-44d0-a95c-4f2a27948488 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:32.818730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58cf5046-4f3a-44d0-a95c-4f2a27948488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.869730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:32.871706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.872092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.872483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.873268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:32.878652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:32.930984 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3150/6251] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:32.937316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:32.938133 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3102/6252] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:32.939543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:32.945309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:32.947614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:32.949493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:32.975140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:32.977475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.032490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b57b-8c1c-4f60-8dc5-efc73107203e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.039369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.040068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.040361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.040694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.041656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.044439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.055720 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3103/6253] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:33.062149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.078076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0b60a-a197-431e-982e-6fd25603aaa8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.090149 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3151/6254] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:32 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:33.090329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.090443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.090815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.090940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.091653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:33.092577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.092991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.095223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.110153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee6c0-4dd4-4e41-b7b8-74f9f07889a9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.115751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3104/6255] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:33.121655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.123896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.124360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.124540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.124930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.125902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.127813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.138354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e97275-e2e4-4444-a29f-adc3774702ba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.142170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3152/6256] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:33.144773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.156015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.157397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.157700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.158181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.158895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.165391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.169921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce6886-cd50-466e-be71-b68d8c476664 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.193370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.194311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.194644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.195470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.196231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.197887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.210961 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3105/6257] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:33.213619 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3153/6258] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:33.217775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.218312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.233524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eda84-1986-4f3c-9c40-6f45f73c789f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.332105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.332750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.333042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.333325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.334022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.335970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.347910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccbab3-96d2-445b-955c-e123fd0b349b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.357646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.358657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.358992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.359732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] PATH_INFO: `/v3/projects/733befed769a4ec29b3f10b0efd4504f/users/9c65eea593394a6483c4b998a2ef1340/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.364968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3154/6259] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:33.366090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.369683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.383584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733befed769a4ec29b3f10b0efd4504f, user_id=9c65eea593394a6483c4b998a2ef1340, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.384117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4011-01ba-4814-8e91-cb843e20532c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.387469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.389292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.390404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.390768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.391059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] PATH_INFO: `/v3/users/086827f8c67744c9ba0410a0e610dc53` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.392996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086827f8c67744c9ba0410a0e610dc53)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.395112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.411287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3106/6260] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:33 2022] PUT /identity/v3/projects/733befed769a4ec29b3f10b0efd4504f/users/9c65eea593394a6483c4b998a2ef1340/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:33.412538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.488540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086827f8c67744c9ba0410a0e610dc53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:33.499982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086827f8c67744c9ba0410a0e610dc53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:33.501348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086827f8c67744c9ba0410a0e610dc53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:33.502197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086827f8c67744c9ba0410a0e610dc53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:33.502803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc1156-e51f-4d92-ba05-fa1ec731d849 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.510423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.512177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.512681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.512967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.514335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086827f8c67744c9ba0410a0e610dc53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:33.515271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.516951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b991d-c98a-420c-b5b9-ec6b8fef5955 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.541895 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3107/6261] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:33.544515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.544818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.545101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.553254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3155/6262] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:33 2022] DELETE /identity/v3/users/086827f8c67744c9ba0410a0e610dc53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:33.555905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.558696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.576992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] MFA Rules not processed for user `9c65eea593394a6483c4b998a2ef1340`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:33.578317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.630993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0f6-cfc9-487b-a243-0579595d44e9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.644239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.645680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.646028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.646614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.647517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.653459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac02e-5570-45a7-be5a-50eb4951860e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.669426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3156/6263] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:33.669426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.669426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.669426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.688526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:33.691877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.708886 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3157/6264] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:33.709590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.718672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3108/6265] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:33.723581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.726628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.738084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e043202-9e73-4b2c-a11f-deda5c4645fa None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.748312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.750259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.750616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.750966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] PATH_INFO: `/v3/projects/4e06a13a44b04af782e4b674988f6436/users/12e45d0d841b4d1d87b57a068b5f9c96/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.768546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc8f8b-28df-43f1-9e64-fdeeeea6951f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.778904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:33.780413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.780832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.781227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.781940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.789336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e06a13a44b04af782e4b674988f6436, user_id=12e45d0d841b4d1d87b57a068b5f9c96, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:33.795236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.796701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26444d-ab7c-460b-84a8-d21b35aa1ba4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:33.829249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3158/6266] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:33 2022] PUT /identity/v3/projects/4e06a13a44b04af782e4b674988f6436/users/12e45d0d841b4d1d87b57a068b5f9c96/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:33.831236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:33.847609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.848443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3109/6267] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:33.849902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:33.850207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:33.850494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:33.879467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] MFA Rules not processed for user `12e45d0d841b4d1d87b57a068b5f9c96`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:33.880768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:33.939657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ee24e-e42d-45b1-be27-6b7b0ae6d1ac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:33.991958 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3110/6268] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:33.992687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.020291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.021496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.022001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.022498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.078061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0310f02-02a5-4389-858f-54613adbbbcb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.086689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.087424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.087716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.088132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.089607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.091564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.096921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.099067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.113328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3159/6269] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:34.116341 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3111/6270] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:33 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:34.117411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.117647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.129275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615528c-f7a2-4765-b00a-b68d5f52c0dd service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.130913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cffe-270f-48bd-92dc-8164b7ec497c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.136314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.137370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.137893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.138709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.138989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.139096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.139258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.139698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.140131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.140793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.142403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.143492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.176025 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3112/6271] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:34.177310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.181834 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3160/6272] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:34 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:34.186312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.197240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e7e31-2255-4abd-917c-b832ffee8ec0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.270180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.271191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.271480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.271924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] PATH_INFO: `/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe/users/f404dda4023c4ee4b04b8df52e8ebca7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.277062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04ae45-9bb9-44ed-a599-0ecd51e2fb1e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.283586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.283785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.284205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.284589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.285335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.287461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.319925 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3161/6273] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:34 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:34.321990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.337278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fddb3b76e3349e6b22366c38f3f6cbe, user_id=f404dda4023c4ee4b04b8df52e8ebca7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.341724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.345932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0bf8-93de-45df-81c1-f5e3ea50e7dc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.364231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.378055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.378362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.378651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.379477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.382245 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3113/6274] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:34 2022] PUT /identity/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe/users/f404dda4023c4ee4b04b8df52e8ebca7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:34.387013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.389545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.413691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3162/6275] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:34.417812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.430612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fbb70-3157-4323-b9bb-2ba046a58f08 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.501865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d5a31-e6d5-42c2-93e1-502df0d6d150 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.518240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.518994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.519343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.519655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.520480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.522166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.533563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3114/6276] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:34.538650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.550734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.552070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.552557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.552994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] PATH_INFO: `/v3/projects/8c299c43db7e47fa990ebc8f470028f0/users/6a4de3d35598492ba40f303685ebba1d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.553457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc127d6-1181-491e-bbdc-bcbc08598d87 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.561096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.563123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.563439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.563730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] PATH_INFO: `/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe/users/f404dda4023c4ee4b04b8df52e8ebca7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.566940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fddb3b76e3349e6b22366c38f3f6cbe, user_id=f404dda4023c4ee4b04b8df52e8ebca7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.570826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.579248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c299c43db7e47fa990ebc8f470028f0, user_id=6a4de3d35598492ba40f303685ebba1d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.584343 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3115/6277] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:34 2022] PUT /identity/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe/users/f404dda4023c4ee4b04b8df52e8ebca7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:34.588659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.588828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0763f-cf8c-4c5a-be75-c8f0a904ffec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.594962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.601640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3163/6278] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:34 2022] PUT /identity/v3/projects/8c299c43db7e47fa990ebc8f470028f0/users/6a4de3d35598492ba40f303685ebba1d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:34.602974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.603269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.603672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.630404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] MFA Rules not processed for user `f404dda4023c4ee4b04b8df52e8ebca7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:34.631537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.663103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ce1a0-4d69-4fe2-944f-cf40bf9c0674 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.696505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3164/6279] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:34.697351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.718120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.718984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.719269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.719547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] PATH_INFO: `/v3/projects/9b9fc08577c04e31899bce3654102dd5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.720788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9fc08577c04e31899bce3654102dd5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.722705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.761188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6243-a0fb-440d-a27a-c40528d98a35 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.766187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.766858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.767147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.767428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.768153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.769800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.775571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9fc08577c04e31899bce3654102dd5', 'request_id': 'req-3644a7bb-6c54-4462-a3d0-86701b760bfd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:34.779913 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3165/6280] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:34.780759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.781951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9fc08577c04e31899bce3654102dd5', 'request_id': 'req-3644a7bb-6c54-4462-a3d0-86701b760bfd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:34.784366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.787798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9fc08577c04e31899bce3654102dd5', 'request_id': 'req-3644a7bb-6c54-4462-a3d0-86701b760bfd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:34.801056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] The token cache is being invalidate because project 9b9fc08577c04e31899bce3654102dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:34.801342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:34.802048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:34.803600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3116/6281] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:34 2022] DELETE /identity/v3/projects/9b9fc08577c04e31899bce3654102dd5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:34.804535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.806961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.847695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977933-428b-4172-870e-ade2cff8724b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.871914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644a7bb-6c54-4462-a3d0-86701b760bfd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.877169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.878246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.878528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.878809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] PATH_INFO: `/v3/projects/8c299c43db7e47fa990ebc8f470028f0/users/6a4de3d35598492ba40f303685ebba1d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.880919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c299c43db7e47fa990ebc8f470028f0, user_id=6a4de3d35598492ba40f303685ebba1d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.883502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.895286 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3117/6282] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:34 2022] PUT /identity/v3/projects/8c299c43db7e47fa990ebc8f470028f0/users/6a4de3d35598492ba40f303685ebba1d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:34.897308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:34.899334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.899827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.900551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.900844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.901123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.903673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:34.962964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.964969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e55d26-adb7-4a9d-a256-76553fd9e2fc service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:34.969053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede8a66-2a22-41a6-b50b-66c73ecc049d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:34.974121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:34.975133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.975430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.975614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3166/6283] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:34.975716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] PATH_INFO: `/v3/users/d70f9a65b0ef4b19b3e4a3a02ce05094` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.976991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:34.977136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70f9a65b0ef4b19b3e4a3a02ce05094)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:34.977312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:34.977558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:34.979230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:35.007504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] MFA Rules not processed for user `6a4de3d35598492ba40f303685ebba1d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:35.008956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:35.033895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70f9a65b0ef4b19b3e4a3a02ce05094'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.050292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70f9a65b0ef4b19b3e4a3a02ce05094'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.051059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70f9a65b0ef4b19b3e4a3a02ce05094'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.061536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70f9a65b0ef4b19b3e4a3a02ce05094'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.071228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70f9a65b0ef4b19b3e4a3a02ce05094'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.078374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3118/6284] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:34 2022] DELETE /identity/v3/users/d70f9a65b0ef4b19b3e4a3a02ce05094 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:35.108633 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3167/6285] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:35.121301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:35.122822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:35.201260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33059a-be42-4724-8917-3f19d38e44e8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:35.207274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:35.208349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:35.208349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:35.208561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:35.212587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:35.316172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:35.318428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:35.339489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3119/6286] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:35.635255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:35.637577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:35.664786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226ea0-e675-4216-8d6f-4b4c72325910 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:35.751769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:35.752731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:35.753019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:35.753301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] PATH_INFO: `/v3/projects/803193607ef44d1aae21c94d035ca32b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:35.755316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803193607ef44d1aae21c94d035ca32b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:35.757341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:35.824891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803193607ef44d1aae21c94d035ca32b', 'request_id': 'req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.832246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803193607ef44d1aae21c94d035ca32b', 'request_id': 'req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.855361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803193607ef44d1aae21c94d035ca32b', 'request_id': 'req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.870480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:35.883040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7145-c475-4462-9ed4-7822010a541b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:35.907768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] The token cache is being invalidate because project 803193607ef44d1aae21c94d035ca32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:35.908398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.909440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d30f1af-1eb8-4bb9-86f9-5dd1ecc936e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:35.916336 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3168/6287] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:35 2022] DELETE /identity/v3/projects/803193607ef44d1aae21c94d035ca32b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:35.920900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491fa1d-3e5b-4f53-9792-69acadaba0d9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:35.921205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491fa1d-3e5b-4f53-9792-69acadaba0d9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:35.921503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491fa1d-3e5b-4f53-9792-69acadaba0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:35.946248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8491fa1d-3e5b-4f53-9792-69acadaba0d9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:35.947670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8491fa1d-3e5b-4f53-9792-69acadaba0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:35.954351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:35.955326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:35.955615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:35.955903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:35.958690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:36.044552 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3169/6288] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:36.044862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.044862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.052049 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3120/6289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:36.121475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.122076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.122076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.141808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:36.143055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:36.152496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3170/6290] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:36.157091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.168910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3f71e-eefa-4dd6-9b48-afb1a9f6d250 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.174110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.174952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.175346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.175729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.176592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:36.177014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.178734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.205719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3121/6291] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:36.209512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.230211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98562028-fdb4-46ce-8c19-17f49c79cab4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.244290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.246187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.246316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.246563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.252910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.255530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.309653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.316277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3171/6292] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:36.320031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0edb-bbfd-4262-8558-ae820cb8afab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.444919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.445186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.445476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.445757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.446451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.448426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.493910 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3122/6293] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:36 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:36.497698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.515228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b430250-6b25-4188-8bf4-a72690b59838 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.522692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.523627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.523980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.524410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.536366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.545489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.566969 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3172/6294] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:36.571013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.583039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d57c-6662-4413-8985-dbe2c70e6553 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.589622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.590782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.590782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.591128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.592245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.595631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0444cd2-781b-4b77-95ad-a8c2fa207334 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.624648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3123/6295] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:36.626012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.647706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10961438-e613-4a67-b354-8f26d67a709f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.654989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.657975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.660800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.660800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] PATH_INFO: `/v3/projects/7b2b268eb8af4fbbb81f50c6625e5e46/users/30ef66e60d974e50a435965c252945dc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.710707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b268eb8af4fbbb81f50c6625e5e46, user_id=30ef66e60d974e50a435965c252945dc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.716884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:36.763476 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3173/6296] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:36 2022] PUT /identity/v3/projects/7b2b268eb8af4fbbb81f50c6625e5e46/users/30ef66e60d974e50a435965c252945dc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:36.777424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.777728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.780173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.798149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.801087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:36.853440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] MFA Rules not processed for user `30ef66e60d974e50a435965c252945dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:36.855211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:36.938205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370277-debb-4ee1-a5b0-e765bb1fdae0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:36.943394 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3124/6297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:36.954790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:36.955929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:36.956220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:36.956529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] PATH_INFO: `/v3/users/106bbc9055cf4eef9b5fecb873c9385f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:36.956957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:36.958697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106bbc9055cf4eef9b5fecb873c9385f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:36.959667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:36.960530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:37.061271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9036c-23ea-4f7a-9858-43c0f25d84bb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:37.067954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:37.068997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:37.069544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:37.070136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:37.082316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:37.084972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106bbc9055cf4eef9b5fecb873c9385f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.085419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:37.097119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106bbc9055cf4eef9b5fecb873c9385f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.097840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106bbc9055cf4eef9b5fecb873c9385f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.098593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106bbc9055cf4eef9b5fecb873c9385f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.103403 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3125/6298] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:37.117340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f29fad82-9f9f-4e81-92e8-4951f6f68d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106bbc9055cf4eef9b5fecb873c9385f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.149344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3174/6299] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:36 2022] DELETE /identity/v3/users/106bbc9055cf4eef9b5fecb873c9385f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:37.471253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:37.504015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833aa51-a8af-4675-9aaa-cb64458e8fe0 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:37.611418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:37.612803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:37.613183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:37.613598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] PATH_INFO: `/v3/projects/b0b5cf5b9c2f4bd997071853f0724424` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:37.615992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b5cf5b9c2f4bd997071853f0724424)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:37.621701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:37.746624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b5cf5b9c2f4bd997071853f0724424', 'request_id': 'req-f54ef979-5fd8-45fc-a66c-9914b7691b10'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.756686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b5cf5b9c2f4bd997071853f0724424', 'request_id': 'req-f54ef979-5fd8-45fc-a66c-9914b7691b10'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.764235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b5cf5b9c2f4bd997071853f0724424', 'request_id': 'req-f54ef979-5fd8-45fc-a66c-9914b7691b10'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.792289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] The token cache is being invalidate because project b0b5cf5b9c2f4bd997071853f0724424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:37.807006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.814635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f54ef979-5fd8-45fc-a66c-9914b7691b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:37.822231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3126/6300] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:37 2022] DELETE /identity/v3/projects/b0b5cf5b9c2f4bd997071853f0724424 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:37.827816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:37.828079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:37.828371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:37.876009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:37.876009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:37.975651 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3175/6301] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:37.983887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:37.984397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:37.984531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.038720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:38.039965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:38.064729 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3127/6302] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:38.070472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.082957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5bc7f-46d5-4528-8b01-eaaf71f4650b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.094154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.095183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.095812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.096095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.096899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:38.097214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.099244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.116994 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3176/6303] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:38.121902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.136111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf952d80-4b45-4469-a431-d0409ff85ca6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.141737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.142406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.142682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.142955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.144568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.147824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.191746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.198909 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3128/6304] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:38 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:38.205160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e600b3-ece2-464f-aa7e-d0aa1b06feaa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.297017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.297801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.298093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.298371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.299137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.301440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.332546 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3177/6305] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:38 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:38.335440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.353308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358044e-d947-4f73-9118-a7ace458a320 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.359880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.360681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.361041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.361393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.362196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.364119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.376315 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3129/6306] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:38.380767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.396927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c41df-5b61-44e7-93aa-e4ddeb8da3fc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.402969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.403770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.404510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.404857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.405716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.407604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7575d6-8f2e-4f26-837a-201e27c7abaf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.420746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3178/6307] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:38.424852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.436822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451e57-ce78-4898-81f7-72ca801b2a80 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.448604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.449677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.450908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.451398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] PATH_INFO: `/v3/projects/33cdd8617965489c859587b4034347ec/users/a1e4a58cbc274f5ab842d28c45d185c8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.484712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cdd8617965489c859587b4034347ec, user_id=a1e4a58cbc274f5ab842d28c45d185c8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.490334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.527500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3130/6308] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:38 2022] PUT /identity/v3/projects/33cdd8617965489c859587b4034347ec/users/a1e4a58cbc274f5ab842d28c45d185c8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:38.529248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c3e6-95ab-498a-826e-11538887b4a5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.529543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c3e6-95ab-498a-826e-11538887b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.529827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c3e6-95ab-498a-826e-11538887b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.560005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce82c3e6-95ab-498a-826e-11538887b4a5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:38.561434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce82c3e6-95ab-498a-826e-11538887b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:38.705147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3179/6309] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:38.721778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:38.723562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:38.820941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2efd88-f744-430b-a92d-487a7b2afd8e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:38.826148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:38.826983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:38.827819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:38.828209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:38.841025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:38.842621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a991d3a-be7f-47bb-8fc6-3a7899f26e94 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:38.873990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3131/6310] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:40.406625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:40.407736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:40.408271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:40.447324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] MFA Rules not processed for user `a1e4a58cbc274f5ab842d28c45d185c8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:40.449668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:40.544863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3180/6311] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:40.546437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:40.547218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:40.547659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:40.573789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] MFA Rules not processed for user `a1e4a58cbc274f5ab842d28c45d185c8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:40.575337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:40.588142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3132/6312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:40.601588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:40.603869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:40.798037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f6f29-5b53-4b7e-94cb-89047925320f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:40.827213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:40.828683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:40.829082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:40.829466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:40.842582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:40.844361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fb786-d51c-4de2-bb84-e2adbfd488f9 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:40.859178 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3181/6313] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:47.386491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:47.387946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:47.401650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19242-1f6a-43df-99b2-edfeb441d479 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:47.407302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:47.408498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:47.408797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:47.409080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] PATH_INFO: `/v3/users/12e45d0d841b4d1d87b57a068b5f9c96` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:47.410318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e45d0d841b4d1d87b57a068b5f9c96)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:47.412253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:47.466797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e45d0d841b4d1d87b57a068b5f9c96'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:47.479626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e45d0d841b4d1d87b57a068b5f9c96'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:47.480403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e45d0d841b4d1d87b57a068b5f9c96'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:47.488397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e45d0d841b4d1d87b57a068b5f9c96'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:47.497130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e45d0d841b4d1d87b57a068b5f9c96'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:47.503035 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3133/6314] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:47 2022] DELETE /identity/v3/users/12e45d0d841b4d1d87b57a068b5f9c96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:47.507703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:47.508163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:47.508275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:47.525864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:47.527503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:47.586942 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3182/6315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:47.598380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:47.600630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:47.672835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bc55d-26fe-4341-961b-8e166a4d7934 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:47.676703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:47.677706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:47.678000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:47.678274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:47.688957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:47.690818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:47.710091 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3134/6316] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:47.911852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:47.913482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:47.935207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb64e3-d7cf-49f3-be6c-6b87d23f7f2d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:47.941302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:47.942345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:47.942727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:47.943103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] PATH_INFO: `/v3/projects/4e06a13a44b04af782e4b674988f6436` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:47.944397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e06a13a44b04af782e4b674988f6436)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:47.946636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.001051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e06a13a44b04af782e4b674988f6436', 'request_id': 'req-91820bd3-e6ed-4df5-8fe9-45602a89b88c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.008360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e06a13a44b04af782e4b674988f6436', 'request_id': 'req-91820bd3-e6ed-4df5-8fe9-45602a89b88c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.020418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e06a13a44b04af782e4b674988f6436', 'request_id': 'req-91820bd3-e6ed-4df5-8fe9-45602a89b88c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.038912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] The token cache is being invalidate because project 4e06a13a44b04af782e4b674988f6436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:48.039207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.039889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.042267 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3183/6317] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:47 2022] DELETE /identity/v3/projects/4e06a13a44b04af782e4b674988f6436 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:48.046620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.056785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e037-50f7-47a7-86c5-9dee534dba98 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.118885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.120412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.120741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.121017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] PATH_INFO: `/v3/users/6a4de3d35598492ba40f303685ebba1d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.122242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4de3d35598492ba40f303685ebba1d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.124174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.172722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4de3d35598492ba40f303685ebba1d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.184657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4de3d35598492ba40f303685ebba1d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.185346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4de3d35598492ba40f303685ebba1d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.215908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4de3d35598492ba40f303685ebba1d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.225175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-87d3ab0e-b510-4d3e-8bf6-298b31475263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4de3d35598492ba40f303685ebba1d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.231881 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3135/6318] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:48 2022] DELETE /identity/v3/users/6a4de3d35598492ba40f303685ebba1d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:48.428913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.430660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:48.462981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91820bd3-e6ed-4df5-8fe9-45602a89b88c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.533645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.534525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.534815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.535095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] PATH_INFO: `/v3/projects/8c299c43db7e47fa990ebc8f470028f0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.536298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c299c43db7e47fa990ebc8f470028f0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.538243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.593856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c299c43db7e47fa990ebc8f470028f0', 'request_id': 'req-d9b64f6f-df8b-496b-8787-af5245161a1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.602056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c299c43db7e47fa990ebc8f470028f0', 'request_id': 'req-d9b64f6f-df8b-496b-8787-af5245161a1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.615337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c299c43db7e47fa990ebc8f470028f0', 'request_id': 'req-d9b64f6f-df8b-496b-8787-af5245161a1c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.632791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] The token cache is being invalidate because project 8c299c43db7e47fa990ebc8f470028f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:48.633159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.633849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d9b64f6f-df8b-496b-8787-af5245161a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:48.635819 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3184/6319] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:48 2022] DELETE /identity/v3/projects/8c299c43db7e47fa990ebc8f470028f0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:48.641100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.641638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.641638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.664254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:48.665521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:48.743010 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3136/6320] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:48.752839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.753312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.753937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.778746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:48.779967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:48.789252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3185/6321] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:48.793856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.804045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d30b6-7974-48ec-a33d-b873c685276c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.811791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.812564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.812855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.813264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.814007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:48.814318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.815930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.828575 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3137/6322] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:12:48.832692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.842117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68c17e-14a4-4b4b-bc9a-dd3c63f2ad8b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.846852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.847636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.847802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.848059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.848781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.850848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.881270 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3186/6323] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:48 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:48.882492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.893514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d7bd-ce59-4bd4-85c0-05df78b103e1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.948927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.949597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.949881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.950157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.950827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.952756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:48.975145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3138/6324] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:48 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:48.976644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:48.987601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70d40d-31e0-4776-a4b6-74ab0ad368b2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:48.992190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:48.992876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:48.993160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:48.993436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:48.994152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:48.996323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:49.007956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3187/6325] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:49.012252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:49.022480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec27823-496b-4acc-857b-2d765d1f7083 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:49.027209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:49.027864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:49.028147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:49.028423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:49.029167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:49.030752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c576a5d-0dfd-4b4b-8862-19397694b54d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:49.044008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3139/6326] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:49.045213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:49.055552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24c107-aa8d-4999-88fd-c257406fcfc7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:49.061650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:49.062600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:49.062839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:49.063130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] PATH_INFO: `/v3/projects/f747f5124bd44e6b83cad71f0d0d838b/users/cd669f63215745ae9222f38be5c26d00/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:49.077930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f747f5124bd44e6b83cad71f0d0d838b, user_id=cd669f63215745ae9222f38be5c26d00, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:49.080689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:49.095926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3188/6327] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:49 2022] PUT /identity/v3/projects/f747f5124bd44e6b83cad71f0d0d838b/users/cd669f63215745ae9222f38be5c26d00/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:49.108277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:49.108691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:49.109041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:49.140218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] MFA Rules not processed for user `cd669f63215745ae9222f38be5c26d00`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:49.141545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:49.224656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3140/6328] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:49.230251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:49.232167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:49.304487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:49.306262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:49.318221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c8211-5b17-4641-a656-8c643f758476 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:49.318776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:49.319485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:49.319761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:49.320185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:49.330127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:49.331719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:49.342536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3189/6329] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:49.382569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029750cc-0c18-44fd-b6d8-601d68218470 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:49.386710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:49.387444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:49.387735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:49.388064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:49.390901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:49.484528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:49.486052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d284-3fd0-47f8-b94f-8cac49cb4e33 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:49.510562 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3141/6330] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:51.565534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:51.567808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:51.690100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4900cc-4af8-4257-8d6a-353c8deb2fe0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:51.695676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:51.696839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:51.697907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:51.698349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] PATH_INFO: `/v3/users/30ef66e60d974e50a435965c252945dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:51.699878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ef66e60d974e50a435965c252945dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:51.702283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:51.768639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ef66e60d974e50a435965c252945dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:51.780203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ef66e60d974e50a435965c252945dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:51.780918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ef66e60d974e50a435965c252945dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:51.781611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ef66e60d974e50a435965c252945dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:51.789156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ef66e60d974e50a435965c252945dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:51.811967 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3190/6331] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:51 2022] DELETE /identity/v3/users/30ef66e60d974e50a435965c252945dc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:51.817007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:51.817585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:51.818030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:51.837041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:51.838906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:51.905000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3142/6332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:51.914800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:51.916223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:51.976544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45028a-8775-4168-9b89-7305c8659d9f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:51.980286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:51.980985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:51.981270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:51.981551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:51.990715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:51.992157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ae75-f5a2-4ac0-a63f-663dc73aa652 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:52.001728 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3191/6333] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:52.239244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:52.244979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:52.267206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c2dcd-d470-41e3-adbc-7e00037227ac None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:52.276131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:52.277100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.277615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.278327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] PATH_INFO: `/v3/projects/7b2b268eb8af4fbbb81f50c6625e5e46` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.279885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2b268eb8af4fbbb81f50c6625e5e46)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:52.281548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:52.372139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2b268eb8af4fbbb81f50c6625e5e46', 'request_id': 'req-dc125d56-3e15-4863-9549-58e874db6f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:52.382648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2b268eb8af4fbbb81f50c6625e5e46', 'request_id': 'req-dc125d56-3e15-4863-9549-58e874db6f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:52.404072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2b268eb8af4fbbb81f50c6625e5e46', 'request_id': 'req-dc125d56-3e15-4863-9549-58e874db6f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:52.436815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] The token cache is being invalidate because project 7b2b268eb8af4fbbb81f50c6625e5e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:52.437265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:52.438053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-dc125d56-3e15-4863-9549-58e874db6f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:52.444492 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3143/6334] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:52 2022] DELETE /identity/v3/projects/7b2b268eb8af4fbbb81f50c6625e5e46 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:52.446195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.446498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.446782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.504832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:52.506068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:52.610590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3192/6335] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:52.618308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.618624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.618892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.641459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:52.643772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:52.665179 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3144/6336] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:52.670424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:52.698428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d8dd5-0bcf-4358-b406-82535616b6ae None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:52.720311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:52.721927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.722436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.722927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.723721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:52.723981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:52.725894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:52.763214 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3193/6337] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:52.764690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:52.775316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b641b-4d0a-4ef4-97d8-f7c4dd5f59a6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:52.781931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:52.782849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.783339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.783633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.784541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:52.786490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:52.820970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3145/6338] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:52 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:52.825541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:52.845142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164b3b-7b10-4945-b169-89483a868fbc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:52.915459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:52.916134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.916558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.916943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.917743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:52.919981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:52.950519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3194/6339] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:52 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:52.955135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:52.966130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08102566-11f3-40ca-ba9c-d52b17e02aa0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:52.972085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:52.973002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:52.973447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:52.973913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:52.974897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:52.976745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:53.004566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:53.008012 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3146/6340] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:53.018966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601f2cf-9815-4cda-83c9-7d078fd77c75 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:53.026669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:53.027440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:53.027753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:53.028036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:53.029120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:53.030981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a4d35-bc75-4350-a787-ef94832c29a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:53.047313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3195/6341] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:53.048412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:53.066099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b60f-937f-4dae-a511-9ec5c55ecf2c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:53.083998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:53.085144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:53.085612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:53.086048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] PATH_INFO: `/v3/projects/14bf0d6bab4d44b6844a8b0847037dcf/users/cb535f68cbeb4275a6f8481c1b2bb372/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:53.120210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bf0d6bab4d44b6844a8b0847037dcf, user_id=cb535f68cbeb4275a6f8481c1b2bb372, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:53.123478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:53.156486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3147/6342] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:53 2022] PUT /identity/v3/projects/14bf0d6bab4d44b6844a8b0847037dcf/users/cb535f68cbeb4275a6f8481c1b2bb372/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:53.169647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:53.169942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:53.170227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:53.209889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] MFA Rules not processed for user `cb535f68cbeb4275a6f8481c1b2bb372`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:53.210730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:53.360052 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3196/6343] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:53.374143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:53.376496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:53.488174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aab76-602c-45fb-b595-a1db6717a4e7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:53.492764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:53.493687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:53.494129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:53.495214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:53.545281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:53.561121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:53.592259 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3148/6344] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:53.618406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:53.620416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:53.731476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f369d-498b-44dc-b882-c49873b6e945 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:53.741255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:53.742345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:53.743055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:53.743055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:53.746112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:53.779308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:53.783611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5870b-97bd-4d27-9412-8da6732285e9 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:53.823494 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3197/6345] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:12:56.122245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:56.124673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:56.252220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee1b2-4cd1-4c05-a29c-93f1fc5b0907 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:56.273647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:56.276145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:56.276704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:56.277191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] PATH_INFO: `/v3/users/cd669f63215745ae9222f38be5c26d00` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:56.278989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd669f63215745ae9222f38be5c26d00)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:56.281560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:56.356564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd669f63215745ae9222f38be5c26d00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:56.380591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd669f63215745ae9222f38be5c26d00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:56.381360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd669f63215745ae9222f38be5c26d00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:56.401542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd669f63215745ae9222f38be5c26d00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:56.415685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd669f63215745ae9222f38be5c26d00'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:56.430218 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3149/6346] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:56 2022] DELETE /identity/v3/users/cd669f63215745ae9222f38be5c26d00 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:56.430670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:56.431181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:56.431873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:56.453781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:56.455290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:56.526831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3198/6347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:12:56.536839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:56.538596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:56.604871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e050e2-3ad6-4298-a86b-21861c7b34d0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:56.609303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:56.609910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:56.610192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:56.610642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:56.622860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:56.624919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c66e6-f381-49d5-a475-e870f93de4db service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:56.638281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3150/6348] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:56.966099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:56.967945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:56.989332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d3f2d-3b57-4673-b44f-308ecd86c2dc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.012785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.013853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.014373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.014894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] PATH_INFO: `/v3/projects/f747f5124bd44e6b83cad71f0d0d838b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.017223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f747f5124bd44e6b83cad71f0d0d838b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.022163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.100539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f747f5124bd44e6b83cad71f0d0d838b', 'request_id': 'req-95ba4103-9628-4e9f-b01c-516d68503d8b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:57.112912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f747f5124bd44e6b83cad71f0d0d838b', 'request_id': 'req-95ba4103-9628-4e9f-b01c-516d68503d8b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:57.137520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f747f5124bd44e6b83cad71f0d0d838b', 'request_id': 'req-95ba4103-9628-4e9f-b01c-516d68503d8b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:57.159282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] The token cache is being invalidate because project f747f5124bd44e6b83cad71f0d0d838b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:57.159946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:57.161195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-95ba4103-9628-4e9f-b01c-516d68503d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:57.164663 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3199/6349] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:56 2022] DELETE /identity/v3/projects/f747f5124bd44e6b83cad71f0d0d838b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:57.169701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.170180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.170284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.192115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:57.193466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:57.304796 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3151/6350] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:57.312877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.313153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.313690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.341523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:57.343074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:57.355118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3200/6351] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:57.359692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.372092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e855d-6461-40da-94d5-19f004fdc598 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.379950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.380867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.381219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.381594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.382488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:57.382866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.385298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.403301 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3152/6352] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:57.404487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.416735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dca5a-e2a9-4689-8a86-44fc282db3d0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.423783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.424631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.424980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.425394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.426185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.428254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.459673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3201/6353] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:57 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:57.463677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.474526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e2c96-67fd-4b23-bbb9-6f0e71606814 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.546346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.547141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.547499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.548037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.548867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.551382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.584087 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3153/6354] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:57 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:12:57.585425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.596514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38732-1dbf-4628-bcb9-b7510c902bdc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.601714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.602632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.603067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.604159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.605292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.607041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.621550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3202/6355] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:57.627534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.639983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912559e7-0a2b-4fc9-a318-8f400cf0e5e0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.645583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.646372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.646721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.647156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.648122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.650925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3157-56d3-42a2-9307-df12df5778b9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.667454 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3154/6356] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:12:57.668893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.679428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57600d-8582-4cb7-aab3-a1f4f57a345f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.685058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.685972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.686258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.686535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] PATH_INFO: `/v3/projects/debf67803ec549e7b67ed957595ed580/users/e5cbf416628643a180fb45c45c9ec4fc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.704769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=debf67803ec549e7b67ed957595ed580, user_id=e5cbf416628643a180fb45c45c9ec4fc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.707524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.722521 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3203/6357] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:57 2022] PUT /identity/v3/projects/debf67803ec549e7b67ed957595ed580/users/e5cbf416628643a180fb45c45c9ec4fc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:12:57.734523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.735100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.735756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.770433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] MFA Rules not processed for user `e5cbf416628643a180fb45c45c9ec4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:57.771660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:57.856260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3155/6358] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:57.870067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:57.872401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:57.943093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853c927-3707-4312-bafc-b72bca1b1c40 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:57.947844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:57.948699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:57.949790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:57.950082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:57.963233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:57.964822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e141-4928-4dd8-b34b-76d3dc6e2a11 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:57.974370 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3204/6359] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:57.989817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:58.063367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fff42-41b9-41f3-8171-dd3a286a5b2d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:58.068884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:58.069759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:58.070049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:58.070326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] PATH_INFO: `/v3/users/e5cbf416628643a180fb45c45c9ec4fc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:58.071640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5cbf416628643a180fb45c45c9ec4fc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:58.073642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:58.139847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5cbf416628643a180fb45c45c9ec4fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.156652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5cbf416628643a180fb45c45c9ec4fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.157409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5cbf416628643a180fb45c45c9ec4fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.167866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5cbf416628643a180fb45c45c9ec4fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.176174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5cbf416628643a180fb45c45c9ec4fc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.185648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3156/6360] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:12:57 2022] DELETE /identity/v3/users/e5cbf416628643a180fb45c45c9ec4fc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:58.193260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:58.193629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:58.193825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:58.241012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:58.243571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:58.363983 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3205/6361] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:58.374543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:58.376731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:58.465685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b710819-9fd3-4164-bffd-dc86e34b9519 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:58.469562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:58.470254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:58.470539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:58.470865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:58.480362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:58.481824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26093748-5d62-4ace-8a77-f06a30d63f3f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:58.491469 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3157/6362] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:12:58.799704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:58.803330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:58.825011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55ff5-4e10-42ba-ba55-1f00db66d7a0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:58.841186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:58.845297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:58.845846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:58.846333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] PATH_INFO: `/v3/projects/debf67803ec549e7b67ed957595ed580` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:58.847945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=debf67803ec549e7b67ed957595ed580)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:58.850326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:58.954392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debf67803ec549e7b67ed957595ed580', 'request_id': 'req-8d4bc124-ec4a-41f6-b710-07990c62d9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.962374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debf67803ec549e7b67ed957595ed580', 'request_id': 'req-8d4bc124-ec4a-41f6-b710-07990c62d9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.982269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debf67803ec549e7b67ed957595ed580', 'request_id': 'req-8d4bc124-ec4a-41f6-b710-07990c62d9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.997077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] The token cache is being invalidate because project debf67803ec549e7b67ed957595ed580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:12:58.997373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:58.998220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8d4bc124-ec4a-41f6-b710-07990c62d9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:12:59.000315 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3206/6363] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:12:58 2022] DELETE /identity/v3/projects/debf67803ec549e7b67ed957595ed580 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:59.005289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.005785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.006263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.032079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:59.033552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:59.128174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3158/6364] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:59.144710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.145451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.146096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.179203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:59.180831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:59.203856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3207/6365] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:59.207174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.219995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7349-dbc2-4267-ac3a-0928fede21de None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.226334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.227135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.227662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.228160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.229529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:12:59.229912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.231634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.253759 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3159/6366] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:12:59.257832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.269504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f334dd-9a4a-4603-85fa-708edf1ef42c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.282218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.282894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.283347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.283630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.284320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.286443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.317351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3208/6367] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:12:59 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:59.321313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.337003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014d52-38c3-4909-8c4c-01e57498b09e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.431150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.432159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.432839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.433260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.434763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.436946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.469908 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3160/6368] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:12:59 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:12:59.475037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.490484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81107dc0-64fc-4398-b616-bea5c13d62c9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.496925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.498074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.498570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.499081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.500644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.502647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.522105 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3209/6369] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:59.526372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.540057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9b73-cafd-4a7d-a67c-de73e5de49aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.550356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.551226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.551658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.551965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.552893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.555668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890d53d-8781-46c8-b5de-8dfd6fb42716 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.575491 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3161/6370] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:12:59.580761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.595095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae88c-9506-4966-919b-c4f6a9b96651 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.601453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.602769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.603796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.604125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] PATH_INFO: `/v3/projects/fa30034b1f50432a9eae68d4d0c69d52/users/f1d2224bfe5e4be0a857279845101282/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.631401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa30034b1f50432a9eae68d4d0c69d52, user_id=f1d2224bfe5e4be0a857279845101282, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.641466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.680060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3210/6371] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:12:59 2022] PUT /identity/v3/projects/fa30034b1f50432a9eae68d4d0c69d52/users/f1d2224bfe5e4be0a857279845101282/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:12:59.686519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.687513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.688506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.726740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] MFA Rules not processed for user `f1d2224bfe5e4be0a857279845101282`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:12:59.728868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:59.828619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3162/6372] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:12:59.835081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:12:59.837323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:12:59.916133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b46dc-ad7a-4e34-9715-9a899f97c3b2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:12:59.924775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:12:59.925452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:12:59.925735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:12:59.926011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:12:59.940058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:12:59.941861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:12:59.954617 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3211/6373] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:00.230819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:00.232286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:00.363577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f3cb-59a4-44b9-8912-2934acac7e78 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:00.371702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:00.373414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:00.373739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:00.374022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:00.376721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:00.406537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:00.408387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:00.424796 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3163/6374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:02.404344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:02.405918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:02.529743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9bbd1-a7e5-469c-a686-196bcab70826 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:02.534930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:02.537692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:02.538161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:02.538450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] PATH_INFO: `/v3/users/a1e4a58cbc274f5ab842d28c45d185c8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:02.539700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e4a58cbc274f5ab842d28c45d185c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:02.542357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:02.629845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e4a58cbc274f5ab842d28c45d185c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:02.647627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e4a58cbc274f5ab842d28c45d185c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:02.649589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e4a58cbc274f5ab842d28c45d185c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:02.651625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e4a58cbc274f5ab842d28c45d185c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:02.666686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3f756179-1388-4c77-8754-921557bed5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e4a58cbc274f5ab842d28c45d185c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:02.725791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3212/6375] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:02 2022] DELETE /identity/v3/users/a1e4a58cbc274f5ab842d28c45d185c8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:03.055590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.073192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7c6d-84be-4645-8d34-f44ce5ebd33a service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.188232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.189249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.189531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.189805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] PATH_INFO: `/v3/projects/33cdd8617965489c859587b4034347ec` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.193294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cdd8617965489c859587b4034347ec)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.195494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.269583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cdd8617965489c859587b4034347ec', 'request_id': 'req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:03.278770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cdd8617965489c859587b4034347ec', 'request_id': 'req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:03.287139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cdd8617965489c859587b4034347ec', 'request_id': 'req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:03.306134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] The token cache is being invalidate because project 33cdd8617965489c859587b4034347ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:03.306726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:03.307946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3f59a55a-4e4f-47c9-a0d8-118daea5e86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:03.310010 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3164/6376] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:03 2022] DELETE /identity/v3/projects/33cdd8617965489c859587b4034347ec => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:03.315440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.315733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.316013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.342668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:03.346928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:03.445640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3213/6377] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:03.456307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.456968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.457456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.483875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:03.485240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:03.496066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3165/6378] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:03.499985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.511710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97a176-05db-479a-a0d0-3e58812b44ab None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.517149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.517850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.518140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.518606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.519343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:03.519657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.521352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.541152 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3214/6379] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:03.543254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.579379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b78427-a85a-4042-8b5f-75df9fd12cfe None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.587689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.588601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.589167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.589467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.590210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.592647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.638827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3166/6380] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:03 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:03.641338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.659840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea64c-2937-4b34-8fa8-f741491712dc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.739477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.740558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.741022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.741378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.742291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.744778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.770943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3215/6381] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:03 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:03.775081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.785466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5bfb-044e-4dd7-8568-5c17322542bf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.790149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.791353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.791635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.792064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.792824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.794415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.805304 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3167/6382] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:03.810348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.821326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ca0-6c7c-4d1b-8f98-c6e4d22e511e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.826839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.827519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.827807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.828086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.828888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.830536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47c5a3-726a-4e0d-bc80-363db03327ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.844478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3216/6383] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:03.845943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:03.857503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aaeb5-c062-49d5-bffc-bd228e422305 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:03.867605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:03.869210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.869846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.870136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] PATH_INFO: `/v3/projects/dfe4735870c44412b279a096ae5dd79c/users/b630191a1dd14563a904c81c462bb800/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.891643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe4735870c44412b279a096ae5dd79c, user_id=b630191a1dd14563a904c81c462bb800, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:03.895030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:03.912557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3168/6384] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:03 2022] PUT /identity/v3/projects/dfe4735870c44412b279a096ae5dd79c/users/b630191a1dd14563a904c81c462bb800/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:03.917670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412afa-4826-4c18-8497-cb9bbf6f80f0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:03.917967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412afa-4826-4c18-8497-cb9bbf6f80f0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:03.918250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412afa-4826-4c18-8497-cb9bbf6f80f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:03.939139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-93412afa-4826-4c18-8497-cb9bbf6f80f0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:03.941686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93412afa-4826-4c18-8497-cb9bbf6f80f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:04.013816 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3217/6385] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:04.028086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:04.030384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:04.111572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ad67-4b3d-4747-b3f6-8c0679ab7ec9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:04.115580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:04.116263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:04.117080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:04.117080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:04.128019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:04.129505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d3f51-c1dc-4d24-859d-acb8c5faaa43 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:04.143084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3169/6386] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:05.035529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:05.036273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:05.036273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:05.077154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:05.078740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:05.196583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3218/6387] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:05.209097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:05.210134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:05.210563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:05.233586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:05.235226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:05.250831 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3170/6388] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:05.258501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:05.260346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:05.390622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc28082-fd57-4c0f-b56c-d0a6fe3faae3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:05.403036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:05.404213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:05.404787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:05.405257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:05.423305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:05.424600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:05.438811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3219/6389] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:10.881386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:10.914540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c416c3-0c2e-47df-90ca-b3756eeecc31 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:10.923426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:10.924207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:10.924611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:10.924967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:10.926960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:10.944135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:10.945947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf694-2d05-43b2-8407-2a538bbcf6b3 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:10.961437 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3171/6390] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:11.094018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:11.098216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:11.121285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e4689-b29d-474f-8f72-a7fe49cfb103 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:11.126963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:11.130021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:11.130285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:11.130575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] PATH_INFO: `/v3/users/9c65eea593394a6483c4b998a2ef1340` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:11.132941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c65eea593394a6483c4b998a2ef1340)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:11.135830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:11.222796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c65eea593394a6483c4b998a2ef1340'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.234163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c65eea593394a6483c4b998a2ef1340'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.235334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c65eea593394a6483c4b998a2ef1340'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.235992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c65eea593394a6483c4b998a2ef1340'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.246690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c65eea593394a6483c4b998a2ef1340'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.273363 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3220/6391] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:11 2022] DELETE /identity/v3/users/9c65eea593394a6483c4b998a2ef1340 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:11.278162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8185-d921-4be7-9cf1-478c5d5fedf5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:11.278454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8185-d921-4be7-9cf1-478c5d5fedf5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:11.278769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8185-d921-4be7-9cf1-478c5d5fedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:11.309332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-825f8185-d921-4be7-9cf1-478c5d5fedf5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:11.310790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-825f8185-d921-4be7-9cf1-478c5d5fedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:11.388271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3172/6392] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:11.430482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:11.432893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:11.503786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba1090-ae2c-40cd-9ced-6ef5d27b6e3c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:11.508328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:11.509451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:11.509740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:11.510218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:11.537950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:11.539669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:11.543473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019321-d14f-4a0b-914e-b4f2fdd98832 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:11.543764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019321-d14f-4a0b-914e-b4f2fdd98832 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:11.544071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68019321-d14f-4a0b-914e-b4f2fdd98832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:11.554657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3221/6393] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:11.564381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-68019321-d14f-4a0b-914e-b4f2fdd98832 None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:11.565673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-68019321-d14f-4a0b-914e-b4f2fdd98832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:11.688827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3173/6394] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:11.808363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:11.811968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:11.852788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad475-324d-4a8f-b37e-f6ae89e00617 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:11.866404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:11.900515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:11.900515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:11.900515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] PATH_INFO: `/v3/users/cb535f68cbeb4275a6f8481c1b2bb372` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:11.907829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb535f68cbeb4275a6f8481c1b2bb372)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:11.919921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:11.987484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb535f68cbeb4275a6f8481c1b2bb372'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.997700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb535f68cbeb4275a6f8481c1b2bb372'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.998551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb535f68cbeb4275a6f8481c1b2bb372'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:11.999125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb535f68cbeb4275a6f8481c1b2bb372'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.007885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb535f68cbeb4275a6f8481c1b2bb372'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.045357 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3222/6395] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:11 2022] DELETE /identity/v3/users/cb535f68cbeb4275a6f8481c1b2bb372 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:12.050349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.050886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.051158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.073535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:12.075447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.161743 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3174/6396] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:12.176599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.179103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.251877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f290f-b248-43ad-b740-ab3c630d9d17 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:12.257238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:12.258204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.258803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.259136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.270700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:12.272526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:12.283280 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3223/6397] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:12.372409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.374679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.393530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601e064-bbc1-4158-9c0d-32fd9c261036 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:12.398446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:12.399123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.399627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.400663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.402822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.415560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:12.417918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:12.442418 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3175/6398] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:12.475167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.476983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.496689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6e812-0d9d-424c-bef9-8ecca4d35ce7 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:12.519024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:12.520770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.521260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.521694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] PATH_INFO: `/v3/projects/733befed769a4ec29b3f10b0efd4504f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.524150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=733befed769a4ec29b3f10b0efd4504f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:12.527182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:12.607835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733befed769a4ec29b3f10b0efd4504f', 'request_id': 'req-5aaab96f-01f5-4359-9471-4bf8326d9c0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.617443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733befed769a4ec29b3f10b0efd4504f', 'request_id': 'req-5aaab96f-01f5-4359-9471-4bf8326d9c0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.628483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733befed769a4ec29b3f10b0efd4504f', 'request_id': 'req-5aaab96f-01f5-4359-9471-4bf8326d9c0b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.641845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] The token cache is being invalidate because project 733befed769a4ec29b3f10b0efd4504f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:12.642396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.643243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.649505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3224/6399] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:12 2022] DELETE /identity/v3/projects/733befed769a4ec29b3f10b0efd4504f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:12.651354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.666514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5befd-a771-4128-b322-99277e04c41e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:12.697814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.699260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.782279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:12.783754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.784249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.784855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] PATH_INFO: `/v3/users/f404dda4023c4ee4b04b8df52e8ebca7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.786701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f404dda4023c4ee4b04b8df52e8ebca7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:12.788861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:12.795521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaab96f-01f5-4359-9471-4bf8326d9c0b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:12.801930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:12.802889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.803246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.803585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] PATH_INFO: `/v3/projects/14bf0d6bab4d44b6844a8b0847037dcf` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:12.805196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bf0d6bab4d44b6844a8b0847037dcf)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:12.813372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:12.850517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f404dda4023c4ee4b04b8df52e8ebca7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.868110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f404dda4023c4ee4b04b8df52e8ebca7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.869665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f404dda4023c4ee4b04b8df52e8ebca7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.883129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f404dda4023c4ee4b04b8df52e8ebca7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.886556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bf0d6bab4d44b6844a8b0847037dcf', 'request_id': 'req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.893163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f404dda4023c4ee4b04b8df52e8ebca7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.901055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bf0d6bab4d44b6844a8b0847037dcf', 'request_id': 'req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.906609 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3176/6400] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:12 2022] DELETE /identity/v3/users/f404dda4023c4ee4b04b8df52e8ebca7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:12.907558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:12.909513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:12.922578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bf0d6bab4d44b6844a8b0847037dcf', 'request_id': 'req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.949357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] The token cache is being invalidate because project 14bf0d6bab4d44b6844a8b0847037dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:12.949652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.950413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3cd54eae-aa27-4bdf-b2d0-9267a80eea0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:12.952763 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3225/6401] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:12 2022] DELETE /identity/v3/projects/14bf0d6bab4d44b6844a8b0847037dcf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:12.957145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b811-1514-411a-b3b2-bf8313a79e53 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:12.957436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b811-1514-411a-b3b2-bf8313a79e53 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:12.957838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b811-1514-411a-b3b2-bf8313a79e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.006548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e613b811-1514-411a-b3b2-bf8313a79e53 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.008939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e613b811-1514-411a-b3b2-bf8313a79e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.063286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dff924-0cc6-4efe-9329-e619675f354a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.093691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.094840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.095129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.095404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] PATH_INFO: `/v3/users/f1d2224bfe5e4be0a857279845101282` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.097474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d2224bfe5e4be0a857279845101282)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.098672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3226/6402] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:13.100554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.107004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.107553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.107962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.157617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.159367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.162740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d2224bfe5e4be0a857279845101282'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.176180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d2224bfe5e4be0a857279845101282'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.176959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d2224bfe5e4be0a857279845101282'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.181248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3227/6403] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:13.185561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.193014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d2224bfe5e4be0a857279845101282'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.196044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d323f-2377-456b-8d7b-b614c6af9a73 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.201944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.203539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.205049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.205784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a1c42e69-60f1-4fa0-a83d-cde697b8a706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d2224bfe5e4be0a857279845101282'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.205979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.207457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:13.207896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.209847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.224630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3177/6404] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:12 2022] DELETE /identity/v3/users/f1d2224bfe5e4be0a857279845101282 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:13.225339 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3228/6405] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:13.249207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.249375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.249485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.251454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.263569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.275908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3e06d-475a-42b5-8712-e8e6f66b3d48 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.288575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.290324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.356153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.357102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.357408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.357884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.359050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.361563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.386231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3178/6406] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:13.398110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3229/6407] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:13.402295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.411849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.414562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bafe06-125d-45af-8b1c-0ccc3d8ee025 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.416968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.513908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63212fc-0b11-4678-b628-e5059ba3f44d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.519077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.519854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.520146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.520481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.521806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.522700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.523262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.523743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.525304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.528035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.533775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.535766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.547160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3230/6408] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:13.555719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3179/6409] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/users => generated 281 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:13.555952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.561582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.564018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.590007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d8f0-8e06-4c0b-b8f4-befb4994c24c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.594480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd4967-6a43-4efc-b793-a914e91321f6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.603237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.603237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.604041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.604179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.605144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.606006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.606195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.606672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.606955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] PATH_INFO: `/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.608428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.611921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fddb3b76e3349e6b22366c38f3f6cbe)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.614624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.628245 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3180/6410] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:13.631947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.644358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbda59-eaa8-4af0-bb57-19fdce741e13 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.650611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.651269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.651620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.652001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.652840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.654561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.669484 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3181/6411] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:13.673204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.688867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867e66f-76de-4c35-95fb-1f74a3c956a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.692151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fddb3b76e3349e6b22366c38f3f6cbe', 'request_id': 'req-9746835c-355a-4bbf-a3d0-06454b17caa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.701024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fddb3b76e3349e6b22366c38f3f6cbe', 'request_id': 'req-9746835c-355a-4bbf-a3d0-06454b17caa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.714341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fddb3b76e3349e6b22366c38f3f6cbe', 'request_id': 'req-9746835c-355a-4bbf-a3d0-06454b17caa8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.732303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] The token cache is being invalidate because project 0fddb3b76e3349e6b22366c38f3f6cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:13.732711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.733479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9746835c-355a-4bbf-a3d0-06454b17caa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.735515 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3231/6412] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:13 2022] DELETE /identity/v3/projects/0fddb3b76e3349e6b22366c38f3f6cbe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:13.743783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.744195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.744496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.765040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.766559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.767381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.767790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] PATH_INFO: `/v3/projects/359e6007027c41689cd67abd2e93ba69/users/c79b89950d9640aa9f63ed6e829c3b9a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.771176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.774005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.788604 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3232/6413] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:13.790423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=359e6007027c41689cd67abd2e93ba69, user_id=c79b89950d9640aa9f63ed6e829c3b9a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.793267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c663b-47d1-48b2-9a9c-bc5b454b9a6b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.794225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.798638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.819861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3182/6414] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:13 2022] PUT /identity/v3/projects/359e6007027c41689cd67abd2e93ba69/users/c79b89950d9640aa9f63ed6e829c3b9a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:13.819861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b08-7522-44e1-a3db-71a291249eff None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.819861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b08-7522-44e1-a3db-71a291249eff None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.819861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8b08-7522-44e1-a3db-71a291249eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.832415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e21e0f-d252-49f8-90b9-aa5ff1318fc4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:13.842532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6fde8b08-7522-44e1-a3db-71a291249eff None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.844331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6fde8b08-7522-44e1-a3db-71a291249eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.897161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:13.898081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.898361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.898631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] PATH_INFO: `/v3/projects/fa30034b1f50432a9eae68d4d0c69d52` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.899860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa30034b1f50432a9eae68d4d0c69d52)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:13.901788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:13.909625 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3183/6415] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:13.910924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf746e-3eaf-4333-a99a-984da52cd822 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:13.911221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf746e-3eaf-4333-a99a-984da52cd822 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:13.911503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf746e-3eaf-4333-a99a-984da52cd822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:13.938947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-14bf746e-3eaf-4333-a99a-984da52cd822 None None] MFA Rules not processed for user `c79b89950d9640aa9f63ed6e829c3b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:13.940071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14bf746e-3eaf-4333-a99a-984da52cd822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:13.947699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa30034b1f50432a9eae68d4d0c69d52', 'request_id': 'req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.953886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa30034b1f50432a9eae68d4d0c69d52', 'request_id': 'req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.962209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa30034b1f50432a9eae68d4d0c69d52', 'request_id': 'req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.973788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] The token cache is being invalidate because project fa30034b1f50432a9eae68d4d0c69d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:13.974084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.974751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:13.976781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3233/6416] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:13 2022] DELETE /identity/v3/projects/fa30034b1f50432a9eae68d4d0c69d52 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:13.977371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:13.979055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.008931 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3184/6417] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:14.011152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.011542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.011918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.030572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:14.031779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.052645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb3ea6-bb69-4e38-be8a-4d99cf78493d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.058749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.059428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.059713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.059990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.061238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:14.061686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.063407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.081039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3234/6418] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:14.081039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.083292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.093196 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3185/6419] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:14.094052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.103785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9338fa-8238-41d1-a56b-ba6257808a5d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.109757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.110570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.110862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.111140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.111829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.113762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33d3e4-fac2-4319-8a4c-8e11e3225292 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.143628 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3186/6420] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:14.145251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.145535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.145814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.169501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:14.169501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.171804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10505c-8b06-4d97-8677-05e5fd00de74 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.234155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.234818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.235101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.235396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.236608 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3187/6421] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:14.237711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.252543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306557-5727-42e2-8e91-d5f99fddcec1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.260335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.261383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.262366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.262844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.263693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.266761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.291866 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3188/6422] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:14.292760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.297370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.299006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.310309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d205f7-9412-479a-8c10-b881b3732be5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.313800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3235/6423] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:14.314722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.316626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.317340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.317758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.318038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.319405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:14.319717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.322373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.329434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc76-402c-4651-aebc-f0b616af6a3c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.338066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.339034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.339619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.340098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.341038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.342875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.348761 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3189/6424] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:14.354169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.357975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3236/6425] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:14.361721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.370940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122c84c-233d-4846-8d83-4a70cb07a907 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.377925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5458c-7791-4350-8db5-39a0bb648aea admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.379921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.380805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.381164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.381450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.382390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.384618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.390042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.391265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.391832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.392313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.393232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.397977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.422517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3190/6426] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/projects => generated 355 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:14.424015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.429836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3237/6427] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:14.437144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.462913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413f5-f22b-42f6-9f7f-254480488584 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.529403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136fb08-12ef-43c7-9181-eeac48afda10 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.534474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.534671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.536017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.536017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.536220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.536307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.536390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.536550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] PATH_INFO: `/v3/projects/f59aaf22978e4c75a101f51d2081db70/users/77639746ed634064b00001f0a78bdcfe/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.536971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.538992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.554102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59aaf22978e4c75a101f51d2081db70, user_id=77639746ed634064b00001f0a78bdcfe, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.558034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5db42-90e1-4c8c-a03b-1920813c7add admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.564502 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3191/6428] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/users => generated 278 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:14.568304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.572918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3238/6429] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:14 2022] PUT /identity/v3/projects/f59aaf22978e4c75a101f51d2081db70/users/77639746ed634064b00001f0a78bdcfe/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:14.581933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec3e-050d-4bd8-aa85-28932db9ddd5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.582983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.582983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.583243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.616694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] MFA Rules not processed for user `77639746ed634064b00001f0a78bdcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:14.617936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.657267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.657267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.657713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.657975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.658609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.660208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.672389 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3192/6430] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:14.676524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.687622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96bd3e-d4f7-45cc-8d1e-cbe6b5868728 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.692868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.693544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.693829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.694107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.694836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.696547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.700798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3239/6431] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:14.711247 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3193/6432] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:14.712951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.713089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.714029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.725179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767749c-cbfd-4768-be73-f49de04720b6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.731147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.732121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.732512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.732866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] PATH_INFO: `/v3/projects/017cba720ab34ba1b9e02ba206ae26aa/users/6ea7ea61f3144dd08f1c73fdae9064b0/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.752067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017cba720ab34ba1b9e02ba206ae26aa, user_id=6ea7ea61f3144dd08f1c73fdae9064b0, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.754682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4af9-abd4-4e8b-9cb4-784d243b0f00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.773654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3194/6433] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:14 2022] PUT /identity/v3/projects/017cba720ab34ba1b9e02ba206ae26aa/users/6ea7ea61f3144dd08f1c73fdae9064b0/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:14.783694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051be4c6-1f73-47bd-aac5-c6331984ab81 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.788392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.798555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.798555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.824399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] MFA Rules not processed for user `6ea7ea61f3144dd08f1c73fdae9064b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:14.825703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:14.840436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.841122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.841412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.842109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.906598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.908193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:14.909956 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3195/6434] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:14.914274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:14.920672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3240/6435] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:14.983457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79024c5-61d2-4fea-b3bd-0f1601dc5d42 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:14.989507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:14.990202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:14.990493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:14.990778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:14.991515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:14.993751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.023677 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3196/6436] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:14 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:15.028127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.041046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48454d25-9805-4159-9ae6-bdefb3c626f1 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:15.158901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264679-801e-421c-9766-53133a961c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:15.168131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264679-801e-421c-9766-53133a961c52 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.169788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264679-801e-421c-9766-53133a961c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.170196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264679-801e-421c-9766-53133a961c52 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.171079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63264679-801e-421c-9766-53133a961c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:15.177451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63264679-801e-421c-9766-53133a961c52 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.213985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3241/6437] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:15 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:15.215567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.244931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5cbf5-c033-4547-b9bf-6fe45be7b99a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:15.262450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:15.264440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.265014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.268232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.269255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:15.275727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.295990 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3197/6438] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:15.300555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264679-801e-421c-9766-53133a961c52 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.322339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264679-801e-421c-9766-53133a961c52 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:15.328949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:15.330769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.331110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.331473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] PATH_INFO: `/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5/users/19f91a37fbd3484084234ecbd5bf50d6/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.355465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05b9bc5844f4755b9fc5741e4f452b5, user_id=19f91a37fbd3484084234ecbd5bf50d6, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:15.359241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.423007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3242/6439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:15 2022] PUT /identity/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5/users/19f91a37fbd3484084234ecbd5bf50d6/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:15.424336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.444198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fabaa-8448-4198-b15c-45a641cb75ab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:15.551314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:15.551916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.552343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.552740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.553727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:15.555586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f56cb-f301-4db5-8f24-701024e3a77a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.571169 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3198/6440] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:15.573026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.592550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb6884-3d98-49b7-a7b4-ec8a624bf0db admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:15.605134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:15.610096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.610770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.611073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] PATH_INFO: `/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5/users/19f91a37fbd3484084234ecbd5bf50d6/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.625577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05b9bc5844f4755b9fc5741e4f452b5, user_id=19f91a37fbd3484084234ecbd5bf50d6, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:15.640753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:15.676590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3243/6441] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:15 2022] PUT /identity/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5/users/19f91a37fbd3484084234ecbd5bf50d6/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:15.690676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:15.691225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:15.691760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:15.752503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] MFA Rules not processed for user `19f91a37fbd3484084234ecbd5bf50d6`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:15.756501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:15.879802 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3199/6442] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:15.895061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:15.896790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:16.021775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a675b-321f-4660-9304-f4e7a20af0ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:16.037842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:16.038534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:16.038896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:16.039176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:16.055702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:16.058502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:16.071747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3244/6443] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:16.178368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:16.207789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f301-e81c-4b8f-8a25-b4fdedc6bb35 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:16.216365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:16.217534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:16.217534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:16.217994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:16.282700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:16.284138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5acbbb-87a5-43e2-b0e1-08b759f0576f service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:16.294820 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3200/6444] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:20.359617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:20.473854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1751-135d-4b42-b94f-b2f985891f69 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:20.480233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:20.481324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:20.481614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:20.482333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] PATH_INFO: `/v3/users/77639746ed634064b00001f0a78bdcfe` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:20.483601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77639746ed634064b00001f0a78bdcfe)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:20.485949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:20.558795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77639746ed634064b00001f0a78bdcfe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:20.574752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77639746ed634064b00001f0a78bdcfe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:20.575417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77639746ed634064b00001f0a78bdcfe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:20.576411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77639746ed634064b00001f0a78bdcfe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:20.589426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77639746ed634064b00001f0a78bdcfe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:20.648404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3245/6445] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:20 2022] DELETE /identity/v3/users/77639746ed634064b00001f0a78bdcfe => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:20.654579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:20.655092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:20.655349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:20.685499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:20.688057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:20.782237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3201/6446] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:20.795842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:20.797455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:20.908196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fbd9-5c7f-4961-84d1-395660f15c78 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:20.913392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:20.914123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:20.914469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:20.914857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:20.931669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:20.933898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357341b6-d595-4832-b7da-0a5f4e2ec66a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:20.947277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3246/6447] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:21.397199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:21.408629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:21.438005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75482-608d-4e20-8f6b-2a8ea7f00601 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:21.454095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:21.454996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:21.455283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:21.455565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] PATH_INFO: `/v3/projects/f59aaf22978e4c75a101f51d2081db70` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:21.462100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59aaf22978e4c75a101f51d2081db70)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:21.463931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:21.585201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59aaf22978e4c75a101f51d2081db70', 'request_id': 'req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:21.597724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59aaf22978e4c75a101f51d2081db70', 'request_id': 'req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:21.606255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59aaf22978e4c75a101f51d2081db70', 'request_id': 'req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:21.631011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] The token cache is being invalidate because project f59aaf22978e4c75a101f51d2081db70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:21.631447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:21.632214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-68ddb9b2-6bb6-46f5-a317-f46fb89a6478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:21.645563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3202/6448] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:21 2022] DELETE /identity/v3/projects/f59aaf22978e4c75a101f51d2081db70 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:21.652390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:21.653441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:21.653886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:21.684495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:21.685858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:21.800198 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3247/6449] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:21.809289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:21.809819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:21.809918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:21.832246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:21.833498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:21.844553 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3203/6450] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:21.848886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:21.859447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623d349-2ce9-4b32-980d-461cc16225c8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:21.864099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:21.864809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:21.865096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:21.865374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:21.866127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:21.866434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:21.868263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:21.880807 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3248/6451] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:21.885713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:21.896118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516777d-5b64-46c3-81ec-295858d8884e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:21.908821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:21.909677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:21.910200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:21.910582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:21.911483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:21.913744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:21.952393 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3204/6452] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:21.956679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:21.970274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5782-a7ca-4a8e-b298-73eebfeca6b5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.066886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.067882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.070461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.070461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.075953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.078138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.117401 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3249/6453] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:21 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:22.121647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.133533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28429f73-67b1-4a6e-9c4e-7e6895a121c8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.139500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.140218 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.140492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.140783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.141568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.143970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337841-e9fa-4edd-b25d-e1fb0aab9b29 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.161983 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3205/6454] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:22.167598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.200993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fec9c-b333-4c15-8351-f5386af1c1f3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.202562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf1be8-5753-41f1-9a58-11bd13b1c7b4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.202933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf1be8-5753-41f1-9a58-11bd13b1c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.203148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf1be8-5753-41f1-9a58-11bd13b1c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.214834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.215918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.216407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.217109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.218024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.219635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.233182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-48bf1be8-5753-41f1-9a58-11bd13b1c7b4 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.234530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48bf1be8-5753-41f1-9a58-11bd13b1c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.261657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3250/6455] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:22.266084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.304609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee9ce0-3083-455d-8436-c4cb47209b27 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.325877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.327041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.327552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.328305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] PATH_INFO: `/v3/projects/9106d7517e6a43d9bf672506311f07a7/users/8463bc2767c84376bbd3c881573afba7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.359352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9106d7517e6a43d9bf672506311f07a7, user_id=8463bc2767c84376bbd3c881573afba7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.362968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4185-51be-49fd-8407-619c01ff89ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.398092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3251/6456] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:22 2022] PUT /identity/v3/projects/9106d7517e6a43d9bf672506311f07a7/users/8463bc2767c84376bbd3c881573afba7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:22.408491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.408845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.409075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.417852 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3206/6457] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:22.451786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] MFA Rules not processed for user `8463bc2767c84376bbd3c881573afba7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.462909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.473638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b777-8ece-48c4-b20e-d57cf3230ba8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.476837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b777-8ece-48c4-b20e-d57cf3230ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.478037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b777-8ece-48c4-b20e-d57cf3230ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.533623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-92c4b777-8ece-48c4-b20e-d57cf3230ba8 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.536586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-92c4b777-8ece-48c4-b20e-d57cf3230ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.580634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3252/6458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:22.588078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.624796 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3207/6459] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:22.651125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d297-d206-4da7-b7f6-0b548deaa7b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.651497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d297-d206-4da7-b7f6-0b548deaa7b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.651844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d297-d206-4da7-b7f6-0b548deaa7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.676178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6542d297-d206-4da7-b7f6-0b548deaa7b7 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.677669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6542d297-d206-4da7-b7f6-0b548deaa7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.695078 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3208/6460] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:22.714864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.715463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.715808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.726375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45348c02-22c3-4a78-8e48-0348d8e46e4f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.732440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.733143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.733428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.733712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.734394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.736297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8a259-7324-4159-a530-a1d451008c0f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.749903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.751169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.760819 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3209/6461] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:22.767811 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3253/6462] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:22.772014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.783958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd682e4-55f6-4e02-b419-3bedc50a8495 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.798325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.798615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.798965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.843341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] MFA Rules not processed for user `b630191a1dd14563a904c81c462bb800`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:22.844612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:22.869043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.869729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.870019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.870299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.870989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.873739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.904133 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3210/6463] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:22.910154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.925987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11581-9ee6-4059-9982-4399a6ff51e8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.933352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.934360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.934635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.935197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.936170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.938265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:22.946533 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3254/6464] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:22.956848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3211/6465] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:22.958944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:22.979780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc13cf-d130-4a99-b976-ee3e4c77598d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:22.986235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:22.987186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:22.988122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:22.988323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:22.989173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:22.990966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9d1f-7a72-4e97-9668-0a6f827ba03c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.004344 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3255/6466] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:23.010177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.030439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9175-9185-4747-bddd-be30d6f67109 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.036125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.037423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.037869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.038755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] PATH_INFO: `/v3/projects/322bc757323e4f909fd0087a466b655d/users/0b8259b32f3a4feab42bdfd05d039e88/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.064388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322bc757323e4f909fd0087a466b655d, user_id=0b8259b32f3a4feab42bdfd05d039e88, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.067654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.092607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3212/6467] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:23 2022] PUT /identity/v3/projects/322bc757323e4f909fd0087a466b655d/users/0b8259b32f3a4feab42bdfd05d039e88/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:23.103515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.104318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.105006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.148027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] MFA Rules not processed for user `0b8259b32f3a4feab42bdfd05d039e88`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:23.150244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:23.311759 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3256/6468] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:23.312909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.421485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47b189-b7c8-4650-bd27-f968bdbbb6c3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.429474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.430439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.431531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.432426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.433372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.435556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.496556 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3213/6469] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:23 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:23.497760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.513354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2148e-de91-4d84-a60e-bc94cbc2fcd4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.606917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.606917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.608141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.608471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.609774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.613053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.640046 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3257/6470] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:23 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:23.644085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.660736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4ad2-e3b4-46c1-b938-8a76c2ddc463 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.666618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.667648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.668039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.668427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.669323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.671098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.684241 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3214/6471] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:23.689011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.701285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa39d-228d-4cda-9c2e-4f45def7bbd9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.713961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.715019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.715417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.715941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] PATH_INFO: `/v3/projects/e8e3a60cafc6494e900d69cc3222542a/users/796452897c7a4241b15047fe99562596/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.734295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e3a60cafc6494e900d69cc3222542a, user_id=796452897c7a4241b15047fe99562596, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.737269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.760222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3258/6472] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:23 2022] PUT /identity/v3/projects/e8e3a60cafc6494e900d69cc3222542a/users/796452897c7a4241b15047fe99562596/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:23.764891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.776571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77de55-7aef-4793-99e8-846d233ac2b9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.849760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.850788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.851899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.852444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.853607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.859900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fd13e-a366-40dc-94a1-1bb2fe89dede admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.874805 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3215/6473] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:23.876120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:23.891632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c04e3-7144-4c4a-bc30-3279b236df69 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:23.901532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:23.903054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.903054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.903488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] PATH_INFO: `/v3/projects/e8e3a60cafc6494e900d69cc3222542a/users/796452897c7a4241b15047fe99562596/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.908009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e3a60cafc6494e900d69cc3222542a, user_id=796452897c7a4241b15047fe99562596, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:23.912267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:23.929202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3259/6474] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:23 2022] PUT /identity/v3/projects/e8e3a60cafc6494e900d69cc3222542a/users/796452897c7a4241b15047fe99562596/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:23.941232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5164-1eef-47e2-b359-00d00b59bad1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:23.941670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5164-1eef-47e2-b359-00d00b59bad1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:23.941980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc5164-1eef-47e2-b359-00d00b59bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:23.972854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38cc5164-1eef-47e2-b359-00d00b59bad1 None None] MFA Rules not processed for user `796452897c7a4241b15047fe99562596`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:23.974071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38cc5164-1eef-47e2-b359-00d00b59bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:24.074981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3216/6475] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:24.084982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:24.086883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:24.159882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f8e-734d-4c4d-bb2d-886a14f1d531 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:24.164263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:24.165512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:24.165801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:24.166080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:24.256022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:24.257587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:24.270990 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3260/6476] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:24.453558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:24.454096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:24.454525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:24.477353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] MFA Rules not processed for user `d7ebf8694d674ee38bb5f58a3687a415`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:24.479179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:24.549142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3217/6477] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:26.004080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:26.005697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:26.031086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2847-20bf-41bc-ba21-28cf9d227bab service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:26.035498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:26.036212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:26.036599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:26.037011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:26.149880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:26.151668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:26.182788 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3261/6478] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:27.003940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:27.022988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec17f1f-ae27-4b76-a40c-930aafb046e6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:27.029006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:27.031955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:27.032179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:27.032648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:27.052930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:27.055006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:27.072614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3218/6479] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:28.811623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:28.813160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:28.889165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c870021-7c4f-408f-bde9-a755d4c948d9 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:28.898299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:28.899748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:28.900214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:28.900664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] PATH_INFO: `/v3/users/b630191a1dd14563a904c81c462bb800` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:28.902126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b630191a1dd14563a904c81c462bb800)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:28.904228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:28.956969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b630191a1dd14563a904c81c462bb800'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:28.968860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b630191a1dd14563a904c81c462bb800'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:28.969504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b630191a1dd14563a904c81c462bb800'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:28.970102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b630191a1dd14563a904c81c462bb800'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:28.979375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1ebb5a60-3008-42a3-a5ea-73f684e7a0ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b630191a1dd14563a904c81c462bb800'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:28.997742 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3262/6480] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:28 2022] DELETE /identity/v3/users/b630191a1dd14563a904c81c462bb800 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:29.331824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:29.350112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257168-4e43-45a3-8056-98516db53f42 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:29.456556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:29.457489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:29.457717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:29.457995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] PATH_INFO: `/v3/projects/dfe4735870c44412b279a096ae5dd79c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:29.459282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe4735870c44412b279a096ae5dd79c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:29.461274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:29.519400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe4735870c44412b279a096ae5dd79c', 'request_id': 'req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:29.528306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe4735870c44412b279a096ae5dd79c', 'request_id': 'req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:29.535492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe4735870c44412b279a096ae5dd79c', 'request_id': 'req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:29.553087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] The token cache is being invalidate because project dfe4735870c44412b279a096ae5dd79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:29.553270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:29.554753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-86c5a4e6-386a-41fa-8d6e-772f9f27e2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:29.557223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3219/6481] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:29 2022] DELETE /identity/v3/projects/dfe4735870c44412b279a096ae5dd79c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:29.563336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:29.563700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:29.564079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:29.601577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:29.602982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:29.734718 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3263/6482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:29.742638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:29.743706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:29.744157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:29.766698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:29.768956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:29.782585 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3220/6483] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:29.787015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:29.801912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682a2b-e43f-47b5-92eb-7d93d32db1ab None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:29.821742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:29.822440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:29.824059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:29.824583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:29.825480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:29.825961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:29.828948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:29.844313 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3264/6484] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:29.849585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:29.860893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbbe32-9e81-4e88-ac6b-778f524b00b8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:29.876927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:29.879374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:29.879926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:29.880408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:29.881469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:29.884179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:29.921791 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3221/6485] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:29 2022] POST /identity/v3/projects => generated 361 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:29.925296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:29.937249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819cc3-47c2-4305-ba4d-4fd49ccc14a8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.012807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.013496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.013785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.014145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.014811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.017023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.047293 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3265/6486] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:29 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:30.051031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:30.068398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee745-16c0-4346-8234-0b28b88d3302 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.082335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.083549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.084238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.084808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.086782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.088932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.108326 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3222/6487] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:30.109180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:30.125396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8ff6-1fbe-4124-bd3b-f1fb050f1b06 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.130689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.131756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.132847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.132847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.133658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.135026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c2de-4215-45e6-96f0-ede443414fba admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.146487 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3266/6488] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:30.151232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:30.167126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adf75e-a13f-41a6-8539-c345ea73465c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.173154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.174068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.174351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.174879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] PATH_INFO: `/v3/projects/c43a4de2259f43e3a929be6cac6b59e1/users/a25edca69fe14aaf9e7ca61daa50ee20/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.203940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43a4de2259f43e3a929be6cac6b59e1, user_id=a25edca69fe14aaf9e7ca61daa50ee20, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.207171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.230160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3223/6489] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:30 2022] PUT /identity/v3/projects/c43a4de2259f43e3a929be6cac6b59e1/users/a25edca69fe14aaf9e7ca61daa50ee20/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:30.243392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.243998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.244476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.298378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] MFA Rules not processed for user `a25edca69fe14aaf9e7ca61daa50ee20`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:30.300414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:30.408632 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3267/6490] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:30.418869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:30.421978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:30.547183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cf96-4c9a-4205-b14f-c928cd71b560 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.554648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.558135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.558655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.558965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.573371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.575640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb5321-8f3c-4c73-a477-0d0545e4d957 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.591043 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3224/6491] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:30.657756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:30.803640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae123f-0738-4c95-a51d-2ff2e4dc45ee None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:30.819258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:30.820193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.821862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.823862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] PATH_INFO: `/v3/users/a25edca69fe14aaf9e7ca61daa50ee20` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.832214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25edca69fe14aaf9e7ca61daa50ee20)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:30.834632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:30.922573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25edca69fe14aaf9e7ca61daa50ee20'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:30.932390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25edca69fe14aaf9e7ca61daa50ee20'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:30.933525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25edca69fe14aaf9e7ca61daa50ee20'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:30.934485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25edca69fe14aaf9e7ca61daa50ee20'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:30.943172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25edca69fe14aaf9e7ca61daa50ee20'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:30.964956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3268/6492] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:30 2022] DELETE /identity/v3/users/a25edca69fe14aaf9e7ca61daa50ee20 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:30.969684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:30.970307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:30.970857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:30.990327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:30.992152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:31.089077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3225/6493] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:31.111514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:31.113333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:31.236760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:31.238271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:31.256296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf74d-8468-4983-8f4c-55a648cdb9a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:31.257697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0158d4e-ac7c-44cc-ae54-36046bb975c2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:31.273439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:31.275777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:31.276070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:31.276345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] PATH_INFO: `/v3/users/8463bc2767c84376bbd3c881573afba7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:31.277769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:31.278631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:31.279091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:31.279524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:31.283500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8463bc2767c84376bbd3c881573afba7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:31.285675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:31.296922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:31.298676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84553a27-61c4-4f20-a48f-164f19655b2d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:31.315230 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3269/6494] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:31.381594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8463bc2767c84376bbd3c881573afba7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:31.406767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8463bc2767c84376bbd3c881573afba7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:31.420260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8463bc2767c84376bbd3c881573afba7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:31.435276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8463bc2767c84376bbd3c881573afba7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:31.464539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8463bc2767c84376bbd3c881573afba7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:31.476828 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3226/6495] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:31 2022] DELETE /identity/v3/users/8463bc2767c84376bbd3c881573afba7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:31.479858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:31.480170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:31.480610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:31.516813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:31.519500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:31.642481 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3270/6496] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:31.666768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:31.671546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:31.790290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312715-96ce-4a87-b425-331d633d5be7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:31.794942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:31.796432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:31.797121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:31.797626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:31.810125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:31.811967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c061-643b-4bb5-8398-33a1aadb47a7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:31.837928 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3227/6497] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:32.081753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.083300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.106172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6fc4-d84f-49d9-94f2-33724876f08d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.116214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.117139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.117431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.118247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] PATH_INFO: `/v3/projects/c43a4de2259f43e3a929be6cac6b59e1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.122225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43a4de2259f43e3a929be6cac6b59e1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.124260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.224914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43a4de2259f43e3a929be6cac6b59e1', 'request_id': 'req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.240597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43a4de2259f43e3a929be6cac6b59e1', 'request_id': 'req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.255406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43a4de2259f43e3a929be6cac6b59e1', 'request_id': 'req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.274229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] The token cache is being invalidate because project c43a4de2259f43e3a929be6cac6b59e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:32.274689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.275534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b1e96eed-2b96-427c-85f8-cc4cc1da3fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.277512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3271/6498] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:32 2022] DELETE /identity/v3/projects/c43a4de2259f43e3a929be6cac6b59e1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:32.283570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.284030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.284689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.307199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:32.309980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.484726 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3228/6499] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:32.493586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.493882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.494172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.507466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.509184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.528157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c5a5-45f7-4858-a88a-4ac24508b80e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.534167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.535411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.535538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:32.537350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.541528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.542059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] PATH_INFO: `/v3/projects/9106d7517e6a43d9bf672506311f07a7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.545372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9106d7517e6a43d9bf672506311f07a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.548389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.561009 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3272/6500] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:32.567270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.583016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405398e-4176-430b-8e77-162c3ab85ddb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.597757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.598486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.598788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.599028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.599757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:32.600140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.601736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.628611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9106d7517e6a43d9bf672506311f07a7', 'request_id': 'req-39bb62ec-23e2-4985-8668-5de0b841e62c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.629118 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3273/6501] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:32.630070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.640582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a5421-8a3e-4756-b846-5a409450ef7f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.641562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9106d7517e6a43d9bf672506311f07a7', 'request_id': 'req-39bb62ec-23e2-4985-8668-5de0b841e62c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.651765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9106d7517e6a43d9bf672506311f07a7', 'request_id': 'req-39bb62ec-23e2-4985-8668-5de0b841e62c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.674495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] The token cache is being invalidate because project 9106d7517e6a43d9bf672506311f07a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:32.674794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.676518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.680235 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3229/6502] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:32 2022] DELETE /identity/v3/projects/9106d7517e6a43d9bf672506311f07a7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:32.685431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.686931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.733839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.734643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.735004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.735355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.736200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.739141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.780084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3274/6503] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:32 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:32.782021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.785846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:32.813624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb62ec-23e2-4985-8668-5de0b841e62c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.876605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8936-9a32-44b5-8565-73d190435feb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.881757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.882045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.882678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.882810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.882957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.883056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.883322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.883554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] PATH_INFO: `/v3/users/0b8259b32f3a4feab42bdfd05d039e88` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.883993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.885270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8259b32f3a4feab42bdfd05d039e88)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.886003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.887863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.917092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3275/6504] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:32 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:32.921735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.933567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a4608-6cd2-4adc-a8a8-760e58aca195 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.939650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.940671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.940965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.941247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.942146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.943998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.955665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8259b32f3a4feab42bdfd05d039e88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.958402 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3276/6505] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:32.963022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:32.973642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9991-32fc-4ec3-991a-4e59c7013204 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:32.973830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8259b32f3a4feab42bdfd05d039e88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.974758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8259b32f3a4feab42bdfd05d039e88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.979355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:32.980101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:32.980392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:32.980819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:32.981810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:32.983738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:32.987066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8259b32f3a4feab42bdfd05d039e88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:32.997218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3277/6506] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:32.998523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f023f942-2534-4270-a8fe-f158f249136b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8259b32f3a4feab42bdfd05d039e88'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.001386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:33.003695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:33.010030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3230/6507] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:32 2022] DELETE /identity/v3/users/0b8259b32f3a4feab42bdfd05d039e88 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:33.019286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c261fb-ef1a-428e-8fdb-13a4dc91db18 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:33.105930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:33.106869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:33.107161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:33.107446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] PATH_INFO: `/v3/projects/5ae86e9285c945628bacc57d4a745c3a/users/5f2d73016d7e493cb363cd993675b7ca/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:33.124693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae86e9285c945628bacc57d4a745c3a, user_id=5f2d73016d7e493cb363cd993675b7ca, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:33.127796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:33.143044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3278/6508] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:33 2022] PUT /identity/v3/projects/5ae86e9285c945628bacc57d4a745c3a/users/5f2d73016d7e493cb363cd993675b7ca/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:33.153447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467932-2a43-495d-8727-8ac865b3442f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:33.153874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467932-2a43-495d-8727-8ac865b3442f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:33.154264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de467932-2a43-495d-8727-8ac865b3442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:33.196019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-de467932-2a43-495d-8727-8ac865b3442f None None] MFA Rules not processed for user `5f2d73016d7e493cb363cd993675b7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:33.197349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de467932-2a43-495d-8727-8ac865b3442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:33.267705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3231/6509] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:33.279781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:33.281542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:33.376090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e534a-f80d-4594-812b-b032fa3f1918 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:33.383340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:33.384494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:33.384494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:33.385503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de467932-2a43-495d-8727-8ac865b3442f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:33.385632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:33.386997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de467932-2a43-495d-8727-8ac865b3442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:33.397790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:33.400966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:33.446872 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3279/6510] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:33.499569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de467932-2a43-495d-8727-8ac865b3442f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:33.510537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:33.512259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:33.512663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:33.513039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] PATH_INFO: `/v3/projects/322bc757323e4f909fd0087a466b655d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:33.515244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322bc757323e4f909fd0087a466b655d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:33.517673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:33.583989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322bc757323e4f909fd0087a466b655d', 'request_id': 'req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.594084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322bc757323e4f909fd0087a466b655d', 'request_id': 'req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.608025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322bc757323e4f909fd0087a466b655d', 'request_id': 'req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.635982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] The token cache is being invalidate because project 322bc757323e4f909fd0087a466b655d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:33.636280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.638050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.643858 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3232/6511] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:33 2022] DELETE /identity/v3/projects/322bc757323e4f909fd0087a466b655d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:33.649831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:33.677459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8dd48-d865-48eb-aed5-70a44a065da5 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:33.833834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:33.834872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:33.836139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:33.837001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] PATH_INFO: `/v3/users/796452897c7a4241b15047fe99562596` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:33.839606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796452897c7a4241b15047fe99562596)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:33.842659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:33.946992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796452897c7a4241b15047fe99562596'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.970321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796452897c7a4241b15047fe99562596'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.970321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796452897c7a4241b15047fe99562596'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.970321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796452897c7a4241b15047fe99562596'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:33.996378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3551ccd-5c6f-4d00-b726-680dbb2bfb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796452897c7a4241b15047fe99562596'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.032586 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3280/6512] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:33 2022] DELETE /identity/v3/users/796452897c7a4241b15047fe99562596 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:34.080080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:34.081699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:34.110590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125cc50-ff9f-4d3e-bb2d-5912ea6f46d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:34.216374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:34.219875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.220939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.221303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] PATH_INFO: `/v3/users/6ea7ea61f3144dd08f1c73fdae9064b0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.225359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea7ea61f3144dd08f1c73fdae9064b0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:34.230151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:34.357106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea7ea61f3144dd08f1c73fdae9064b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.384650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea7ea61f3144dd08f1c73fdae9064b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.385460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea7ea61f3144dd08f1c73fdae9064b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.395842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea7ea61f3144dd08f1c73fdae9064b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.426577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea7ea61f3144dd08f1c73fdae9064b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.444118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3233/6513] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:34 2022] DELETE /identity/v3/users/6ea7ea61f3144dd08f1c73fdae9064b0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:34.452632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.453140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.456489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.482601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:34.484051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:34.573746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3281/6514] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:34.585989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:34.588666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:34.679244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:34.682734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:34.726609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619450de-d3d4-4e3b-a78b-ec8b9cbe0749 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:34.729016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ec05-3bf6-40ae-8b6f-1b0ae1a50d6c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:34.745384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:34.745778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:34.746671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.746953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.747227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] PATH_INFO: `/v3/projects/e8e3a60cafc6494e900d69cc3222542a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.749164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.749164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.749575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.750901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e3a60cafc6494e900d69cc3222542a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:34.752900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:34.760516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:34.762628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e651d3-fe2f-456f-9476-7eff0d93c562 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:34.782217 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3234/6515] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:34.829547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e3a60cafc6494e900d69cc3222542a', 'request_id': 'req-de040cbb-5198-433c-9758-602fd6513dce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.835777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e3a60cafc6494e900d69cc3222542a', 'request_id': 'req-de040cbb-5198-433c-9758-602fd6513dce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.846574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e3a60cafc6494e900d69cc3222542a', 'request_id': 'req-de040cbb-5198-433c-9758-602fd6513dce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.865383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] The token cache is being invalidate because project e8e3a60cafc6494e900d69cc3222542a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:34.866110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.867000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-de040cbb-5198-433c-9758-602fd6513dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:34.870555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3282/6516] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:34 2022] DELETE /identity/v3/projects/e8e3a60cafc6494e900d69cc3222542a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:34.875644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.876340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.876663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.895891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:34.897175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:34.965652 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3235/6517] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:34.975426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:34.975914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:34.976424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:34.997453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:34.998816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:35.011111 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3283/6518] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:35.012474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.022804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68f5e8-f109-4c7c-8967-028c93e1f41f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.027884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.028610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.028898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.029177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.029918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:35.030229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.031850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.044674 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3236/6519] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:35.049251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.059833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb94a20-4d4d-411c-a7cc-97e044b65d45 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.064612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.065318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.065604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.066094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.066798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.068799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.101089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3284/6520] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:35.106739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.119648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef95a55-5224-4d6a-983e-ec085fa461a3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.188055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.188774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.189060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.189333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.190045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.191974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.219340 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3237/6521] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:35 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:35.223222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.240163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc95a7-03fd-412f-b86c-e09bcab486b5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.249547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.250883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.251245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.251592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.252679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.254823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.269293 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3285/6522] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:35.274008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.287241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dcdb4-27d7-4afc-87f5-9f1927a6b7c3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.294035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.295008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.295524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.296103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.297214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.299406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3d2b2-7098-4858-9890-3f8ad542b326 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.328607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3238/6523] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:35.332307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.346159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2565a-d7c7-4b01-bde3-9aaa928e11d0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.358405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.359760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.360234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.361157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] PATH_INFO: `/v3/projects/3265dbc2dbab442dbb562ef4a3652650/users/b80790d4e9484dfd92f9ad7e840637c3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.382762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3265dbc2dbab442dbb562ef4a3652650, user_id=b80790d4e9484dfd92f9ad7e840637c3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.386569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.420492 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3286/6524] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:35 2022] PUT /identity/v3/projects/3265dbc2dbab442dbb562ef4a3652650/users/b80790d4e9484dfd92f9ad7e840637c3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:35.518031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.518623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.519000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.553928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] MFA Rules not processed for user `b80790d4e9484dfd92f9ad7e840637c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:35.556040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:35.655284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3239/6525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:35.667648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.670042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:35.751861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:35.754489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:35.769316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b994005-aa02-40ea-99fb-9b5e66a2af3c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.775383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.776324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.776717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.777068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.795732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.799023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:35.817308 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3287/6526] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:35.874892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee6c0-ac5b-4ec0-9012-86645a6b9cd8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:35.884190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:35.885658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:35.885868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:35.886183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] PATH_INFO: `/v3/projects/017cba720ab34ba1b9e02ba206ae26aa` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:35.887963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017cba720ab34ba1b9e02ba206ae26aa)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:35.891565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:36.007036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017cba720ab34ba1b9e02ba206ae26aa', 'request_id': 'req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.016704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017cba720ab34ba1b9e02ba206ae26aa', 'request_id': 'req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.025358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017cba720ab34ba1b9e02ba206ae26aa', 'request_id': 'req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.052621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] The token cache is being invalidate because project 017cba720ab34ba1b9e02ba206ae26aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:36.052946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.053805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.055966 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3240/6527] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:35 2022] DELETE /identity/v3/projects/017cba720ab34ba1b9e02ba206ae26aa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:36.060293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:36.075146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6028-6ac7-482d-b340-63accc958eb5 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:36.202730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:36.203968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:36.205599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:36.207255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] PATH_INFO: `/v3/users/19f91a37fbd3484084234ecbd5bf50d6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:36.209586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f91a37fbd3484084234ecbd5bf50d6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:36.216249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:36.354589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f91a37fbd3484084234ecbd5bf50d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.364295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f91a37fbd3484084234ecbd5bf50d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.365107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f91a37fbd3484084234ecbd5bf50d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.365847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f91a37fbd3484084234ecbd5bf50d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.388427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0eb607d8-09f5-419e-9a63-c019c1df2309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f91a37fbd3484084234ecbd5bf50d6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.424206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3288/6528] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:36 2022] DELETE /identity/v3/users/19f91a37fbd3484084234ecbd5bf50d6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:36.512657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:36.514410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:36.534281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d8a5-ffcc-4b18-9b28-d0bf870cc253 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:36.654213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:36.655239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:36.655595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:36.656191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] PATH_INFO: `/v3/users/5f2d73016d7e493cb363cd993675b7ca` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:36.662792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2d73016d7e493cb363cd993675b7ca)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:36.664994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:36.766179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2d73016d7e493cb363cd993675b7ca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.794113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2d73016d7e493cb363cd993675b7ca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.799339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2d73016d7e493cb363cd993675b7ca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.811702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2d73016d7e493cb363cd993675b7ca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.821337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2d73016d7e493cb363cd993675b7ca'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:36.830816 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3241/6529] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:36 2022] DELETE /identity/v3/users/5f2d73016d7e493cb363cd993675b7ca => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:36.836071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:36.837085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:36.837847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:36.866366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:36.868869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:36.924260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:36.925775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:36.959932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3289/6530] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:36.970680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:36.975815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:37.026508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca8891-b73e-4327-9c8d-2789b7f23b91 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.032240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.033136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.033551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.033835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] PATH_INFO: `/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.035949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05b9bc5844f4755b9fc5741e4f452b5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.039103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.067160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5b1b-e1d4-4ce0-9e68-8f3bdc8a1bd0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.071146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.072011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.072348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.072661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.082378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.083826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999dcea-f0a0-40b3-8265-c12d4a2fad07 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.099061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3290/6531] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:37.124416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05b9bc5844f4755b9fc5741e4f452b5', 'request_id': 'req-4bed867a-9db2-4379-a61a-38d571c3ea17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.131674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05b9bc5844f4755b9fc5741e4f452b5', 'request_id': 'req-4bed867a-9db2-4379-a61a-38d571c3ea17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.140999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05b9bc5844f4755b9fc5741e4f452b5', 'request_id': 'req-4bed867a-9db2-4379-a61a-38d571c3ea17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.167797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] The token cache is being invalidate because project f05b9bc5844f4755b9fc5741e4f452b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:37.168278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.168802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4bed867a-9db2-4379-a61a-38d571c3ea17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.170937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3242/6532] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:36 2022] DELETE /identity/v3/projects/f05b9bc5844f4755b9fc5741e4f452b5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:37.178511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.179058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.179174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.214182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:37.215457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:37.301037 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3291/6533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:37.310931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165e3a-73e0-489b-8e0a-389c2d199397 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.311413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165e3a-73e0-489b-8e0a-389c2d199397 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.311864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165e3a-73e0-489b-8e0a-389c2d199397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.346568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b2165e3a-73e0-489b-8e0a-389c2d199397 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:37.348112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b2165e3a-73e0-489b-8e0a-389c2d199397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:37.365066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3243/6534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:37.366315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.394394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.394766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.395049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.411558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41e3e-e49e-4707-afe6-26a9ef0a2df8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.424278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.424999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.425279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.425551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.426273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:37.426580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.432284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.446447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] MFA Rules not processed for user `b80790d4e9484dfd92f9ad7e840637c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:37.447959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:37.478356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3292/6535] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:37.485428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.520935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af31d8-f6bb-435c-8681-5739097ded7d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.535073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.535678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.535959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.536250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.539109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.542449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.587037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3244/6536] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:37.605628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3293/6537] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:37.609926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.629673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29edc6-7154-4fc6-85c8-0b2b8614ce2c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.731209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.731823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.732132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.732420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.733724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.736365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.769523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.770987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3245/6538] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:37.771847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:37.771970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.783367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70a1b-0d92-4ab3-ad51-248747d9e6d4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.788155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.788868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.789170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.789488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.790228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.792019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d9d3-b49e-4856-b230-2e1379c1672a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.792156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.808800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.809687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.809973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.810255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] PATH_INFO: `/v3/projects/5ae86e9285c945628bacc57d4a745c3a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.811621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae86e9285c945628bacc57d4a745c3a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.813800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.814321 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3246/6539] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:37.819332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.835033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd03f0-8ab7-46a5-bbc6-94b9ae9d35df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.853053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:37.853958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.856408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.856790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.857612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:37.859251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:37.887486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3247/6540] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:37.891092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae86e9285c945628bacc57d4a745c3a', 'request_id': 'req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.891665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:37.899477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae86e9285c945628bacc57d4a745c3a', 'request_id': 'req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.910697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce99b-036f-43c2-8f36-bfb9e834d7bd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:37.915124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae86e9285c945628bacc57d4a745c3a', 'request_id': 'req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.929600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] The token cache is being invalidate because project 5ae86e9285c945628bacc57d4a745c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:37.930861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.932026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-051a72e1-f69a-4f2a-aab3-0ecc4510bcb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:37.934164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3294/6541] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:37 2022] DELETE /identity/v3/projects/5ae86e9285c945628bacc57d4a745c3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:37.938817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43ec3-79c0-4369-b388-75a48e39e284 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:37.939114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43ec3-79c0-4369-b388-75a48e39e284 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:37.939386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef43ec3-79c0-4369-b388-75a48e39e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:37.978799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0ef43ec3-79c0-4369-b388-75a48e39e284 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:37.980034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0ef43ec3-79c0-4369-b388-75a48e39e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:38.016882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.018749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.019189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.019525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] PATH_INFO: `/v3/projects/908dce322fe941d296060ecec6ce8630/users/1ddb56a23a8043d681648180f65e038d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.053385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908dce322fe941d296060ecec6ce8630, user_id=1ddb56a23a8043d681648180f65e038d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.064537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07754c-7bb2-47fe-8259-9ddc878ccca9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.110677 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3248/6542] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:37 2022] PUT /identity/v3/projects/908dce322fe941d296060ecec6ce8630/users/1ddb56a23a8043d681648180f65e038d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:38.112757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.113127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.114227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.149451 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3295/6543] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:38.152380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.152670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.152959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.163106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] MFA Rules not processed for user `1ddb56a23a8043d681648180f65e038d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:38.165105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:38.193265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:38.194510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:38.322750 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3249/6544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:38.329398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.331829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:38.336804 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3296/6545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:38.340763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.363507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b662-6df7-43f4-b54d-36dcfe9dab5e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.366997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d179c96-3661-4dc6-9e05-a3ad827f8b61 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.373853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.375102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.376815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.381758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.388705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.397797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.397797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.397797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.398078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:38.398078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.401533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.403469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.405691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.452275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3297/6546] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:38.452275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.479087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917565-2ca1-47d4-b525-429747a3ffa5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.500180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.500523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3250/6547] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:38.503151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.505435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.505910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.506384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.510092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.515613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.579764 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3298/6548] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:38.582300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.657508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96422f-c507-4a5a-a36f-6d4bc8b1ebe9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.708514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f88d0-0284-4abc-b969-64af7420ba83 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.716867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.717490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.717782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.718063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.718801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.722514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.776484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3299/6549] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:38.780220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.803900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cd2b5-4035-41e6-8499-eca6491e27c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.813562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.819840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.820015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.823438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.824021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.826658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.830321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.831111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.831378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.831680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.832513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.834143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.878701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3300/6550] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:38.879702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.891589 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3251/6551] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:38 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:38.895263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.897871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40035bd-5757-4149-bee6-6deae65412bb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.912733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764ead-d89b-4fa2-a719-8eb95310bac0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.919695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.920775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.921214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.921768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.922654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.924882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.934983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.935673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.935959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.936259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.936994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:38.942154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:38.957487 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3301/6552] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:38.958480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.974513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3252/6553] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:38.975842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc696d-95a0-4094-847a-3b8e04e5f1ad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:38.977504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:38.991198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:38.992117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:38.992448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:38.992765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] PATH_INFO: `/v3/projects/acf941ed89b64dfe81d4c2817a620861/users/7b11130fbc2c40bfbf9c86c6a39e64c8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:38.993792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf6c-9bd5-405b-8378-80fa50e9c141 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.007696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.009230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.009523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.009798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] PATH_INFO: `/v3/projects/920057bffeca4ee78d0fd6a35928219b/users/be35f92d0ece4b9ea0e14da7a0d8c79d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.026819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf941ed89b64dfe81d4c2817a620861, user_id=7b11130fbc2c40bfbf9c86c6a39e64c8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.029619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32982c-5798-4428-a718-f152dfdc2602 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.040109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920057bffeca4ee78d0fd6a35928219b, user_id=be35f92d0ece4b9ea0e14da7a0d8c79d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.049009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.055687 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3302/6554] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:38 2022] PUT /identity/v3/projects/acf941ed89b64dfe81d4c2817a620861/users/7b11130fbc2c40bfbf9c86c6a39e64c8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:39.072104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.072479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.072784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.089019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3253/6555] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:38 2022] PUT /identity/v3/projects/920057bffeca4ee78d0fd6a35928219b/users/be35f92d0ece4b9ea0e14da7a0d8c79d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:39.090126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.115985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] MFA Rules not processed for user `7b11130fbc2c40bfbf9c86c6a39e64c8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:39.118370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:39.249657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad9e8-0241-4f4e-9ea5-9364f14b51d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.264969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.266729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.267703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.269500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.270950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.275485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.287867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3303/6556] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:39.289996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.303351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0f276-adee-40bb-a34b-5770fffc57cc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.309115 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3254/6557] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:39.310364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.323382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.324374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.324814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.325166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.326021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.328434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.349675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c56b6-067d-4a23-8363-92182a796f20 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.360208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.361928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.362479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.362983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] PATH_INFO: `/v3/projects/920057bffeca4ee78d0fd6a35928219b/users/be35f92d0ece4b9ea0e14da7a0d8c79d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.370419 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3304/6558] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:39 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:39.371687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.381351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920057bffeca4ee78d0fd6a35928219b, user_id=be35f92d0ece4b9ea0e14da7a0d8c79d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.385247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba27e8-4732-4e42-aed7-66f8cc3f0876 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.407930 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3255/6559] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:39 2022] PUT /identity/v3/projects/920057bffeca4ee78d0fd6a35928219b/users/be35f92d0ece4b9ea0e14da7a0d8c79d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:39.418204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.418915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.419414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.470932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] MFA Rules not processed for user `be35f92d0ece4b9ea0e14da7a0d8c79d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:39.472632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:39.590444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb548d-01bb-49e0-a7be-01b48149fe99 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.604266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3256/6560] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:39.613276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.615012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:39.701705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.702653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.703272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.703666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.705168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.707279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.739558 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3305/6561] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:39 2022] POST /identity/v3/users => generated 308 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:39.745092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.755140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2f5d6-bf29-4726-a108-b18eb1e109bd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.759432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.760092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.760375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.760689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.773561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.775281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.776589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852995-b00a-451f-afe9-95dbbf10ccc2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.788070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3257/6562] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:39.788792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.790142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.790429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.792000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.792761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.794511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.806697 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3306/6563] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:39.810645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.824412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b255-b252-453e-8c05-4e7f90815a7d service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:39.838964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:39.840820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:39.845294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:39.846171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] PATH_INFO: `/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721/users/e394fc1e487a46148fc5eaf03602f8d0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:39.892900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6e74a6b5d8410982f054b0bbfa4721, user_id=e394fc1e487a46148fc5eaf03602f8d0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:39.906642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:39.968965 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3258/6564] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:39 2022] PUT /identity/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721/users/e394fc1e487a46148fc5eaf03602f8d0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:39.973473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:39.988730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66706e-87ac-4a99-ad9a-400ac2917e98 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.079477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.080279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.080823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.081348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.082352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.084210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dede7a0-b0c7-4f4c-91a8-ded63a57f00b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.108796 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3307/6565] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:40.110904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.128869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc96cf4-1255-4a0f-a381-967297f961e4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.135790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.136810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.137094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.137374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] PATH_INFO: `/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721/users/e394fc1e487a46148fc5eaf03602f8d0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.141414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6e74a6b5d8410982f054b0bbfa4721, user_id=e394fc1e487a46148fc5eaf03602f8d0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.145659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.159281 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3259/6566] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:40 2022] PUT /identity/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721/users/e394fc1e487a46148fc5eaf03602f8d0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:40.170322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.171061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.171307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.211787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] MFA Rules not processed for user `e394fc1e487a46148fc5eaf03602f8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:40.213105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:40.320412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.407961 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3308/6567] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:40.409107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.424037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9b023-8758-4bd9-953f-58c822661d5c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.430429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e394fc1e487a46148fc5eaf03602f8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6e74a6b5d8410982f054b0bbfa4721', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.431567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.432049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.432500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.433198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.435788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.464621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3309/6568] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:40 2022] POST /identity/v3/roles => generated 239 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:40.465588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6979d-ac29-414c-adae-63a442b2d98c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.468528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.477221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be35f92d0ece4b9ea0e14da7a0d8c79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '920057bffeca4ee78d0fd6a35928219b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.477910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.478204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.478672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.480612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:40.481010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.482495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b636-42fd-4260-be50-71ddd098042d tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.485697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.488162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e394fc1e487a46148fc5eaf03602f8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6e74a6b5d8410982f054b0bbfa4721', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.489395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.489532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.489796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] PATH_INFO: `/v3/projects/acf941ed89b64dfe81d4c2817a620861/users/7b11130fbc2c40bfbf9c86c6a39e64c8/roles/b555f760eb8b487b800a29c0337fc58a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.492472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorizing `identity:create_grant(project_id=acf941ed89b64dfe81d4c2817a620861, user_id=7b11130fbc2c40bfbf9c86c6a39e64c8, role_id=b555f760eb8b487b800a29c0337fc58a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.495151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.503768 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3260/6569] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:40.508917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.517863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3310/6570] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:40 2022] PUT /identity/v3/projects/acf941ed89b64dfe81d4c2817a620861/users/7b11130fbc2c40bfbf9c86c6a39e64c8/roles/b555f760eb8b487b800a29c0337fc58a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:40.522275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.525033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9478a-72ef-4b53-b0da-5a0afae88d59 tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.594055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be35f92d0ece4b9ea0e14da7a0d8c79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '920057bffeca4ee78d0fd6a35928219b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.594752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.595114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.595447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5079429-cafa-4e9a-88d1-5fc73dd36bea tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.595583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.596298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.598419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.601300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b11130fbc2c40bfbf9c86c6a39e64c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acf941ed89b64dfe81d4c2817a620861', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-745225505'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.602571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.603034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.603593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] PATH_INFO: `/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8/application_credentials` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.604593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: Authorizing `identity:create_application_credential(user_id=7b11130fbc2c40bfbf9c86c6a39e64c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.605931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b198704-153c-408b-aa68-8008bbc520fc tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.629433 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3261/6571] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:40 2022] POST /identity/v3/projects => generated 355 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:40.634563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.689164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3311/6572] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Apr 2 21:13:40 2022] POST /identity/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8/application_credentials => generated 659 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:40.693754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.694161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.694501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.705552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cb225-a75e-42ec-a68d-afd9b7e0b71a tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.716201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be35f92d0ece4b9ea0e14da7a0d8c79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '920057bffeca4ee78d0fd6a35928219b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.717417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.717704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.718179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.718926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:40.719248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.720420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] MFA Rules not processed for user `7b11130fbc2c40bfbf9c86c6a39e64c8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:40.721082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.721718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:40.734020 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3262/6573] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:40.779700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.790449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79108351-918b-4e07-9206-1823778c117f tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.796400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be35f92d0ece4b9ea0e14da7a0d8c79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '920057bffeca4ee78d0fd6a35928219b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.798451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.798599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.798777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] PATH_INFO: `/v3/projects/8935416a42c94a29b5f11ccc168c253f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.800963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8935416a42c94a29b5f11ccc168c253f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.803055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.873918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3312/6574] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 02 21:13:40.878668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8935416a42c94a29b5f11ccc168c253f', 'request_id': 'req-3fcef4a5-d9a9-40bc-a808-23a11118a87d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:40.879146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.887578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8935416a42c94a29b5f11ccc168c253f', 'request_id': 'req-3fcef4a5-d9a9-40bc-a808-23a11118a87d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:40.893900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8935416a42c94a29b5f11ccc168c253f', 'request_id': 'req-3fcef4a5-d9a9-40bc-a808-23a11118a87d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:40.908998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] The token cache is being invalidate because project 8935416a42c94a29b5f11ccc168c253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:40.909436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:40.910484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:40.912390 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3263/6575] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:40 2022] DELETE /identity/v3/projects/8935416a42c94a29b5f11ccc168c253f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:40.949215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e1bc7-18c2-42ad-b8b0-8316b241eddb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:40.954709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b11130fbc2c40bfbf9c86c6a39e64c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'acf941ed89b64dfe81d4c2817a620861', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-745225505'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:40.955762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:40.955966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:40.956221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] PATH_INFO: `/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8/application_credentials/04438605d990467d9dd1c299efb7cf17` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:40.957628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7b11130fbc2c40bfbf9c86c6a39e64c8, application_credential_id=04438605d990467d9dd1c299efb7cf17)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:40.959138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:40.984608 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3313/6576] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Apr 2 21:13:40 2022] DELETE /identity/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8/application_credentials/04438605d990467d9dd1c299efb7cf17 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:40.986155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:40.987613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.062822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef4a5-d9a9-40bc-a808-23a11118a87d tempest-VolumeQuotaClassesTest-1251529624 tempest-VolumeQuotaClassesTest-1251529624-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:41.069427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e394fc1e487a46148fc5eaf03602f8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea6e74a6b5d8410982f054b0bbfa4721', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:41.071024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.071809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.072099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] PATH_INFO: `/v3/roles/b555f760eb8b487b800a29c0337fc58a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.073761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b555f760eb8b487b800a29c0337fc58a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:41.075444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:41.122549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Invalidating the token cache because role b555f760eb8b487b800a29c0337fc58a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:41.122848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.123522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.125860 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3264/6577] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:40 2022] DELETE /identity/v3/roles/b555f760eb8b487b800a29c0337fc58a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:41.130893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:41.132752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.141547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:41.143014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.212116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd03a5-003c-46b9-af79-aebb161685a0 tempest-ApplicationCredentialsV3AdminTest-931881065 tempest-ApplicationCredentialsV3AdminTest-931881065-project] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:41.217943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:41.218862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.219149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.219487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] PATH_INFO: `/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.220791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b11130fbc2c40bfbf9c86c6a39e64c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:41.223130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe63ae-7eb8-4fd6-a74c-10b23d09f3a6 tempest-ApplicationCredentialsV3AdminTest-2003111069 tempest-ApplicationCredentialsV3AdminTest-2003111069-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:41.223286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:41.228512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:41.229501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.229863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.230209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] PATH_INFO: `/v3/users/1ddb56a23a8043d681648180f65e038d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.231514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddb56a23a8043d681648180f65e038d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:41.233595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:41.278420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b11130fbc2c40bfbf9c86c6a39e64c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.286995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b11130fbc2c40bfbf9c86c6a39e64c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.287719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b11130fbc2c40bfbf9c86c6a39e64c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.288662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b11130fbc2c40bfbf9c86c6a39e64c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.290146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddb56a23a8043d681648180f65e038d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.296700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59fcccf2-92f6-4639-97d3-db2f6bd073ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b11130fbc2c40bfbf9c86c6a39e64c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.302816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddb56a23a8043d681648180f65e038d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.303581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddb56a23a8043d681648180f65e038d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.312609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddb56a23a8043d681648180f65e038d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.315621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3314/6578] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:41 2022] DELETE /identity/v3/users/7b11130fbc2c40bfbf9c86c6a39e64c8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:41.320412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.320896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.321379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.321800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fe19b14e-9dcd-4746-ac90-0deb9b405a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddb56a23a8043d681648180f65e038d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:41.330714 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3265/6579] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:41 2022] DELETE /identity/v3/users/1ddb56a23a8043d681648180f65e038d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:41.335580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b590e-400d-4335-a442-197d6937b071 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.335858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b590e-400d-4335-a442-197d6937b071 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.336175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b590e-400d-4335-a442-197d6937b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.339604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:41.340852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.355268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f84b590e-400d-4335-a442-197d6937b071 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:41.356534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f84b590e-400d-4335-a442-197d6937b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.411858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3315/6580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:41.422474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:41.429061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.482774 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3266/6581] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:41.503895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b590e-400d-4335-a442-197d6937b071 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:41.506257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f84b590e-400d-4335-a442-197d6937b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:41.544641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2625cfe-823a-4ce3-9996-6631e8169679 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:41.549015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:41.549837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.550255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.550643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.562949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:41.565342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:41.576915 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3316/6582] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:41.620589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b590e-400d-4335-a442-197d6937b071 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:41.624966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:41.625702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:41.625997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:41.626283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:41.639686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:41.641097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:41.654462 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3267/6583] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:42.131410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:42.135102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:42.157425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff27aac-2579-4508-86c2-3cef2973d195 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:42.167626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:42.168557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:42.168900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:42.169183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] PATH_INFO: `/v3/projects/acf941ed89b64dfe81d4c2817a620861` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:42.171489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf941ed89b64dfe81d4c2817a620861)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:42.173748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:42.230906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf941ed89b64dfe81d4c2817a620861', 'request_id': 'req-aa547cda-d409-4743-a56a-26bc6ffd5f21'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.239807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf941ed89b64dfe81d4c2817a620861', 'request_id': 'req-aa547cda-d409-4743-a56a-26bc6ffd5f21'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.260486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf941ed89b64dfe81d4c2817a620861', 'request_id': 'req-aa547cda-d409-4743-a56a-26bc6ffd5f21'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.281477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] The token cache is being invalidate because project acf941ed89b64dfe81d4c2817a620861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:42.281819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.286741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.292055 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3317/6584] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:42 2022] DELETE /identity/v3/projects/acf941ed89b64dfe81d4c2817a620861 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:42.293225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:42.304065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec6b64-254f-4f80-a8cf-756c01a65986 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:42.392651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:42.394265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:42.394661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:42.394925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] PATH_INFO: `/v3/users/e394fc1e487a46148fc5eaf03602f8d0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:42.396838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e394fc1e487a46148fc5eaf03602f8d0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:42.399783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:42.488309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e394fc1e487a46148fc5eaf03602f8d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.506034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e394fc1e487a46148fc5eaf03602f8d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.511182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e394fc1e487a46148fc5eaf03602f8d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.521428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e394fc1e487a46148fc5eaf03602f8d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.530698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e394fc1e487a46148fc5eaf03602f8d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.539083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3268/6585] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:42 2022] DELETE /identity/v3/users/e394fc1e487a46148fc5eaf03602f8d0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:42.638344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:42.640351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:42.655618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa547cda-d409-4743-a56a-26bc6ffd5f21 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:42.774401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:42.776697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:42.777146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:42.777534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] PATH_INFO: `/v3/projects/908dce322fe941d296060ecec6ce8630` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:42.779898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908dce322fe941d296060ecec6ce8630)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:42.782352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:42.920535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908dce322fe941d296060ecec6ce8630', 'request_id': 'req-4db7faa4-a200-4e65-888c-2c9840c1b541'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.934803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908dce322fe941d296060ecec6ce8630', 'request_id': 'req-4db7faa4-a200-4e65-888c-2c9840c1b541'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.958587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908dce322fe941d296060ecec6ce8630', 'request_id': 'req-4db7faa4-a200-4e65-888c-2c9840c1b541'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.989351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] The token cache is being invalidate because project 908dce322fe941d296060ecec6ce8630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:42.989647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.990569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:42.997629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:42.998488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3318/6586] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:42 2022] DELETE /identity/v3/projects/908dce322fe941d296060ecec6ce8630 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:42.999211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:43.025700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a9c0-07b2-4c44-a49a-c8d5cf49cd18 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:43.124543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:43.126164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.126798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.127249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] PATH_INFO: `/v3/users/be35f92d0ece4b9ea0e14da7a0d8c79d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.129400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=be35f92d0ece4b9ea0e14da7a0d8c79d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:43.132072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:43.208604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be35f92d0ece4b9ea0e14da7a0d8c79d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.238473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be35f92d0ece4b9ea0e14da7a0d8c79d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.239457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be35f92d0ece4b9ea0e14da7a0d8c79d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.252057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be35f92d0ece4b9ea0e14da7a0d8c79d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.280720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-116f14cf-e083-4bcd-b577-73f2472631ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be35f92d0ece4b9ea0e14da7a0d8c79d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.301460 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3269/6587] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:42 2022] DELETE /identity/v3/users/be35f92d0ece4b9ea0e14da7a0d8c79d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:43.411832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:43.416076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:43.460067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7faa4-a200-4e65-888c-2c9840c1b541 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:43.558321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:43.559375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.560060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.560060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] PATH_INFO: `/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.561802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6e74a6b5d8410982f054b0bbfa4721)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:43.564677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:43.617260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6e74a6b5d8410982f054b0bbfa4721', 'request_id': 'req-8a24323e-1c8a-42ad-8ac6-4b682685f84d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.627679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6e74a6b5d8410982f054b0bbfa4721', 'request_id': 'req-8a24323e-1c8a-42ad-8ac6-4b682685f84d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.635900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6e74a6b5d8410982f054b0bbfa4721', 'request_id': 'req-8a24323e-1c8a-42ad-8ac6-4b682685f84d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.646287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] The token cache is being invalidate because project ea6e74a6b5d8410982f054b0bbfa4721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:43.646663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.647370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8a24323e-1c8a-42ad-8ac6-4b682685f84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:43.649621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3319/6588] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:43 2022] DELETE /identity/v3/projects/ea6e74a6b5d8410982f054b0bbfa4721 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:43.654576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.654876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.655184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.674375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:43.675516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:43.752642 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3270/6589] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:43.757375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.757667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.758444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.781201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:43.783586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:43.792705 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3320/6590] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:43.796951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:43.812961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8031-09af-4c06-94fb-1ca8dd509504 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:43.819305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:43.820990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.825727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.825727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.825727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:43.825727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:43.825727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:43.840029 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3271/6591] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:43.844143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:43.856399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85638f-0170-44a7-94bb-ede2e5c26d0b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:43.870016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:43.871136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:43.871136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:43.871386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:43.872165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:43.874176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:43.904363 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3321/6592] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:43 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:43.908625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:43.924196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15d01a-e614-4ce3-b448-b689e73f9df2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:43.971812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:43.973862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:44.016564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.017299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.017573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.018032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.018885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.021450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.069493 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3272/6593] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:43 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:44.071111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.082970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e397-567e-4408-b04e-c00c9a16923f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.093397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.094153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.094447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.094727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.095629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.096209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512910a-9c91-42a9-a728-59429ca41bab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.097741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.102169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.103130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.103486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.103866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] PATH_INFO: `/v3/projects/920057bffeca4ee78d0fd6a35928219b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.105245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920057bffeca4ee78d0fd6a35928219b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.107447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.116741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3273/6594] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:44.118354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.133878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c865-7e11-400c-a23a-424331e706b2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.140621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.141356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.141678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.141993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.142866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.144590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.162402 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3274/6595] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:44.167036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.181068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920057bffeca4ee78d0fd6a35928219b', 'request_id': 'req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:44.184763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85ca05-b62d-4bd8-8844-13d079221689 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.190648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920057bffeca4ee78d0fd6a35928219b', 'request_id': 'req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:44.211728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920057bffeca4ee78d0fd6a35928219b', 'request_id': 'req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:44.223349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] The token cache is being invalidate because project 920057bffeca4ee78d0fd6a35928219b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:44.224293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:44.231305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2e6f93c9-1fe4-4ea2-9e78-8c4fa0b350a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:44.237707 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3322/6596] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:43 2022] DELETE /identity/v3/projects/920057bffeca4ee78d0fd6a35928219b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:44.243803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a483d3-c8de-412e-bee1-27f9e9f529ef None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.244242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a483d3-c8de-412e-bee1-27f9e9f529ef None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.244675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a483d3-c8de-412e-bee1-27f9e9f529ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.278881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.279516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.279801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.280212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] PATH_INFO: `/v3/projects/8bab0e8e1a934ea8a4b7d33af322e065/users/5de191a2dbe64311912317b47691cd1a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.312716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42a483d3-c8de-412e-bee1-27f9e9f529ef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:44.314375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42a483d3-c8de-412e-bee1-27f9e9f529ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:44.316427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bab0e8e1a934ea8a4b7d33af322e065, user_id=5de191a2dbe64311912317b47691cd1a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.322144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c67d27-18fc-4237-877f-a05adc26ed14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.328140 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3323/6597] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:44.346626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.347106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.347475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.348443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3275/6598] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:44 2022] PUT /identity/v3/projects/8bab0e8e1a934ea8a4b7d33af322e065/users/5de191a2dbe64311912317b47691cd1a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:44.360154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.360473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.360863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.410580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:44.413246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:44.423663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] MFA Rules not processed for user `5de191a2dbe64311912317b47691cd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:44.425118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:44.521799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3324/6599] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:44.526719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.547675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518167d7-3ef7-41c4-b6ce-41af2d7b0a9d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.557532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.558574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.559102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.559850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.560857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:44.561381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.563444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.581261 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3325/6600] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:44.585643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.589532 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3276/6601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:44.594286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.596573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:44.602094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f438767-0097-4ca1-9e55-991c9afc5489 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.613603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.614480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.616842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.617892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.619139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.623522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.627985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1236c-ed17-4a6c-acd5-7508543feb9d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.640104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.640883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.641169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.642009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.642737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.644892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.672507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3326/6602] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:44.675718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.700216 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3277/6603] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:44.701894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.764541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d07c-fbcf-42a2-a31b-9a4af3ec1923 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.797265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1667-f9a8-4abd-a352-c2e208084460 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.802697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.803268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.803556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.803841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.804772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.807125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.834744 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3278/6604] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:44.840182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.859061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.859754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.860041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.860324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.861149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.861897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727acd0-dc84-4078-b046-eec024057370 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.863925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.867979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.869133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.869620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.870067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.871133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.874104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.891205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3327/6605] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:44 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:44.895442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.905172 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3279/6606] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:44.909207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.911189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca6b77-7375-439f-a168-2185fe27bafa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.923154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04ec26-77ac-4809-a037-edc6102ffc2e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.927416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.928615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.929083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.929524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.931073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.935505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.938003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.940333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.940795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.941247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] PATH_INFO: `/v3/projects/ab53a837f44d4b2f80742f92aef3d930/users/60435da1c8d24c51bd95e293941c625c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.952770 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3328/6607] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:44.956370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:44.966303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab53a837f44d4b2f80742f92aef3d930, user_id=60435da1c8d24c51bd95e293941c625c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.969192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.975199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5ccf-046c-4940-bfc1-ef233b25683c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:44.985687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:44.986554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:44.986846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:44.987216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:44.988031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:44.991039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:44.993729 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3280/6608] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:44 2022] PUT /identity/v3/projects/ab53a837f44d4b2f80742f92aef3d930/users/60435da1c8d24c51bd95e293941c625c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:44.994685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.010234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3329/6609] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:45.014809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.031085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d315a-b55f-4ab3-b4c1-0188a1944372 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.090739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c400d3-7fde-4ac4-b494-ba663cdc66a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.096862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.098074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.099182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.099709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.101005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.101237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.102437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.102832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.103258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] PATH_INFO: `/v3/projects/ba5069f9c1a14903acb26267457acaae/users/1d6710ca23ed41acad0f8338b61cd42b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.104528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.118905 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3281/6610] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:45.123222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.129886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5069f9c1a14903acb26267457acaae, user_id=1d6710ca23ed41acad0f8338b61cd42b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.135488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f45f76-8804-4384-ae9b-0c7ad29a27ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.140766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f051536-db36-4ca5-8a6b-94a3e74cd274 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.147899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.150043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.150495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.150911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] PATH_INFO: `/v3/projects/ab53a837f44d4b2f80742f92aef3d930/users/60435da1c8d24c51bd95e293941c625c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.153647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab53a837f44d4b2f80742f92aef3d930, user_id=60435da1c8d24c51bd95e293941c625c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.156682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e98d6e-619f-41c1-a985-030dfa8fae92 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.160870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3330/6611] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:45 2022] PUT /identity/v3/projects/ba5069f9c1a14903acb26267457acaae/users/1d6710ca23ed41acad0f8338b61cd42b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:45.171149 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3282/6612] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:45 2022] PUT /identity/v3/projects/ab53a837f44d4b2f80742f92aef3d930/users/60435da1c8d24c51bd95e293941c625c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:45.176690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.177328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.177844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.181990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.183069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.183663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.240693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] MFA Rules not processed for user `1d6710ca23ed41acad0f8338b61cd42b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:45.242256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:45.244960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] MFA Rules not processed for user `60435da1c8d24c51bd95e293941c625c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:45.246245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:45.345755 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3331/6613] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:45.349908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.414749 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3283/6614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:45.419647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.435123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451057c1-2fb6-4f9b-ae32-814f394c7d98 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.442090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.443050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.443506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.443940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.444836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.449015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba93ed-6a1e-4563-a1e0-13c0eb40bc74 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.450823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.469323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.470189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.470330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.470642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.471434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.473447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.491220 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3332/6615] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/projects => generated 401 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:45.495895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.504479 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3284/6616] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/services => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:45.509434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.552057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0034-5a58-467d-9221-d0ae8f3fec36 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.588474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe066-a529-4997-beb5-f24b8044f25e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.613202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.613891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.614179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.614450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.616547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.619889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.638463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.639776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.641387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.641693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.642577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.644797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.650420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3333/6617] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/users => generated 307 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:45.654406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.671221 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-317033352. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:45.671221 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:45.671221 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:13:45.678286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6d61f-9d1e-4fe6-b9f3-a3f3f0fd75f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.700030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.700891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.701246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.701715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.702540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.704565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.721031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3285/6618] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/endpoints => generated 359 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:45.727615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.736843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3334/6619] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:45.741621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.753562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4b79-56c6-416f-aaa1-d8c2b63c68cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.761754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f28121-4882-4cf2-910b-fcb2c895d1f3 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.770439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.770439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.770439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.770880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-317033352` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.771102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-317033352)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.772375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.774991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3286/6620] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 21:13:45 2022] GET /identity/v3/regions/tempest-region-317033352 => generated 178 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:45.778680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.787481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.787921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.788212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.788776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] PATH_INFO: `/v3/projects/25a14423e4d54806badd0de16c09fe86/users/cd72fc7d70fe446a96de9f7473eb5ded/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.811891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74037b4f-ed91-4b0e-8d5c-83f6a0163503 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.819698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.820613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.820911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.821198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.821440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a14423e4d54806badd0de16c09fe86, user_id=cd72fc7d70fe446a96de9f7473eb5ded, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.821920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.823807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.828893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.842147 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3287/6621] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/services => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:45.846219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.859320 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3335/6622] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:45 2022] PUT /identity/v3/projects/25a14423e4d54806badd0de16c09fe86/users/cd72fc7d70fe446a96de9f7473eb5ded/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:45.860735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:45.889718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2a44-4e11-4e8d-829d-c37279b03e51 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.941178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17544c33-85a9-41f2-91ac-70a39ecc9d88 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:45.970763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:45.971715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:45.972177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:45.972808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:45.973733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:45.975515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:45.998338 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3336/6623] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:46.002048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.008666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.009329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.009680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.009995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.010911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.012356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.016265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06538e1-03b8-4698-bded-88ef2dbbd2ad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.028553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.029736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.030185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.030623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] PATH_INFO: `/v3/projects/25a14423e4d54806badd0de16c09fe86/users/cd72fc7d70fe446a96de9f7473eb5ded/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.037799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a14423e4d54806badd0de16c09fe86, user_id=cd72fc7d70fe446a96de9f7473eb5ded, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.041460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8a7e-24e7-4c43-8d36-d765c29742ef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.043579 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-569894085. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:46.043579 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:46.043579 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:13:46.079561 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3337/6624] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:46 2022] PUT /identity/v3/projects/25a14423e4d54806badd0de16c09fe86/users/cd72fc7d70fe446a96de9f7473eb5ded/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:46.082813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.083250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.083755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.093842 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3288/6625] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:13:45 2022] POST /identity/v3/endpoints => generated 360 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:46.097703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.119798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] MFA Rules not processed for user `cd72fc7d70fe446a96de9f7473eb5ded`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:46.122165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:46.139706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830dd06-f31a-42bc-b7e1-6f01da4ea5fe tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.247378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.249584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.250026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.251015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-569894085` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.251855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-569894085)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.253716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.263533 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3338/6626] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3962 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:46.268380 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3289/6627] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/regions/tempest-region-569894085 => generated 178 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:46.282515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.282966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.285384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:46.294953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb8134-6f5d-4c4c-ac7e-fa9dd042ec62 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.300694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.301380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.301675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.302025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.302775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.305095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.347661 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1039454876. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:46.347661 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:46.347661 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:46.414445 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3339/6628] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:13:46 2022] POST /identity/v3/endpoints => generated 361 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:46.418414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.461431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9104ad-770a-44fd-a1f1-cdb9eb3ccc69 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.468446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae764-9432-4793-9b0f-27559dddf60e tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.477023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.477023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.477023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.477403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1039454876` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.477403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1039454876)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.478456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.480668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3340/6629] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/regions/tempest-region-1039454876 => generated 180 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:46.482232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.483169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.485842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.486404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.486665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.503041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f901d36-3992-4913-9525-efe53727bb83 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.508112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.508539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.509211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.509503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.509709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.513360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.514533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.515737 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:13:46.515737 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:13:46.515737 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:46.517583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.527694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3341/6630] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints => generated 4384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:46.533094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.538128 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3290/6631] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/auth/tokens => generated 4147 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:46.546338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ae228-59db-44bf-8435-8941b1e54055 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.551441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.552312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.552639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.552925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/0cb56c8c2c744b56a767ae0608543699` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.562424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=0cb56c8c2c744b56a767ae0608543699)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.563859 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:13:46.563859 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:13:46.563859 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:46.566856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.569279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3342/6632] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints/0cb56c8c2c744b56a767ae0608543699 => generated 361 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:46.573252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.585565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dee26-e8dd-4d70-ba97-009c1b63ea6e service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.591790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.592838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.593138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.593423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/0cb56c8c2c744b56a767ae0608543699` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.594881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0cb56c8c2c744b56a767ae0608543699)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.596986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.609005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0cb56c8c2c744b56a767ae0608543699', 'request_id': 'req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:46.623827 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3291/6633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:46 2022] DELETE /identity/v3/endpoints/0cb56c8c2c744b56a767ae0608543699 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:46.627034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.641311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d4f87-52f9-4db3-9aaf-ceee3e7aa3d4 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.649160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.667150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.668779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.669148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.669523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.673348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.673348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.684504 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3343/6634] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints => generated 4036 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:46.687229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.697853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11f21f-12e2-4008-b3d6-e1d6cd75be26 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.702411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.703236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.703693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.704158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.711487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5c16-b2fb-4f8c-9cf3-43dbc9998bf5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.724227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.725854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.726365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.727375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/0cb56c8c2c744b56a767ae0608543699` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.739374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:13:46.753757 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Could not find endpoint: 0cb56c8c2c744b56a767ae0608543699.: keystone.exception.EndpointNotFound: Could not find endpoint: 0cb56c8c2c744b56a767ae0608543699. Apr 02 21:13:46.755056 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3344/6635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:46 2022] DELETE /identity/v3/endpoints/0cb56c8c2c744b56a767ae0608543699 => generated 114 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:13:46.759707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.773913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e4f20-4294-46a5-910a-7da497eb5090 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.780979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.781886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.782178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.782468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1039454876` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.783127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1039454876)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.784755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.791236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.793030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.810577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3345/6636] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 21:13:46 2022] DELETE /identity/v3/regions/tempest-region-1039454876 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:46.816164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.817378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3292/6637] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3891 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:46.846632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111087-7d6d-4716-8de7-d3a2f96c5113 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.852635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.853303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.853597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.853885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.854941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.856584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.870168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3346/6638] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints => generated 4036 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:46.872056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.893065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3ad00-9fb1-42c3-8df0-b4ee42737e7e service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.899024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.900009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.900501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.900744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.902183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Adding query filter params (service_id=aa83e8f57a794e31bc60dd3d6059d609) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:46.902183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.903152 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:13:46.903152 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:13:46.903152 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:13:46.904259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.917430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3293/6639] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints?service_id=aa83e8f57a794e31bc60dd3d6059d609 => generated 501 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:46.921150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.935515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ee79-97f1-4343-928b-16a0810d3945 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.942378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.943064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.943357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.943673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.944505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Adding query filter params (service_id=e79d8dcc762b4c618d4e74876302ab23) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:46.944733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.949127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:46.961663 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3347/6640] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints?service_id=e79d8dcc762b4c618d4e74876302ab23 => generated 502 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:46.965340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:46.982210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be98d7-026d-454b-9e1b-6bd17c7ff0f0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:46.989257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:46.989991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:46.990318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:46.990600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:46.991328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:46.991634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:46.993309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.002981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3294/6641] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 21:13:46 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:47.007233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.020767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b7b1-59ad-42bf-866b-e7c699c2bb7c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.029373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.030154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.031186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.031604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.032443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:47.032883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.034838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.046909 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3348/6642] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Apr 2 21:13:47 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:47.052390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.064245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921823a-4445-494d-af11-eaa8e2861fad tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.075309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.076007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.076299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.076747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.077482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.079107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.114104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3295/6643] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:47 2022] POST /identity/v3/services => generated 288 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:47.118284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.133588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5147bcb-8147-492a-a8c3-6d324bb84be2 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.155216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.155889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.156176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.156478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.157269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.158876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.182538 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1131877863. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:47.182538 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:47.182538 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:47.251985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3349/6644] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:13:47 2022] POST /identity/v3/endpoints => generated 360 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:47.253865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.278450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9c1a-86e9-4b21-827a-e8071643ee4c tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.314866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.316274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.316661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.317096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1131877863` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.317791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1131877863)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.319109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.324917 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3296/6645] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:13:47 2022] GET /identity/v3/regions/tempest-region-1131877863 => generated 180 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:47.326717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.350165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47180cec-1f3e-44cc-837a-98eb9329c948 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.356684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.357572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.357876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.358156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/a5ec01271a73420483a9c4dbef04d642` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.364878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a5ec01271a73420483a9c4dbef04d642)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.368938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.392322 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1140099990. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:47.392322 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:47.392322 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:47.436511 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3350/6646] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:13:47 2022] PATCH /identity/v3/endpoints/a5ec01271a73420483a9c4dbef04d642 => generated 363 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:47.437294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.472954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4625f6-73bc-400e-95be-9eefe18013b6 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.513683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.514659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.514949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.515230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1140099990` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.515885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1140099990)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.516973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.522544 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3297/6647] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:13:47 2022] GET /identity/v3/regions/tempest-region-1140099990 => generated 180 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:47.524217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.537867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6c1f9-b0e5-4182-ba14-7dd150b194e0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.546205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.547285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.547706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.548994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/a5ec01271a73420483a9c4dbef04d642` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.559281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a5ec01271a73420483a9c4dbef04d642)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.561274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.571412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a5ec01271a73420483a9c4dbef04d642', 'request_id': 'req-4a3862f8-ebe0-4d9d-81db-c763487497e7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:47.585194 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3351/6648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/endpoints/a5ec01271a73420483a9c4dbef04d642 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:47.589669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.601452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072777d-9309-49d0-b526-6c88252897f9 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.623621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.624832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.625125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.626037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1140099990` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.626037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1140099990)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.627793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.641458 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1140099990. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:47.641458 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:47.641458 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:13:47.652691 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3298/6649] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/regions/tempest-region-1140099990 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:47.653820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.665688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3862f8-ebe0-4d9d-81db-c763487497e7 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.682253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.683727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.684019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.684298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-1131877863` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.684986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1131877863)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.686717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.712440 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3352/6650] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/regions/tempest-region-1131877863 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:47.717694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.733742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9545-4fdd-488d-b9d2-fd86caa1edd1 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.768375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.769634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.769778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.769979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services/ce5626e5b1a74736be0fee594f87aa1f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.770889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ce5626e5b1a74736be0fee594f87aa1f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.772747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.813449 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3299/6651] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/services/ce5626e5b1a74736be0fee594f87aa1f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:47.814938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.831774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245039b9-4f59-4983-8894-ae5c18bfbba0 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.848386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.849543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.849926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.850306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/e68977338c5d4dcda79770a989906c66` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.856769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e68977338c5d4dcda79770a989906c66)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.858503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.868604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e68977338c5d4dcda79770a989906c66', 'request_id': 'req-f18ecf40-e3a1-462d-8e04-417378aa477f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:47.880369 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3353/6652] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/endpoints/e68977338c5d4dcda79770a989906c66 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:47.885392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.898938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd259178-a8f8-483a-9f71-dc77eec1d9d5 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.921570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.924552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.924552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.924552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-569894085` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.924552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-569894085)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.925916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:47.952512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3300/6653] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/regions/tempest-region-569894085 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:47.955450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:47.968348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ecf40-e3a1-462d-8e04-417378aa477f tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:47.987321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:47.988345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:47.988740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:47.989235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services/e79d8dcc762b4c618d4e74876302ab23` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:47.989933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e79d8dcc762b4c618d4e74876302ab23)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:47.994064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.022459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3354/6654] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:47 2022] DELETE /identity/v3/services/e79d8dcc762b4c618d4e74876302ab23 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:48.023113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:48.035929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed675ef9-d12a-4b22-8652-7530125c9526 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:48.052981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:48.053839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.054128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.054551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/endpoints/42601208757a4d8d8d4f1aac9b491e00` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.061527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=42601208757a4d8d8d4f1aac9b491e00)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:48.063181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.075644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '42601208757a4d8d8d4f1aac9b491e00', 'request_id': 'req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.092665 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3301/6655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:48 2022] DELETE /identity/v3/endpoints/42601208757a4d8d8d4f1aac9b491e00 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:48.096732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:48.110733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eacb02-3505-43b6-b8cd-13b174652eef tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:48.133994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:48.135330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.135778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.136248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/regions/tempest-region-317033352` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.137107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-317033352)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:48.138946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.157589 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-317033352. To ensure interoperability, identifiers should be a valid uuid. Apr 02 21:13:48.157589 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 02 21:13:48.157589 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:13:48.169274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3355/6656] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:13:48 2022] DELETE /identity/v3/regions/tempest-region-317033352 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:48.173311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:48.185103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc647f80-29a5-4cd3-b1f3-6ce1a282c710 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:48.206892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60435da1c8d24c51bd95e293941c625c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab53a837f44d4b2f80742f92aef3d930', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:48.208016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.208812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.209322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] PATH_INFO: `/v3/services/aa83e8f57a794e31bc60dd3d6059d609` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.210194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aa83e8f57a794e31bc60dd3d6059d609)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:48.212847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190d090-d25f-42fa-b44c-3456dc943cdf tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.257133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:48.262142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3302/6657] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:48 2022] DELETE /identity/v3/services/aa83e8f57a794e31bc60dd3d6059d609 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:48.381684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91097b27-f7d4-482d-8176-09999d9b5c54 tempest-EndPointsTestJSON-92502874 tempest-EndPointsTestJSON-92502874-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:48.416770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:48.417726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.417954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.418239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] PATH_INFO: `/v3/users/5de191a2dbe64311912317b47691cd1a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.421314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de191a2dbe64311912317b47691cd1a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:48.423436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.508443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de191a2dbe64311912317b47691cd1a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.519608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de191a2dbe64311912317b47691cd1a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.521188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de191a2dbe64311912317b47691cd1a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.521885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de191a2dbe64311912317b47691cd1a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.531768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de191a2dbe64311912317b47691cd1a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:48.556748 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3356/6658] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:48 2022] DELETE /identity/v3/users/5de191a2dbe64311912317b47691cd1a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:48.558727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.559175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.559357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.590924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:48.595642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:48.720120 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3303/6659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:48.726791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:48.730243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:48.866874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e9116-29b3-41eb-950c-2ae90b722681 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:48.871108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:48.871773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:48.872064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:48.872344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:48.887853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:48.889507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:48.904354 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3357/6660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:49.745305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:49.749831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:49.785236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970eecaa-07e3-4ffa-931b-83bccedf66db None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:49.798030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:49.798926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:49.799206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:49.799665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] PATH_INFO: `/v3/projects/8bab0e8e1a934ea8a4b7d33af322e065` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:49.803041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bab0e8e1a934ea8a4b7d33af322e065)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:49.811412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:49.914666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bab0e8e1a934ea8a4b7d33af322e065', 'request_id': 'req-e2b773f5-3a22-4bc2-a416-37192885e8b7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:49.923411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bab0e8e1a934ea8a4b7d33af322e065', 'request_id': 'req-e2b773f5-3a22-4bc2-a416-37192885e8b7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:49.930292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bab0e8e1a934ea8a4b7d33af322e065', 'request_id': 'req-e2b773f5-3a22-4bc2-a416-37192885e8b7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:49.947834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] The token cache is being invalidate because project 8bab0e8e1a934ea8a4b7d33af322e065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:49.948281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:49.949088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:49.950984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3304/6661] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:49 2022] DELETE /identity/v3/projects/8bab0e8e1a934ea8a4b7d33af322e065 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:49.955477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:49.968280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c9d32-4cf2-4591-a87b-5ed798409e13 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:50.050897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:50.052015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:50.052314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:50.052700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] PATH_INFO: `/v3/users/60435da1c8d24c51bd95e293941c625c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:50.054985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60435da1c8d24c51bd95e293941c625c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:50.058227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:50.157491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60435da1c8d24c51bd95e293941c625c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.165552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60435da1c8d24c51bd95e293941c625c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.166264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60435da1c8d24c51bd95e293941c625c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.167056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60435da1c8d24c51bd95e293941c625c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.175004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-132d5ec2-a446-40bd-ab70-66e87078e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60435da1c8d24c51bd95e293941c625c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.217683 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3358/6662] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:49 2022] DELETE /identity/v3/users/60435da1c8d24c51bd95e293941c625c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:50.765733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:50.768772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:50.783462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b773f5-3a22-4bc2-a416-37192885e8b7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:50.858513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:50.859385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:50.859664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:50.859942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] PATH_INFO: `/v3/projects/ab53a837f44d4b2f80742f92aef3d930` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:50.861146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab53a837f44d4b2f80742f92aef3d930)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:50.863037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:50.911795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab53a837f44d4b2f80742f92aef3d930', 'request_id': 'req-f7404a48-8153-4214-96fb-feadbd08051c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.918898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab53a837f44d4b2f80742f92aef3d930', 'request_id': 'req-f7404a48-8153-4214-96fb-feadbd08051c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.924578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab53a837f44d4b2f80742f92aef3d930', 'request_id': 'req-f7404a48-8153-4214-96fb-feadbd08051c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.937981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] The token cache is being invalidate because project ab53a837f44d4b2f80742f92aef3d930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:50.938270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.938885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f7404a48-8153-4214-96fb-feadbd08051c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:50.940419 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3305/6663] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:50 2022] DELETE /identity/v3/projects/ab53a837f44d4b2f80742f92aef3d930 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:50.946049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:50.946422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:50.946778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:50.964397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:50.965673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.034989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3359/6664] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:51.043942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.044233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.044535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.064152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:51.065498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.074527 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3306/6665] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:51.078804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.089341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1235e4-cfed-4d9d-9d38-5da6379cf581 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.094292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.094993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.095278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.095555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.096274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:51.096629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.098259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.113619 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3360/6666] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:51.114760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.125097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d79cab-76bf-496c-ae1d-38cd9ef51f17 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.130712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.131403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.131688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.131983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.132748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.134738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.159899 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3307/6667] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:51.164534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.175577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0ebf4-3af7-4b50-b1cd-d03c33fd43ed admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.240387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.241199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.243040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.243247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.243971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.246312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.272127 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3361/6668] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:51.276760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.289931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723cfd5-95a6-4fb2-9e08-ee95650740ac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.296783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.297996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.298885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.299240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.300032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.301857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.321941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.322646 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3308/6669] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:13:51.336783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72370-a3ef-420e-a1ce-bd928fe7bfab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.342838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.343524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.343807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.344085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.347999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.348599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.350071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.350633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.368663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b4b38-4e2e-4033-963e-afea9172e6e3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.369164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3362/6670] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:51.373436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.377202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.378414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.380901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.381196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] PATH_INFO: `/v3/users/1d6710ca23ed41acad0f8338b61cd42b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.383274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6710ca23ed41acad0f8338b61cd42b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.384341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb37514-1d19-4e62-8412-5686da429529 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.386087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.400057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.401806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.402093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.402375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] PATH_INFO: `/v3/projects/b569cd1844d147eebfcef616e5a569d9/users/0232b5cbfdec4bd5ad078ac58614b0e6/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.420290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b569cd1844d147eebfcef616e5a569d9, user_id=0232b5cbfdec4bd5ad078ac58614b0e6, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.423494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cdbb5-76e0-4b20-aa41-3e962431fdf1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.440158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3363/6671] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:51 2022] PUT /identity/v3/projects/b569cd1844d147eebfcef616e5a569d9/users/0232b5cbfdec4bd5ad078ac58614b0e6/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:51.448724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6710ca23ed41acad0f8338b61cd42b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:51.456038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.456038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.456038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.475075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6710ca23ed41acad0f8338b61cd42b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:51.476258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6710ca23ed41acad0f8338b61cd42b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:51.485081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6710ca23ed41acad0f8338b61cd42b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:51.487595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] MFA Rules not processed for user `0232b5cbfdec4bd5ad078ac58614b0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:51.489065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.495878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aa1840c2-e5fc-47a0-a812-f608251dfe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6710ca23ed41acad0f8338b61cd42b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:51.504317 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3309/6672] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:51 2022] DELETE /identity/v3/users/1d6710ca23ed41acad0f8338b61cd42b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:51.510728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018317-b327-465a-a529-c16056ee9beb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.511032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018317-b327-465a-a529-c16056ee9beb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.511794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e018317-b327-465a-a529-c16056ee9beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.535434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2e018317-b327-465a-a529-c16056ee9beb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:51.536039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e018317-b327-465a-a529-c16056ee9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.570072 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3364/6673] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:13:51.575485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.577499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.636868 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3310/6674] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:51.647784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018317-b327-465a-a529-c16056ee9beb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.649863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2e018317-b327-465a-a529-c16056ee9beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:51.660209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4309e-5470-4701-bfeb-47ab804c688c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.666428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.667728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.667728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.667920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.668639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.670653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.718436 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3365/6675] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:51.733380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.754467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e018317-b327-465a-a529-c16056ee9beb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.837215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.838047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.838389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.838668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.865688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03193676-1c45-42fb-9adf-a6e18b491094 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.874528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.875853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.876156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.876441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.877259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.879815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.914147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3366/6676] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:51 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:51.917980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.929991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93e181-5c5c-4867-a2ea-3dc4b4074a4a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.932770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.934669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.936382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.937104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.937394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.937681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:51.938462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:51.940678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:51.946130 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3311/6677] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:13:51.965600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3367/6678] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:51.968734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:51.982902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa540704-e171-4ec0-a571-afdb7c9101c8 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:51.990090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:51.991687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:51.992097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:51.992476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] PATH_INFO: `/v3/projects/5fee7a8ef6d04fb7923057500c19899a/users/4667696970f347dc982adc22c2d6488c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.019511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fee7a8ef6d04fb7923057500c19899a, user_id=4667696970f347dc982adc22c2d6488c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.026680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.057187 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3312/6679] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:51 2022] PUT /identity/v3/projects/5fee7a8ef6d04fb7923057500c19899a/users/4667696970f347dc982adc22c2d6488c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:52.058681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.073944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aac56-ad66-4f49-9103-4f2e66de1358 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.191919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.192858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.193158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.193446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.194180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.198968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d87c7-41e2-4268-8226-ff2673b041ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.214776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3368/6680] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:52.215629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.231322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aae335-cc6d-4e85-9471-24056ec20982 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.243955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.244786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.245076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.245359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] PATH_INFO: `/v3/projects/5fee7a8ef6d04fb7923057500c19899a/users/4667696970f347dc982adc22c2d6488c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.250994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fee7a8ef6d04fb7923057500c19899a, user_id=4667696970f347dc982adc22c2d6488c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.256999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.271617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3313/6681] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:52 2022] PUT /identity/v3/projects/5fee7a8ef6d04fb7923057500c19899a/users/4667696970f347dc982adc22c2d6488c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:52.282714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.283055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.283292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.316584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] MFA Rules not processed for user `4667696970f347dc982adc22c2d6488c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:52.317974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:52.394373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3369/6682] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:52.399299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.409567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.412544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bee5ba-eb6c-4f16-866a-26e202b6dfc4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.413068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:52.420558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.421708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.423287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.424323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.425073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.428968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.488477 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3314/6683] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/domains => generated 276 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:52.493096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.531147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1e4f6-492d-46fc-9114-5fe099732e91 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.573259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e450b-576e-4192-a944-94815e14384d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.579697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.580627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.580916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.581195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.581891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.583806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.606715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.607690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.608085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.608895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] PATH_INFO: `/v3/projects/ba5069f9c1a14903acb26267457acaae` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.610247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5069f9c1a14903acb26267457acaae)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.616112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.637614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3315/6684] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:52.638887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.681258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5069f9c1a14903acb26267457acaae', 'request_id': 'req-0375817d-053a-469b-9a02-97da441f7dd7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.687654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5069f9c1a14903acb26267457acaae', 'request_id': 'req-0375817d-053a-469b-9a02-97da441f7dd7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.697710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5069f9c1a14903acb26267457acaae', 'request_id': 'req-0375817d-053a-469b-9a02-97da441f7dd7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.713512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] The token cache is being invalidate because project ba5069f9c1a14903acb26267457acaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:52.713855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.714921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.717370 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3370/6685] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:52 2022] DELETE /identity/v3/projects/ba5069f9c1a14903acb26267457acaae => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:52.721873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.724300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:52.773542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c347d13-ec8a-44a1-8cca-6dbe4df34a11 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.852076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375817d-053a-469b-9a02-97da441f7dd7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.853054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.853811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.854162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.854510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.855263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.857935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.865385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.866279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.866562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.866900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] PATH_INFO: `/v3/users/cd72fc7d70fe446a96de9f7473eb5ded` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.869019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd72fc7d70fe446a96de9f7473eb5ded)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.870963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.887436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3316/6686] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/groups => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:52.891557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.893294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:52.911762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617461b-127e-45f8-9d4d-d9f0255091b2 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.917605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.918343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.918635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.918913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.919627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.921687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.947108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3317/6687] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/users => generated 445 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:52.951520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.957242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd72fc7d70fe446a96de9f7473eb5ded'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.963168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7319f88-f17c-4563-85c8-3dad22568659 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:52.966873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd72fc7d70fe446a96de9f7473eb5ded'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.967878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd72fc7d70fe446a96de9f7473eb5ded'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.968297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:52.968711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd72fc7d70fe446a96de9f7473eb5ded'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.969075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:52.969363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:52.969706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:52.970374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:52.971984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:52.978792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd72fc7d70fe446a96de9f7473eb5ded'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:52.989115 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3318/6688] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:52 2022] POST /identity/v3/roles => generated 240 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:52.993431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:52.995449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:52.998147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3371/6689] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:52 2022] DELETE /identity/v3/users/cd72fc7d70fe446a96de9f7473eb5ded => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:53.009555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098dd0-8337-47c4-84d6-a7ef99189dd3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.082854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.085281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.086392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.086868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.095893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, group_id=85c012a50802410ca7efaab10716c536, role_id=3bb350e991ea4ffb871788b664cbffde)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.100987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.132405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3319/6690] 10.222.0.18 () {60 vars in 1584 bytes} [Sat Apr 2 21:13:52 2022] PUT /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:53.136775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.160748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fecf5-4760-4bd9-b940-7c1bc649861a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.233108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.234051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.234416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.234778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.237172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:check_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, group_id=85c012a50802410ca7efaab10716c536, role_id=3bb350e991ea4ffb871788b664cbffde)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.240756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.252699 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3372/6691] 10.222.0.18 () {58 vars in 1566 bytes} [Sat Apr 2 21:13:53 2022] HEAD /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:53.254635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.268857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c594a-3fbb-4299-95eb-bf84f168bd55 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.278046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.279526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.279818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.280108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.283671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, group_id=85c012a50802410ca7efaab10716c536, role_id=3bb350e991ea4ffb871788b664cbffde)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.287201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.294360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 3bb350e991ea4ffb871788b664cbffde was removed from group 85c012a50802410ca7efaab10716c536 on project 58e234fda7be4b31a5edc38d9bf3da92. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:53.294812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.296648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.315300 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3320/6692] 10.222.0.18 () {58 vars in 1568 bytes} [Sat Apr 2 21:13:53 2022] DELETE /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/groups/85c012a50802410ca7efaab10716c536/roles/3bb350e991ea4ffb871788b664cbffde/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:53.319181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.321861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:53.339726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755bca4-4972-4b37-800a-0b3a66d11c7e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.465261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.466847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.467877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.468034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.470070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:53.470747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/3bb350e991ea4ffb871788b664cbffde` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.478064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3bb350e991ea4ffb871788b664cbffde)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.488961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.552973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 3bb350e991ea4ffb871788b664cbffde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:53.553385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.555306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.559228 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3373/6693] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:53 2022] DELETE /identity/v3/roles/3bb350e991ea4ffb871788b664cbffde => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:53.565191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.567255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:53.679408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17072a-5b62-4619-b373-ab0b5ed6e181 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.692607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.693508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.693893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.694387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.696343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.699261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.703821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec5f6-13e8-4c3e-a43a-b5b7fd645682 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.720714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3374/6694] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:53 2022] POST /identity/v3/roles => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:53.725105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.746113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626207cd-9ecc-419b-a920-f31fdc13cbe3 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.758963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.759922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.760203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.760516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.782482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=4a529787532f41cfba92d96f027e57c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.786281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.812532 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3375/6695] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Apr 2 21:13:53 2022] PUT /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:53.813844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:53.843103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.844209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.844823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.845260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] PATH_INFO: `/v3/projects/25a14423e4d54806badd0de16c09fe86` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.846676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a14423e4d54806badd0de16c09fe86)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:53.848845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:53.903360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b514-d86d-46b5-bf45-3e9d47a3afea tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:53.919053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a14423e4d54806badd0de16c09fe86', 'request_id': 'req-ff9777ae-e523-4397-907c-d7ce39ce133b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.931968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a14423e4d54806badd0de16c09fe86', 'request_id': 'req-ff9777ae-e523-4397-907c-d7ce39ce133b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.964243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a14423e4d54806badd0de16c09fe86', 'request_id': 'req-ff9777ae-e523-4397-907c-d7ce39ce133b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.984035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] The token cache is being invalidate because project 25a14423e4d54806badd0de16c09fe86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:53.984652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.985680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ff9777ae-e523-4397-907c-d7ce39ce133b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:53.987549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3321/6696] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:53 2022] DELETE /identity/v3/projects/25a14423e4d54806badd0de16c09fe86 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:53.994451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48feb17-54d2-4517-b79b-b39ea046a2db None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.995594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48feb17-54d2-4517-b79b-b39ea046a2db None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.996249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:53.997131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:53.997492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:53.997838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48feb17-54d2-4517-b79b-b39ea046a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:53.997963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.000597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:check_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=4a529787532f41cfba92d96f027e57c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.004273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.017850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3376/6697] 10.222.0.18 () {58 vars in 1563 bytes} [Sat Apr 2 21:13:53 2022] HEAD /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:54.025276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.027089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.036995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d48feb17-54d2-4517-b79b-b39ea046a2db None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:54.039277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d48feb17-54d2-4517-b79b-b39ea046a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.050894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358cbfe-b9ed-4b68-926c-537873929f4c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.062802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.063748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.064040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.064420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.071500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=4a529787532f41cfba92d96f027e57c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.074430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.085355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 4a529787532f41cfba92d96f027e57c7 was removed from user 7c4f89618ac34b3e9a9d0e42b68919d8 on project 58e234fda7be4b31a5edc38d9bf3da92. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:54.086949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.089052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.116146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3377/6698] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Apr 2 21:13:54 2022] DELETE /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/4a529787532f41cfba92d96f027e57c7/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:54.121205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.124721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.138197 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3322/6699] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:54.142268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.142573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.142875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.203776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:54.205412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.233877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc04e46-e01a-42e2-89d0-175d356977bf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.242272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.244265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.244693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.245151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/4a529787532f41cfba92d96f027e57c7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.247922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4a529787532f41cfba92d96f027e57c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.249829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.357830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 4a529787532f41cfba92d96f027e57c7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:54.358149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.361389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.364986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3323/6700] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:54.372677 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3378/6701] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:54 2022] DELETE /identity/v3/roles/4a529787532f41cfba92d96f027e57c7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:54.379258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.380762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.390524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.402720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b201ee6-866d-4a73-8ec9-0f596e674b9d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.490074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce7e9-96b0-456f-9194-2cca0427898c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.499304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.500012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.500303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.501212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.502045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.508718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.531374 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3379/6702] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:54 2022] POST /identity/v3/roles => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:54.535606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.546557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b729cde-2dd9-4ea8-8e9e-6e3789f6f227 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.552383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.553359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.553645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.553932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.558308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44ea177896574363a261734d77f2d3ea, group_id=85c012a50802410ca7efaab10716c536, role_id=1f87893104e94f8f98632650cb2a089d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.562000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.567428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.568225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.568478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.568915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.569694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:54.570647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.580470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.598668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3380/6703] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Apr 2 21:13:54 2022] PUT /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:54.600129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.615000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3324/6704] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:54.615972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.621585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.638892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364a10-9154-4c1f-9219-81b5ef4747fd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.693830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f3c2-0062-4328-9d15-d8226aaded5e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.700805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.701990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.702659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.703287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.705487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44ea177896574363a261734d77f2d3ea, group_id=85c012a50802410ca7efaab10716c536)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.710129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.720159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.720956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.721287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.721568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.722259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.724343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.728942 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3381/6705] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Apr 2 21:13:54 2022] GET /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/inherited_to_projects => generated 448 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:54.733947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.748598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4512e-0225-4a73-b317-6f005c6eaeb1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.756621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.762675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.763671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.764602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.768630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44ea177896574363a261734d77f2d3ea, group_id=85c012a50802410ca7efaab10716c536, role_id=1f87893104e94f8f98632650cb2a089d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.771761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.782349 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3382/6706] 10.222.0.18 () {58 vars in 1563 bytes} [Sat Apr 2 21:13:54 2022] HEAD /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:54.782887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3325/6707] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:54 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:54.786700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.792289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.802183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea0f0-7fe2-4bc6-9a09-3e71bc014157 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.901568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351c0b-d24f-4f29-8e2c-67b1655c1f93 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:54.907276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.907959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.908243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.908558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.909283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.911379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.912294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:54.914200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:54.914606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:54.914993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:54.917827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44ea177896574363a261734d77f2d3ea, group_id=85c012a50802410ca7efaab10716c536, role_id=1f87893104e94f8f98632650cb2a089d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:54.921501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:54.928575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 1f87893104e94f8f98632650cb2a089d was removed from group 85c012a50802410ca7efaab10716c536 on domain 44ea177896574363a261734d77f2d3ea. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:54.929084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.931483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:54.947718 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3326/6708] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:13:54 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:54.949005 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3383/6709] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Apr 2 21:13:54 2022] DELETE /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/groups/85c012a50802410ca7efaab10716c536/roles/1f87893104e94f8f98632650cb2a089d/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:54.957878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.958361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:54.960219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:54.968541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:55.002028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb50ec5-02db-4e7a-9de7-dc1a8fb3e1fe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.073781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35687-1010-40cb-a584-77f5de3d6c86 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.088307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.089039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.089333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.089622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.090481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.092122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.115839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3384/6710] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:54 2022] GET /identity/v3/roles => generated 1651 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:55.121030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.125043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.126425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.126619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.126879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/1f87893104e94f8f98632650cb2a089d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.130165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1f87893104e94f8f98632650cb2a089d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.132484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.138317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbe8aa-b92b-44c7-ba68-ef32d24ac093 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.153715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.154556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.155421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.155809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.156681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.158507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.189206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3385/6711] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:13:55 2022] GET /identity/v3/roles => generated 1651 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:13:55.190965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.214101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17b20d-99ea-4dc0-8094-303be992ddde admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.224509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 1f87893104e94f8f98632650cb2a089d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:55.225071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:55.225969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:55.226883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.228036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.228158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.228605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] PATH_INFO: `/v3/projects/f225bd13fc8c4322bda129069fb71d7c/users/33e309d018fc4bc0a4ca5ff0e0311e40/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.233263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3327/6712] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:54 2022] DELETE /identity/v3/roles/1f87893104e94f8f98632650cb2a089d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:55.234289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.236130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:55.261407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f225bd13fc8c4322bda129069fb71d7c, user_id=33e309d018fc4bc0a4ca5ff0e0311e40, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.289698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d59d-3a29-446a-9407-4b14ec6aab65 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.344640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3386/6713] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:13:55 2022] PUT /identity/v3/projects/f225bd13fc8c4322bda129069fb71d7c/users/33e309d018fc4bc0a4ca5ff0e0311e40/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:55.361468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.364255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.367705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.386158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2dfa-550b-46e7-bb46-6be74fa9beed tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.457884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] MFA Rules not processed for user `33e309d018fc4bc0a4ca5ff0e0311e40`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:13:55.459195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:55.502221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.503629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.503924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.504208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.505586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.508906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.538500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3387/6714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:13:55.539704 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3328/6715] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:55 2022] POST /identity/v3/roles => generated 240 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:55.547889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.549024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.553726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:55.561837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a953-74c5-4245-a29d-be92ad097a30 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.569465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.571012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.571298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.571748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.574933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=f8447ccd03514fb7a72a8f2adfd04dd5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.579276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.599712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3388/6716] 10.222.0.18 () {60 vars in 1578 bytes} [Sat Apr 2 21:13:55 2022] PUT /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:55.605000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.671322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8502-e5df-4136-b631-9e23b125bf3c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.693095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc886-3337-49ed-9389-7a95908c9ed0 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.700968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.701679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.702038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.702394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.704265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.707879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.727951 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3389/6717] 10.222.0.18 () {58 vars in 1460 bytes} [Sat Apr 2 21:13:55 2022] GET /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/inherited_to_projects => generated 447 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:55.732566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.743711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcc2-8e3a-41ea-87de-ccc748618fd9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.752144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.752144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.752144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.752144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.759336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.760540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.761562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.762027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.765050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=f8447ccd03514fb7a72a8f2adfd04dd5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.768720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.789380 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3390/6718] 10.222.0.18 () {58 vars in 1560 bytes} [Sat Apr 2 21:13:55 2022] HEAD /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:55.790489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.801101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf5c6-d665-471b-9b9b-621d48d8c90a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.807480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.808370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.808789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.809082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.811411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=f8447ccd03514fb7a72a8f2adfd04dd5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.814274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.821993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role f8447ccd03514fb7a72a8f2adfd04dd5 was removed from user 7c4f89618ac34b3e9a9d0e42b68919d8 on domain 44ea177896574363a261734d77f2d3ea. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:55.822501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:55.823266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:55.849597 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3391/6719] 10.222.0.18 () {58 vars in 1562 bytes} [Sat Apr 2 21:13:55 2022] DELETE /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/f8447ccd03514fb7a72a8f2adfd04dd5/inherited_to_projects => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:55.850648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:55.854939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:55.871338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.873182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:55.898379 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3329/6720] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:13:55.958176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102502a3-64b0-469a-99e4-76d39ca67b25 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:55.963771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:55.964696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:55.965454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:55.965454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/f8447ccd03514fb7a72a8f2adfd04dd5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:55.966763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f8447ccd03514fb7a72a8f2adfd04dd5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:55.968558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.035663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role f8447ccd03514fb7a72a8f2adfd04dd5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:56.036344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:56.037615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:56.040898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3392/6721] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:55 2022] DELETE /identity/v3/roles/f8447ccd03514fb7a72a8f2adfd04dd5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:56.046104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.059538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4f5fe-e8bb-44ae-827c-a4f5977e1ba9 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.140289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.141374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.141497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.141787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.142768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.145070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.163570 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3330/6722] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:56 2022] POST /identity/v3/roles => generated 239 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:56.167965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.169553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:56.185908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f939-9677-4e8e-a51c-d711c658cad1 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.195954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.196956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.197105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.197364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.198580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.201308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.281191 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3393/6723] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:56 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:56.287875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.304237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d03-3b7c-4d84-bee9-a28374285dcf tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.485173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.487015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.487531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.488052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/0c7b0ac2512f489b931a5aadf74e90a7/inherited_to_projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.503894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=0c7b0ac2512f489b931a5aadf74e90a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.511160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.533232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3331/6724] 10.222.0.18 () {60 vars in 1578 bytes} [Sat Apr 2 21:13:56 2022] PUT /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/0c7b0ac2512f489b931a5aadf74e90a7/inherited_to_projects => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:56.537209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.550561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917083a-8ba9-4ec4-9288-8b3edebc2c6c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.661342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.668599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.669556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.669829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.671920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=58e234fda7be4b31a5edc38d9bf3da92, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:56.672609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.674857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.760743 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3394/6725] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:56 2022] GET /identity/v3/role_assignments?scope.project.id=58e234fda7be4b31a5edc38d9bf3da92&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 648 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:56.764846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.778491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2471f40-d5fe-4c6a-841b-28a4f0d5aecb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.784628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.786111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.787528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.787528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.789291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=04b9b35b30d94234b1c533ff19b8fc35, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:56.789718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.791737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.858688 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3332/6726] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:56 2022] GET /identity/v3/role_assignments?scope.project.id=04b9b35b30d94234b1c533ff19b8fc35&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 648 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:56.859895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.870165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855edf8-e1f2-437b-b85f-b7414ff4ef68 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.875064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.875923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.876212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.876521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/0c7b0ac2512f489b931a5aadf74e90a7/inherited_to_projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.878791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=44ea177896574363a261734d77f2d3ea, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=0c7b0ac2512f489b931a5aadf74e90a7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.881543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:56.886737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 0c7b0ac2512f489b931a5aadf74e90a7 was removed from user 7c4f89618ac34b3e9a9d0e42b68919d8 on domain 44ea177896574363a261734d77f2d3ea. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:56.887031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:56.887704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:56.902650 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3395/6727] 10.222.0.18 () {58 vars in 1562 bytes} [Sat Apr 2 21:13:56 2022] DELETE /identity/v3/OS-INHERIT/domains/44ea177896574363a261734d77f2d3ea/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/0c7b0ac2512f489b931a5aadf74e90a7/inherited_to_projects => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:56.906868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:56.908594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:56.921797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527e8a-fa16-481f-a446-efbf4ae4a198 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:56.979670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:56.980256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:56.980687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:56.980978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:56.981798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=58e234fda7be4b31a5edc38d9bf3da92, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:56.982108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:56.983955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.029065 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3333/6728] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:56 2022] GET /identity/v3/role_assignments?scope.project.id=58e234fda7be4b31a5edc38d9bf3da92&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 228 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:57.033256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.050034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59dc37-3765-4c96-819f-0130f41913d9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.065091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.076484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.076484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.076484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.076484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=04b9b35b30d94234b1c533ff19b8fc35, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:57.076958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.076958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.129003 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3396/6729] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:57 2022] GET /identity/v3/role_assignments?scope.project.id=04b9b35b30d94234b1c533ff19b8fc35&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 228 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:57.130973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.147255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fcc6b-1183-4443-8e09-c88f2b327fdc tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.160953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.162204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.162728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.168955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects/04b9b35b30d94234b1c533ff19b8fc35` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.171071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04b9b35b30d94234b1c533ff19b8fc35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.174186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.245430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b9b35b30d94234b1c533ff19b8fc35', 'request_id': 'req-4f499e9a-c121-472d-95b2-0296f432b83e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.260525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b9b35b30d94234b1c533ff19b8fc35', 'request_id': 'req-4f499e9a-c121-472d-95b2-0296f432b83e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.268669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b9b35b30d94234b1c533ff19b8fc35', 'request_id': 'req-4f499e9a-c121-472d-95b2-0296f432b83e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.290495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] The token cache is being invalidate because project 04b9b35b30d94234b1c533ff19b8fc35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:57.290750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.291923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.296901 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3334/6730] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:57 2022] DELETE /identity/v3/projects/04b9b35b30d94234b1c533ff19b8fc35 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:57.298691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.301383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:57.340708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67919-658a-43ea-ba17-217c13f5aabe tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.461144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.462442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.462931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.463436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/0c7b0ac2512f489b931a5aadf74e90a7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.465795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0c7b0ac2512f489b931a5aadf74e90a7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.468021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.523269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role 0c7b0ac2512f489b931a5aadf74e90a7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:57.523466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.524151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:57.531356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3397/6731] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:57 2022] DELETE /identity/v3/roles/0c7b0ac2512f489b931a5aadf74e90a7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:57.532284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.563806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f499e9a-c121-472d-95b2-0296f432b83e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.676054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.676993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.677441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.677880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.678789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.681467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.700206 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3335/6732] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Apr 2 21:13:57 2022] POST /identity/v3/roles => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:13:57.701524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.703011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:57.725897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2450a-7ea6-4bf2-aa40-63f635526668 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.733255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.733612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.733926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.734193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.734955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.737241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.772839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3398/6733] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:13:57 2022] POST /identity/v3/projects => generated 410 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:13:57.777001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.787179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c8f83-82e0-4737-bf5b-dfcbdb850f67 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.846856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.848095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.848235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.848547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/b0ec37c9abbf4c32907f46fb5bda11c7/inherited_to_projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.851210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:create_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=b0ec37c9abbf4c32907f46fb5bda11c7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.853991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:57.867800 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3336/6734] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Apr 2 21:13:57 2022] PUT /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/b0ec37c9abbf4c32907f46fb5bda11c7/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:57.872146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:57.883113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b4340-9e43-48ed-8cba-1ed1e7cf3bbb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:57.958185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:57.959076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:57.959562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:57.960160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:57.962525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=8ea7eb140bdf459aad35a28b3f369145, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:57.963001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:57.965244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.031837 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3399/6735] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:57 2022] GET /identity/v3/role_assignments?scope.project.id=8ea7eb140bdf459aad35a28b3f369145&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 649 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:58.035868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.047284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab90d-c796-4eb3-b6b6-e175979a1da5 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.052639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.053610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.053890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.054316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/b0ec37c9abbf4c32907f46fb5bda11c7/inherited_to_projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.057102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=58e234fda7be4b31a5edc38d9bf3da92, user_id=7c4f89618ac34b3e9a9d0e42b68919d8, role_id=b0ec37c9abbf4c32907f46fb5bda11c7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.060169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.065763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role b0ec37c9abbf4c32907f46fb5bda11c7 was removed from user 7c4f89618ac34b3e9a9d0e42b68919d8 on project 58e234fda7be4b31a5edc38d9bf3da92. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:58.066143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.066868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.082664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3337/6736] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Apr 2 21:13:58 2022] DELETE /identity/v3/OS-INHERIT/projects/58e234fda7be4b31a5edc38d9bf3da92/users/7c4f89618ac34b3e9a9d0e42b68919d8/roles/b0ec37c9abbf4c32907f46fb5bda11c7/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:58.087409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.089470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:58.102397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff18aeb-1bd7-4326-b5f4-f012546c375d tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.160844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.161519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.161810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.162098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.162904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Adding query filter params (scope.project.id=8ea7eb140bdf459aad35a28b3f369145, user.id=7c4f89618ac34b3e9a9d0e42b68919d8) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:13:58.163429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.165354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.226700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3400/6737] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Apr 2 21:13:58 2022] GET /identity/v3/role_assignments?scope.project.id=8ea7eb140bdf459aad35a28b3f369145&user.id=7c4f89618ac34b3e9a9d0e42b68919d8&effective => generated 228 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:13:58.227818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.242476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aca33-0b0c-4a02-912c-b260ee90d54f tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.258708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.261076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.261418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.261686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects/8ea7eb140bdf459aad35a28b3f369145` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.262975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ea7eb140bdf459aad35a28b3f369145)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.272618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.356084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea7eb140bdf459aad35a28b3f369145', 'request_id': 'req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.363514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea7eb140bdf459aad35a28b3f369145', 'request_id': 'req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.375813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea7eb140bdf459aad35a28b3f369145', 'request_id': 'req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.391476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] The token cache is being invalidate because project 8ea7eb140bdf459aad35a28b3f369145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:58.392665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.393407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.399762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.401263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3338/6738] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:58 2022] DELETE /identity/v3/projects/8ea7eb140bdf459aad35a28b3f369145 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:13:58.402240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:58.420062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68182b-275d-45b1-b6cd-2b7138d8d395 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.547690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.548802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.549646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.550165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/roles/b0ec37c9abbf4c32907f46fb5bda11c7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.552262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b0ec37c9abbf4c32907f46fb5bda11c7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.557335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.598293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invalidating the token cache because role b0ec37c9abbf4c32907f46fb5bda11c7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:58.598596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.599413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.601901 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3401/6739] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:58 2022] DELETE /identity/v3/roles/b0ec37c9abbf4c32907f46fb5bda11c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:58.607126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.618180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfd4df-8ea0-439d-9829-a78b1610dc4a tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.680316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.682304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.683052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.683413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/users/7c4f89618ac34b3e9a9d0e42b68919d8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.689219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7c4f89618ac34b3e9a9d0e42b68919d8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.689219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:58.764244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4f89618ac34b3e9a9d0e42b68919d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.781732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4f89618ac34b3e9a9d0e42b68919d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.783346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4f89618ac34b3e9a9d0e42b68919d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.796063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4f89618ac34b3e9a9d0e42b68919d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.806935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4f89618ac34b3e9a9d0e42b68919d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:58.816997 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3339/6740] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:13:58 2022] DELETE /identity/v3/users/7c4f89618ac34b3e9a9d0e42b68919d8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:58.821730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:58.823267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:58.839752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1efbb7-ffbb-49d7-a7ea-0aab4f353ad9 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:58.985435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:58.986229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:58.986408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:58.986692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/groups/85c012a50802410ca7efaab10716c536` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:58.990474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_group(group_id=85c012a50802410ca7efaab10716c536)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:58.993862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:59.090510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3402/6741] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:13:58 2022] DELETE /identity/v3/groups/85c012a50802410ca7efaab10716c536 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:59.094620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:59.096298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:59.118357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09c98-911b-492d-ba38-4ead5f8a6ddb tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:59.221022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:59.222114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:59.222500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:59.222945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/projects/58e234fda7be4b31a5edc38d9bf3da92` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:59.224511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58e234fda7be4b31a5edc38d9bf3da92)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:59.229328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:59.295748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e234fda7be4b31a5edc38d9bf3da92', 'request_id': 'req-c65606d8-7817-4750-abf9-b7c46ca69e8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.309593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e234fda7be4b31a5edc38d9bf3da92', 'request_id': 'req-c65606d8-7817-4750-abf9-b7c46ca69e8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.322018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e234fda7be4b31a5edc38d9bf3da92', 'request_id': 'req-c65606d8-7817-4750-abf9-b7c46ca69e8e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.354164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] The token cache is being invalidate because project 58e234fda7be4b31a5edc38d9bf3da92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:13:59.354597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.355436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.357890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3340/6742] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:13:59 2022] DELETE /identity/v3/projects/58e234fda7be4b31a5edc38d9bf3da92 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:13:59.364595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:59.367837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:13:59.383799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad5432-a0ec-4ba8-a100-2934efeac76c tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:59.490749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:59.494114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:59.494410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:59.494882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/domains/44ea177896574363a261734d77f2d3ea` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:59.499960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=44ea177896574363a261734d77f2d3ea)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:59.501638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:59.560835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.561560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.629994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.630783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.638422 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3403/6743] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:13:59 2022] PATCH /identity/v3/domains/44ea177896574363a261734d77f2d3ea => generated 277 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:13:59.642490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:13:59.662160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65606d8-7817-4750-abf9-b7c46ca69e8e tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:13:59.815283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4667696970f347dc982adc22c2d6488c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fee7a8ef6d04fb7923057500c19899a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:13:59.816242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:13:59.816700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:13:59.817117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] PATH_INFO: `/v3/domains/44ea177896574363a261734d77f2d3ea` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:13:59.837097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=44ea177896574363a261734d77f2d3ea)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:13:59.839312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:13:59.870070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.883147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '44ea177896574363a261734d77f2d3ea'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.955733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.966891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:13:59.982038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.025379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] The token cache is being invalidate because project 44ea177896574363a261734d77f2d3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:00.027401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.031233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.050792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.063955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.065894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-83e761d9-3ff6-4457-9416-e4bad099e631 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '44ea177896574363a261734d77f2d3ea', 'request_id': 'req-83e761d9-3ff6-4457-9416-e4bad099e631'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.072523 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3341/6744] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:13:59 2022] DELETE /identity/v3/domains/44ea177896574363a261734d77f2d3ea => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:00.077520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:00.079147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:00.161042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d610b-327d-492f-88ad-66236b3b51c8 tempest-InheritsV3TestJSON-334527890 tempest-InheritsV3TestJSON-334527890-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:00.230989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:00.232862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:00.233876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:00.235631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] PATH_INFO: `/v3/users/0232b5cbfdec4bd5ad078ac58614b0e6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:00.238028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0232b5cbfdec4bd5ad078ac58614b0e6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:00.240593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:00.308296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0232b5cbfdec4bd5ad078ac58614b0e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.339897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0232b5cbfdec4bd5ad078ac58614b0e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.356212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0232b5cbfdec4bd5ad078ac58614b0e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.361276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0232b5cbfdec4bd5ad078ac58614b0e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.369967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0232b5cbfdec4bd5ad078ac58614b0e6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:00.394752 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3404/6745] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:00 2022] DELETE /identity/v3/users/0232b5cbfdec4bd5ad078ac58614b0e6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:00.397232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905540a-3a72-4264-8d10-2a737975abef None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:00.398281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905540a-3a72-4264-8d10-2a737975abef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:00.398548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905540a-3a72-4264-8d10-2a737975abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:00.421026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8905540a-3a72-4264-8d10-2a737975abef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:00.422357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8905540a-3a72-4264-8d10-2a737975abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:00.497125 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3342/6746] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:00.508262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:00.510368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:00.580213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a00af-60e8-43ec-8ea7-8fd38eaba68c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:00.584264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:00.585036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:00.585479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:00.585770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:00.597553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:00.599231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:00.612712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3405/6747] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:00.948918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905540a-3a72-4264-8d10-2a737975abef None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:00.950379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8905540a-3a72-4264-8d10-2a737975abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:00.964618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905540a-3a72-4264-8d10-2a737975abef None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:00.969576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:00.970683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:00.971134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:00.971573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] PATH_INFO: `/v3/projects/b569cd1844d147eebfcef616e5a569d9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:00.973026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b569cd1844d147eebfcef616e5a569d9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:00.976857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:01.029757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b569cd1844d147eebfcef616e5a569d9', 'request_id': 'req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.036048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b569cd1844d147eebfcef616e5a569d9', 'request_id': 'req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.044303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b569cd1844d147eebfcef616e5a569d9', 'request_id': 'req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.063541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] The token cache is being invalidate because project b569cd1844d147eebfcef616e5a569d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:01.064005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.065169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.067202 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3343/6748] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:00 2022] DELETE /identity/v3/projects/b569cd1844d147eebfcef616e5a569d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:01.071178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:01.082225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec9a1e-c15b-4155-b4ef-4f4f8061b178 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:01.149981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:01.151725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:01.152063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:01.152371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] PATH_INFO: `/v3/users/4667696970f347dc982adc22c2d6488c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:01.153855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4667696970f347dc982adc22c2d6488c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:01.155840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:01.208105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4667696970f347dc982adc22c2d6488c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.216608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4667696970f347dc982adc22c2d6488c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.217286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4667696970f347dc982adc22c2d6488c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.218001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4667696970f347dc982adc22c2d6488c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.228479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b2276369-f7c0-42a0-a176-b09e21723fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4667696970f347dc982adc22c2d6488c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.249293 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3406/6749] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:01 2022] DELETE /identity/v3/users/4667696970f347dc982adc22c2d6488c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:01.579490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:01.581620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:01.601802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa723a-631a-4527-8d4b-84b2ddbcd7d0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:01.724721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:01.726806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:01.727270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:01.727704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] PATH_INFO: `/v3/projects/5fee7a8ef6d04fb7923057500c19899a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:01.730197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fee7a8ef6d04fb7923057500c19899a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:01.733797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:01.814622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fee7a8ef6d04fb7923057500c19899a', 'request_id': 'req-113aa978-1e43-4b25-bbfa-eed1d756c386'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.837766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fee7a8ef6d04fb7923057500c19899a', 'request_id': 'req-113aa978-1e43-4b25-bbfa-eed1d756c386'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.845317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fee7a8ef6d04fb7923057500c19899a', 'request_id': 'req-113aa978-1e43-4b25-bbfa-eed1d756c386'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.862266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] The token cache is being invalidate because project 5fee7a8ef6d04fb7923057500c19899a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:01.863098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.865250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-113aa978-1e43-4b25-bbfa-eed1d756c386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:01.868035 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3344/6750] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:01 2022] DELETE /identity/v3/projects/5fee7a8ef6d04fb7923057500c19899a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:01.873100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:01.873598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:01.877965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:01.916883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:01.918129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:02.087706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3407/6751] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:02.096030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.096543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.096662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.123382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:02.125885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:02.138490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3345/6752] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:02.143019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.154332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95998cb9-2823-46ab-b897-3aedf80eb12d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.161194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.162209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.162735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.164003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.165033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:02.165564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.168121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.182398 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3408/6753] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:02.187362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.200771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d3d4d-cedb-458c-9cbc-3fc03321e797 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.206915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.207794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.208654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.209091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.209965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.213058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.260978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3346/6754] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:02 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:02.264285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.278899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6b79-c7ca-43df-b17b-e3bb3cb88296 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.418818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.419820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.420273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.420736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.421625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.423757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.459997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3409/6755] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:02 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:02.465034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.490945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45485b9-dd91-42b2-9992-6340df56866c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.501105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.502203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.503055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.503698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.504661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.510071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.526006 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3347/6756] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:02.530069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.546607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f82ea-05a5-47fc-8430-c7d633e299f4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.562259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.566567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.566869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.567150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.567893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.571979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a86da-c6d0-4ba1-a853-92edef0855b1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.591442 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3410/6757] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:02.595582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.612729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358602-fa6e-4fa2-9e38-df7e545877d8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.618442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.623506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.624596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.624916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] PATH_INFO: `/v3/projects/e5a809f3b83d41e98fe0a2f0766d7a95/users/31dd2ac054134b8fbb885f936327d3f5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.654781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a809f3b83d41e98fe0a2f0766d7a95, user_id=31dd2ac054134b8fbb885f936327d3f5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.658736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.686517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3348/6758] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:02 2022] PUT /identity/v3/projects/e5a809f3b83d41e98fe0a2f0766d7a95/users/31dd2ac054134b8fbb885f936327d3f5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:02.701465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.702058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.702586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.746364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] MFA Rules not processed for user `31dd2ac054134b8fbb885f936327d3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:02.747915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:02.840621 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3411/6759] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:02.845390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.945232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d12820-e2db-4353-a855-b1c689b960bb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.953261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:02.954705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:02.956405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.957463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.957908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.958366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.959231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:02.962521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:02.973583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b61f9-613f-487e-9620-8601e8e6527f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:02.990918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:02.992897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:02.994515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:02.994789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] PATH_INFO: `/v3/users/33e309d018fc4bc0a4ca5ff0e0311e40` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:02.997684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e309d018fc4bc0a4ca5ff0e0311e40)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.003000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.006138 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3349/6760] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:02 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:03.017593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.110477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0c5f7-8080-40a4-99f5-823ec94646f8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.115178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e309d018fc4bc0a4ca5ff0e0311e40'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:03.115926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.117415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.118165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.118616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.119326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.122095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.141312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e309d018fc4bc0a4ca5ff0e0311e40'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:03.143483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e309d018fc4bc0a4ca5ff0e0311e40'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:03.147094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e309d018fc4bc0a4ca5ff0e0311e40'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:03.156514 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3350/6761] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:03 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:03.157807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.160549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:03.177557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c12a3-3730-4f5d-92ef-76e201c94f43 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.184909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e268c891-cb57-4757-ac8d-a7bf3a543ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e309d018fc4bc0a4ca5ff0e0311e40'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:03.185912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.186876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.187375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.187845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.189149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.191547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.204124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3351/6762] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:03.208116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.230986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21984-ec19-4460-a1c0-f89d0cbc9899 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.236487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.237497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.237860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.238269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] PATH_INFO: `/v3/projects/5349f88b8f804a0eb7320c1f523c0419/users/9cb235077a93481db647ff847037e424/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.254929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3412/6763] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:02 2022] DELETE /identity/v3/users/33e309d018fc4bc0a4ca5ff0e0311e40 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:03.263192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.263801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.264284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.286717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:03.289088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:03.301433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5349f88b8f804a0eb7320c1f523c0419, user_id=9cb235077a93481db647ff847037e424, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.306596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.338054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3352/6764] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:03 2022] PUT /identity/v3/projects/5349f88b8f804a0eb7320c1f523c0419/users/9cb235077a93481db647ff847037e424/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:03.342260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.427112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e5d2-2191-4c15-9ec4-8c8461812f29 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.433266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.434001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.434237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.434575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.435311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.436594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3413/6765] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:03.440477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.452380 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3353/6766] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:03.457557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.466056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.467802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:03.477939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1d5c8-fbde-44e7-aaf2-b1e3fbccd4a8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.488124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.489653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.489879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.490529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] PATH_INFO: `/v3/projects/5349f88b8f804a0eb7320c1f523c0419/users/9cb235077a93481db647ff847037e424/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.496845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5349f88b8f804a0eb7320c1f523c0419, user_id=9cb235077a93481db647ff847037e424, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.503870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0b20-3b12-4923-ac65-b235ca16868e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.520036 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3414/6767] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:03 2022] PUT /identity/v3/projects/5349f88b8f804a0eb7320c1f523c0419/users/9cb235077a93481db647ff847037e424/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:03.531996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.532287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.532777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.551839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec767b41-3a36-49fe-bb82-ce58c3ae23c2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.563281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] MFA Rules not processed for user `9cb235077a93481db647ff847037e424`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:03.564130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:03.606469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.607133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.607422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.607701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.648088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3415/6768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:03.653032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.664053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf1f4-9e15-46de-8fb4-8bf6333dfafc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.669217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb235077a93481db647ff847037e424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5349f88b8f804a0eb7320c1f523c0419', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.669883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.670177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.670616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.671308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.673477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.682988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.687370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:03.707615 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3354/6769] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:03.723625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3416/6770] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:03 2022] POST /identity/v3/projects => generated 359 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:03.727467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.730065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:03.807899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395bf83-65b3-4deb-8372-e1b203e2254f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.866999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31dd2ac054134b8fbb885f936327d3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5a809f3b83d41e98fe0a2f0766d7a95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.868027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.868322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.868645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] PATH_INFO: `/v3/projects/be543e11a1c9492fabac078fbd21c9e2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.870033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] RBAC: Authorizing `identity:delete_project(project_id=be543e11a1c9492fabac078fbd21c9e2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.880777 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Apr 02 21:14:03.885507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3355/6771] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:03 2022] DELETE /identity/v3/projects/be543e11a1c9492fabac078fbd21c9e2 => generated 136 bytes in 156 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:14:03.887288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:03.952956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c6868-3f78-484c-8d2c-f2d19519379b tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:03.958486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb235077a93481db647ff847037e424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5349f88b8f804a0eb7320c1f523c0419', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:03.959367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:03.959658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:03.959940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] PATH_INFO: `/v3/projects/be543e11a1c9492fabac078fbd21c9e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:03.961875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: Authorizing `identity:delete_project(project_id=be543e11a1c9492fabac078fbd21c9e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:03.964041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.010404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be543e11a1c9492fabac078fbd21c9e2', 'request_id': 'req-be89a204-1436-43e3-93da-bf0f1c926951'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.016922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be543e11a1c9492fabac078fbd21c9e2', 'request_id': 'req-be89a204-1436-43e3-93da-bf0f1c926951'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.029659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be543e11a1c9492fabac078fbd21c9e2', 'request_id': 'req-be89a204-1436-43e3-93da-bf0f1c926951'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.041016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] The token cache is being invalidate because project be543e11a1c9492fabac078fbd21c9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:04.041476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.042353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.044490 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3417/6772] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:03 2022] DELETE /identity/v3/projects/be543e11a1c9492fabac078fbd21c9e2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:04.049708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.051500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.120728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf95ac-be99-41cf-a728-e5c94ae85d80 tempest-ProjectsNegativeTestJSON-90260022 tempest-ProjectsNegativeTestJSON-90260022-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.152335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.155154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.206343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.207295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.207576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.207922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] PATH_INFO: `/v3/users/31dd2ac054134b8fbb885f936327d3f5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.209268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31dd2ac054134b8fbb885f936327d3f5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.211394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.230449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a204-1436-43e3-93da-bf0f1c926951 tempest-ProjectsNegativeTestJSON-691230683 tempest-ProjectsNegativeTestJSON-691230683-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.235174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.236164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.236602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.236952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] PATH_INFO: `/v3/projects/f225bd13fc8c4322bda129069fb71d7c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.238662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f225bd13fc8c4322bda129069fb71d7c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.240726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.266879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31dd2ac054134b8fbb885f936327d3f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.279318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31dd2ac054134b8fbb885f936327d3f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.280082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31dd2ac054134b8fbb885f936327d3f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.288184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31dd2ac054134b8fbb885f936327d3f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.296332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-14b41637-add3-4501-bce5-e30488daa124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31dd2ac054134b8fbb885f936327d3f5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.302716 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3356/6773] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:04 2022] DELETE /identity/v3/users/31dd2ac054134b8fbb885f936327d3f5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:04.304548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f225bd13fc8c4322bda129069fb71d7c', 'request_id': 'req-b14eb82d-02a0-4b15-8de3-e0093a9e3051'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.307836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.308262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.308871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.312165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f225bd13fc8c4322bda129069fb71d7c', 'request_id': 'req-b14eb82d-02a0-4b15-8de3-e0093a9e3051'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.321507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f225bd13fc8c4322bda129069fb71d7c', 'request_id': 'req-b14eb82d-02a0-4b15-8de3-e0093a9e3051'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.327611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:04.329235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.333377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] The token cache is being invalidate because project f225bd13fc8c4322bda129069fb71d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:04.333854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.335300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b14eb82d-02a0-4b15-8de3-e0093a9e3051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:04.337146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3418/6774] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:04 2022] DELETE /identity/v3/projects/f225bd13fc8c4322bda129069fb71d7c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:04.343712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a363-3f62-4e69-a946-919e948b1070 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.345224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a363-3f62-4e69-a946-919e948b1070 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.345519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835a363-3f62-4e69-a946-919e948b1070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.369909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c835a363-3f62-4e69-a946-919e948b1070 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:04.371178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c835a363-3f62-4e69-a946-919e948b1070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.402469 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3357/6775] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:04.412597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.414296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.461546 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3419/6776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:04.471842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.471842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.471842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.491064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:04.493101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:04.508292 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3420/6777] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:04.509785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.515685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8bb0-8818-4696-9d6d-4da4f2cda13d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.520768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.521465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b604a-fd8f-429e-aaad-e06a01012c1b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.523667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.523900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.524175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.527661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.528575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.528869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.529200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.530094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:04.530449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.534552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.542774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.550591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.552397 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3421/6778] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:04.553322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.568357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1288a8-4508-4491-9fa4-e81aef525462 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.575063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3358/6779] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:04.578143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.579399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.579890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.580991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.582182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.584554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.633915 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3422/6780] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:04.635167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.647237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06887a0d-4595-48e8-9056-8d62a3180894 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.719411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.720242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.720559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.720840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.721528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.723547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.758238 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3359/6781] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:04.762094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.779627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9961f33-4c29-49dc-81bc-24c711c383f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.789065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.792203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.792203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.792203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.792203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.792911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.812652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3423/6782] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:04.814513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.832325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc76b5-fd58-4b5b-9e41-a2a4a32cc8a5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.841403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.842141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.842516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.843602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.843985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.845900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845229-941f-4921-a5c7-a47d64e74064 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.862754 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3360/6783] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:04.864418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.877563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dfae7-4f51-4be8-b64e-3f5a7959d8fb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:04.888352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:04.889499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.889884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.890317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] PATH_INFO: `/v3/projects/752dbe7fcf844bb881addb074467167e/users/d74819209d5f45a5ae75ba6e5c9429b8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.911094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752dbe7fcf844bb881addb074467167e, user_id=d74819209d5f45a5ae75ba6e5c9429b8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:04.914868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:04.957004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:04.957301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:04.957588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:04.959929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3424/6784] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:04 2022] PUT /identity/v3/projects/752dbe7fcf844bb881addb074467167e/users/d74819209d5f45a5ae75ba6e5c9429b8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:04.972206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:04.975147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:05.022228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] MFA Rules not processed for user `d74819209d5f45a5ae75ba6e5c9429b8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:05.023547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:05.087523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab311f-5a93-4671-832b-f8233108a661 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:05.092478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:05.093538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:05.093788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:05.094077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] PATH_INFO: `/v3/projects/e5a809f3b83d41e98fe0a2f0766d7a95` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:05.095514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a809f3b83d41e98fe0a2f0766d7a95)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:05.098222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:05.153282 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3361/6785] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:05.162840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:05.164560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:05.172038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a809f3b83d41e98fe0a2f0766d7a95', 'request_id': 'req-31c89ac0-34ce-4c3e-97b0-00ef935944d8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.179340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a809f3b83d41e98fe0a2f0766d7a95', 'request_id': 'req-31c89ac0-34ce-4c3e-97b0-00ef935944d8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.189146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a809f3b83d41e98fe0a2f0766d7a95', 'request_id': 'req-31c89ac0-34ce-4c3e-97b0-00ef935944d8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.201363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] The token cache is being invalidate because project e5a809f3b83d41e98fe0a2f0766d7a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:05.201942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.202766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.204916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3425/6786] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:04 2022] DELETE /identity/v3/projects/e5a809f3b83d41e98fe0a2f0766d7a95 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:05.208392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:05.209932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:05.246424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376832-fd65-4110-b89d-7c6a20b61516 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:05.280398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89ac0-34ce-4c3e-97b0-00ef935944d8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:05.285372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:05.286334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:05.286807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:05.287511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] PATH_INFO: `/v3/users/9cb235077a93481db647ff847037e424` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:05.289066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb235077a93481db647ff847037e424)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:05.291290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:05.300260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:05.300967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:05.301260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:05.301533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:05.303555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:05.348782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb235077a93481db647ff847037e424'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.357953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb235077a93481db647ff847037e424'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.358757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb235077a93481db647ff847037e424'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.359554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb235077a93481db647ff847037e424'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.368147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f84166c1-1e1b-49da-9152-99f4f71896b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb235077a93481db647ff847037e424'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:05.382309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:05.384293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:05.395160 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3362/6787] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:05.399577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3426/6788] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:05 2022] DELETE /identity/v3/users/9cb235077a93481db647ff847037e424 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:05.866438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:05.881730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520061-a5d6-4056-b906-8abd9fbb1b72 service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.004152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.005441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.005860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.006242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] PATH_INFO: `/v3/projects/5349f88b8f804a0eb7320c1f523c0419` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.007853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5349f88b8f804a0eb7320c1f523c0419)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.010206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.085699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5349f88b8f804a0eb7320c1f523c0419', 'request_id': 'req-3252e676-bad0-474f-ad38-193f498f46ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:06.094671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5349f88b8f804a0eb7320c1f523c0419', 'request_id': 'req-3252e676-bad0-474f-ad38-193f498f46ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:06.110019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5349f88b8f804a0eb7320c1f523c0419', 'request_id': 'req-3252e676-bad0-474f-ad38-193f498f46ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:06.138510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] The token cache is being invalidate because project 5349f88b8f804a0eb7320c1f523c0419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:06.138830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:06.139740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3252e676-bad0-474f-ad38-193f498f46ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:06.142001 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3363/6789] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:05 2022] DELETE /identity/v3/projects/5349f88b8f804a0eb7320c1f523c0419 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:06.147506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.147984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.148125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.176280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:06.177826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:06.254789 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3427/6790] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:06.264598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.265022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.265355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.287878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:06.289698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:06.309370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.315306 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3364/6791] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:06.330875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c201d2-1018-4feb-b302-0d90a1adc050 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.338723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.339418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.340172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.340488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.341483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:06.341606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.343832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.364114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.370751 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3428/6792] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:06.374543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a8b33-5842-47ab-9c53-d404efc588c6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.382570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.383485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.383958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.384427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.385327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.387456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.426815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3365/6793] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:06.429856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.480483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09686ab-1271-45aa-b411-2a806a4f6636 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.558458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.559150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.559624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.560089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.561476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.564115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.596289 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3429/6794] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:06.597856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.608951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f9d48-f92d-4c66-85ac-3ad52ad9c542 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.613630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.614294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.614577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.614850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.615594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.617259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.628419 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3366/6795] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:06.632387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.642680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4575-75e7-45df-8cc7-4c882cd9063e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.647306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.648528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.648819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.649097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.649872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.651472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fea17-26ae-468e-b700-5d264ddbaa05 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.661612 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3430/6796] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:06.666578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.676485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fd7c-07b3-404e-91d5-43dfe199c660 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.681773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.682701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.682993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.683278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] PATH_INFO: `/v3/projects/57a2bf6f886b44f7bd45eb336c559033/users/1c6311708a01499aba4823cf63632482/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.699209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a2bf6f886b44f7bd45eb336c559033, user_id=1c6311708a01499aba4823cf63632482, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.702422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.716084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3367/6797] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:06 2022] PUT /identity/v3/projects/57a2bf6f886b44f7bd45eb336c559033/users/1c6311708a01499aba4823cf63632482/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:06.727504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.727800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.728087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.756159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] MFA Rules not processed for user `1c6311708a01499aba4823cf63632482`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:06.758321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:06.822434 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3431/6798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:06.826792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.892565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27840-b5cc-46cf-998a-2ff3d6753f67 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:06.898350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:06.899014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:06.899427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:06.900388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:06.901130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:06.903032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:06.930527 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3368/6799] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:06.935040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:06.948803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eff398-d3c9-4bd7-ac6b-913ef6562d8c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.015222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.016067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.016582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.016938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.017708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.019754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.044463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3432/6800] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:06 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:07.049139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.062305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a418b5-f2b2-4524-a96d-4300dfafe8d7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.067978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.068832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.069125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.069941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.070676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.072377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.088276 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3369/6801] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:07.092625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.103327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997975b2-cd65-4e74-a75a-a7ff40e02338 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.108057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.109124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.109413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.109693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] PATH_INFO: `/v3/projects/bce3f86df37f48908dcd220706b4d1c7/users/cd89d2174f874fb29d67a8ac08d8b187/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.126454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce3f86df37f48908dcd220706b4d1c7, user_id=cd89d2174f874fb29d67a8ac08d8b187, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.129286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.150883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3433/6802] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:07 2022] PUT /identity/v3/projects/bce3f86df37f48908dcd220706b4d1c7/users/cd89d2174f874fb29d67a8ac08d8b187/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:07.154995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.168137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0188-36d0-4360-a86b-9f453628ac27 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.237989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.239230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.239767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.240235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.241760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.243883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fb6d6-c90a-44c6-b530-48c33610f981 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.260498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3370/6803] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:07.263754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.274927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abcc5f-00ed-40aa-9323-8134e6685fb7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.280371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.281728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.282015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.282292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] PATH_INFO: `/v3/projects/bce3f86df37f48908dcd220706b4d1c7/users/cd89d2174f874fb29d67a8ac08d8b187/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.284348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce3f86df37f48908dcd220706b4d1c7, user_id=cd89d2174f874fb29d67a8ac08d8b187, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.287537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.298799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3434/6804] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:07 2022] PUT /identity/v3/projects/bce3f86df37f48908dcd220706b4d1c7/users/cd89d2174f874fb29d67a8ac08d8b187/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:07.310993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.311277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.311741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.345009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] MFA Rules not processed for user `cd89d2174f874fb29d67a8ac08d8b187`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:07.347288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:07.426422 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3371/6805] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:07.432195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.451886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6004ad-2b58-4a77-a333-9493ab194848 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.459314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.460373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.460934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.461378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.462069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.465406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.501679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3435/6806] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:07 2022] POST /identity/v3/projects => generated 358 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:07.506044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.516633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361bfe6-d87d-41ac-af91-2637e33b7d8b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.590060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.591621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.592180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.592564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.593916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.595972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.630267 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3372/6807] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:07 2022] POST /identity/v3/users => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:07.634783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.685689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2235-43d7-46b9-82a9-dae2c2d760e4 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.696805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.698017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.698351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.698777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.699418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:07.699735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.702708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1aa59-1351-4ff3-a5fd-40c8b1ba5025 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.752796 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3436/6808] 10.222.0.18 () {58 vars in 1156 bytes} [Sat Apr 2 21:14:07 2022] GET /identity/v3/users?domain_id=default => generated 7710 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:07.757911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:07.782282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d671d-f453-4bfa-b5d7-4d3747aaf97b tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:07.803320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:07.806516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.806869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.807357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/users/6f00de444f474c30852399e801ff5604` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.848992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:update_user(user_id=6f00de444f474c30852399e801ff5604)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:07.851964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:07.909717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:07.928034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invalidating the token cache because user 6f00de444f474c30852399e801ff5604 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:07.929139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:07.934913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:07.946995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3373/6809] 10.222.0.18 () {60 vars in 1243 bytes} [Sat Apr 2 21:14:07 2022] PATCH /identity/v3/users/6f00de444f474c30852399e801ff5604 => generated 485 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:07.948025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:07.948326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:07.948665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:07.966572 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.auth.plugins.core [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] User is disabled: 6f00de444f474c30852399e801ff5604: AssertionError: User is disabled: 6f00de444f474c30852399e801ff5604 Apr 02 21:14:07.989236 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:14:08.003642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:08.005725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:08.007064 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3437/6810] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 61 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 02 21:14:08.026497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60440938-17b8-49ea-a7a4-cf18cb8eba03 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:08.033687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:08.035215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:08.035598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:08.035888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/users/6f00de444f474c30852399e801ff5604` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:08.064881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6f00de444f474c30852399e801ff5604)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:08.067762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:08.126781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.147136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.148413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.157795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.169276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f00de444f474c30852399e801ff5604'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.180853 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3374/6811] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:08 2022] DELETE /identity/v3/users/6f00de444f474c30852399e801ff5604 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:08.183085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:08.185738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:08.277327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de587076-93ca-4ad1-bc6d-3700905b3f9f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:08.282615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:08.283853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:08.284154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:08.285042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/projects/6a26a1200b2a4c15bace2cd678be2767` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:08.286989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a26a1200b2a4c15bace2cd678be2767)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:08.289772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:08.390974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a26a1200b2a4c15bace2cd678be2767', 'request_id': 'req-7b3c6272-b7de-4d52-a508-361a0f8fd3af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.413494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a26a1200b2a4c15bace2cd678be2767', 'request_id': 'req-7b3c6272-b7de-4d52-a508-361a0f8fd3af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.432540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a26a1200b2a4c15bace2cd678be2767', 'request_id': 'req-7b3c6272-b7de-4d52-a508-361a0f8fd3af'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.482882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] The token cache is being invalidate because project 6a26a1200b2a4c15bace2cd678be2767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:08.485827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.492943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.495028 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3438/6812] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:08 2022] DELETE /identity/v3/projects/6a26a1200b2a4c15bace2cd678be2767 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:08.501777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:08.524473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c079-bf56-46e3-874e-d5552f8a15e1 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:08.613269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd89d2174f874fb29d67a8ac08d8b187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bce3f86df37f48908dcd220706b4d1c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:08.614077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:08.614383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:08.614675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:08.615525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:08.620908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:08.638921 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1120d0bb-7b6a-45cb-998b-67ba89977984 tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Could not find domain: ab6c676c820e4a27971f3b8535142884.: keystone.exception.DomainNotFound: Could not find domain: ab6c676c820e4a27971f3b8535142884. Apr 02 21:14:08.645724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:08.646060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3375/6813] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:08 2022] POST /identity/v3/users => generated 112 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:14:08.648975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:08.771158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6272-b7de-4d52-a508-361a0f8fd3af tempest-UsersNegativeTest-1425838605 tempest-UsersNegativeTest-1425838605-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:08.777382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:08.778661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:08.779183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:08.780183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] PATH_INFO: `/v3/users/1c6311708a01499aba4823cf63632482` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:08.782008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6311708a01499aba4823cf63632482)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:08.784196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:08.851563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6311708a01499aba4823cf63632482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.863784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6311708a01499aba4823cf63632482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.865727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6311708a01499aba4823cf63632482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.867417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6311708a01499aba4823cf63632482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.878149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6311708a01499aba4823cf63632482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:08.897540 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3439/6814] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:08 2022] DELETE /identity/v3/users/1c6311708a01499aba4823cf63632482 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:08.902118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:08.902414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:08.902701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:08.922179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:08.923635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:08.997320 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3376/6815] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:09.007172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:09.008726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:09.080598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c3997-7c3b-4aac-8bc9-2ca1e6497cc5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:09.085354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:09.086299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:09.086652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:09.087050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:09.097899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:09.100063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:09.114276 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3440/6816] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:09.471636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:09.473202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:09.490879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1cc28-0f83-48d4-8340-827f1a2d5f32 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:09.508802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:09.513048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:09.513320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:09.513683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] PATH_INFO: `/v3/projects/57a2bf6f886b44f7bd45eb336c559033` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:09.514988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a2bf6f886b44f7bd45eb336c559033)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:09.517265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:09.587460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a2bf6f886b44f7bd45eb336c559033', 'request_id': 'req-068dc260-ddb8-4489-bcb8-25d996a52363'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.595386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a2bf6f886b44f7bd45eb336c559033', 'request_id': 'req-068dc260-ddb8-4489-bcb8-25d996a52363'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.604131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a2bf6f886b44f7bd45eb336c559033', 'request_id': 'req-068dc260-ddb8-4489-bcb8-25d996a52363'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.624120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] The token cache is being invalidate because project 57a2bf6f886b44f7bd45eb336c559033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:09.625229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.636084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.636084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3377/6817] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:09 2022] DELETE /identity/v3/projects/57a2bf6f886b44f7bd45eb336c559033 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:09.639057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:09.650913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f3271-d168-4947-a883-228f1e598559 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:09.733030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:09.734069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:09.734363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:09.734640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] PATH_INFO: `/v3/users/cd89d2174f874fb29d67a8ac08d8b187` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:09.736194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd89d2174f874fb29d67a8ac08d8b187)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:09.738318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:09.839051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd89d2174f874fb29d67a8ac08d8b187'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.849796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd89d2174f874fb29d67a8ac08d8b187'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.852311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd89d2174f874fb29d67a8ac08d8b187'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.853298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd89d2174f874fb29d67a8ac08d8b187'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.860855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7989a986-fd2c-4fa4-a8a9-8c4727541980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd89d2174f874fb29d67a8ac08d8b187'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:09.879867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3441/6818] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:09 2022] DELETE /identity/v3/users/cd89d2174f874fb29d67a8ac08d8b187 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:10.505140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:10.506609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:10.528086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068dc260-ddb8-4489-bcb8-25d996a52363 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:10.620700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:10.621830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:10.622363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:10.623036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] PATH_INFO: `/v3/projects/bce3f86df37f48908dcd220706b4d1c7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:10.624537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce3f86df37f48908dcd220706b4d1c7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:10.626605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:10.684871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce3f86df37f48908dcd220706b4d1c7', 'request_id': 'req-a557bfce-39f4-44b4-96c4-cde52194508f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:10.691750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce3f86df37f48908dcd220706b4d1c7', 'request_id': 'req-a557bfce-39f4-44b4-96c4-cde52194508f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:10.700600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce3f86df37f48908dcd220706b4d1c7', 'request_id': 'req-a557bfce-39f4-44b4-96c4-cde52194508f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:10.716805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] The token cache is being invalidate because project bce3f86df37f48908dcd220706b4d1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:10.717263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:10.718607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a557bfce-39f4-44b4-96c4-cde52194508f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:10.720448 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3378/6819] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:10 2022] DELETE /identity/v3/projects/bce3f86df37f48908dcd220706b4d1c7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:10.726863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:10.727344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:10.727720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:10.749939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:10.751313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:10.842964 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3442/6820] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:10.851241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:10.851579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:10.851822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:10.910096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:10.914237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:10.930348 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3379/6821] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:10.934932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:10.951782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad82abf-b9fd-4688-a19c-938b42052276 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:10.962270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:10.962938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:10.963309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:10.963729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:10.964668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:10.965053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:10.968084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.035089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3443/6822] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:11.039594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.054363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0db550-f4df-42ac-98fb-5782043a77a7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.070995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.071760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.071959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.072515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.073211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.079947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.127273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3380/6823] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:11 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:11.131736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.148185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f967-fcb9-4d79-a748-6f2df3066654 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.237397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.238121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.238409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.238690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.239394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.242183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.274852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3444/6824] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:11 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:11.279008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.290899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090ba8-dac7-41ed-8a60-3d10f208bfd2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.297905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.298747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.299362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.299906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.301176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.303432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.323151 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3381/6825] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:11.324413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.338752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b14e-8d14-462f-9a5c-14685d1dc934 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.350289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.351888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.352526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.352759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.353541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.356491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847f1af-cecf-4f00-a8a1-ba931ef62d3e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.370776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3445/6826] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:11.374997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.385680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89199304-fec8-431c-9502-d63a8309d115 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.392228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.393985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.396136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.397323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] PATH_INFO: `/v3/projects/cf695913dab446e3ae21694253a3e58d/users/ead2fcb6f0b541298248aafbd4b2f6bb/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.440489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf695913dab446e3ae21694253a3e58d, user_id=ead2fcb6f0b541298248aafbd4b2f6bb, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.447191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.497832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3382/6827] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:11 2022] PUT /identity/v3/projects/cf695913dab446e3ae21694253a3e58d/users/ead2fcb6f0b541298248aafbd4b2f6bb/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:11.498244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.498559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.498850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.538571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] MFA Rules not processed for user `ead2fcb6f0b541298248aafbd4b2f6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:11.539825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:11.640618 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3446/6828] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:11.645141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.717750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679bd2-950b-40c2-9762-a28824befd12 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.723225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.724039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.724433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.725126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.726260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.728560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.758184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3383/6829] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:11 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:11.762380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.774558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac425b-a453-47f2-a137-24a27bcdb9f2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.840996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.841678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.841964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.842242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.842927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.844872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.868152 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3447/6830] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:11 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:11.869002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.879323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ace48-8931-40a6-a770-e5b1de2eabaa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.884195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.884960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.885249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.885534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.886259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.887925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.899946 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3384/6831] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:11.904022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.915010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c530-de64-4dc1-a00b-2a905b21e66d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.926194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.926899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.927189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.927473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.929330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.931358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee99c-4225-44c3-aba9-3089dbeeb264 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:11.949079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3448/6832] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:11.953217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:11.963613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2e378-7796-4ada-b6ed-c698b675bf8d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:11.968427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:11.969349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:11.969640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:11.969938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] PATH_INFO: `/v3/projects/a4502ae88bee43eea3be803e50344e2c/users/abc44485ad174efbb82a82be9a215c53/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:11.985008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4502ae88bee43eea3be803e50344e2c, user_id=abc44485ad174efbb82a82be9a215c53, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:11.987672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:12.015046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3385/6833] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:11 2022] PUT /identity/v3/projects/a4502ae88bee43eea3be803e50344e2c/users/abc44485ad174efbb82a82be9a215c53/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:12.096852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceaa4c-3e69-491a-8ccb-1f119b26c926 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.097276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceaa4c-3e69-491a-8ccb-1f119b26c926 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.097446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceaa4c-3e69-491a-8ccb-1f119b26c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.131676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-39ceaa4c-3e69-491a-8ccb-1f119b26c926 None None] MFA Rules not processed for user `abc44485ad174efbb82a82be9a215c53`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:12.133389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39ceaa4c-3e69-491a-8ccb-1f119b26c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:12.207418 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3449/6834] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:12.213046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:12.300884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f79228-b9f9-4850-8416-d54435bd42a5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:12.305920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ead2fcb6f0b541298248aafbd4b2f6bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf695913dab446e3ae21694253a3e58d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:12.306805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.307202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.307366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] PATH_INFO: `/v3/users/ead2fcb6f0b541298248aafbd4b2f6bb/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.308834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] RBAC: Authorizing `identity:list_user_projects(user_id=ead2fcb6f0b541298248aafbd4b2f6bb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:12.310671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb64cd-60fd-473b-afd5-a1a250ef5046 tempest-IdentityV3ProjectsTest-1369159405 tempest-IdentityV3ProjectsTest-1369159405-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:12.362062 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3386/6835] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:14:12 2022] GET /identity/v3/users/ead2fcb6f0b541298248aafbd4b2f6bb/projects => generated 517 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:12.362700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.363514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.363514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.408334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] MFA Rules not processed for user `ead2fcb6f0b541298248aafbd4b2f6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:12.409755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:12.424528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.425062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.425568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.431492 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3450/6836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:12.459158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] MFA Rules not processed for user `ead2fcb6f0b541298248aafbd4b2f6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:12.465657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:12.541437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.models.token_model [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] User ead2fcb6f0b541298248aafbd4b2f6bb has no access to project a4502ae88bee43eea3be803e50344e2c {{(pid=97316) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Apr 02 21:14:12.546614 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-e157d670-b743-45bd-9b12-40ef0886d8a7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 02 21:14:12.548497 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3387/6837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:12 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 125 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 02 21:14:12.556012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:12.651207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861b1b6-0712-4355-a369-8dfd2227ec65 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:12.656934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:12.657833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.659580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.660321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] PATH_INFO: `/v3/users/ead2fcb6f0b541298248aafbd4b2f6bb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.661786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead2fcb6f0b541298248aafbd4b2f6bb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:12.665463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:12.745577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead2fcb6f0b541298248aafbd4b2f6bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:12.761040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead2fcb6f0b541298248aafbd4b2f6bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:12.761670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead2fcb6f0b541298248aafbd4b2f6bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:12.762286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead2fcb6f0b541298248aafbd4b2f6bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:12.779349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead2fcb6f0b541298248aafbd4b2f6bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:12.815094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3451/6838] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:12 2022] DELETE /identity/v3/users/ead2fcb6f0b541298248aafbd4b2f6bb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:12.820583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:12.821164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:12.821269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:12.844000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:12.845886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:12.940652 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3388/6839] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:12.952420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:12.953925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:13.025023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f4d0-69c3-4e90-9c12-c67b4c5d8811 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:13.028955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:13.029685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:13.029971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:13.030252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:13.041198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:13.042698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:13.054386 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3452/6840] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:13.592790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:13.594247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:13.624845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeb357-4b76-4e49-857b-aea18b05c219 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:13.645208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:13.646965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:13.647391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:13.648019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] PATH_INFO: `/v3/projects/cf695913dab446e3ae21694253a3e58d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:13.657054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf695913dab446e3ae21694253a3e58d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:13.659813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:13.757564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf695913dab446e3ae21694253a3e58d', 'request_id': 'req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:13.769938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf695913dab446e3ae21694253a3e58d', 'request_id': 'req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:13.776147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf695913dab446e3ae21694253a3e58d', 'request_id': 'req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:13.801768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] The token cache is being invalidate because project cf695913dab446e3ae21694253a3e58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:13.802194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:13.803100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:13.806614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3389/6841] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:13 2022] DELETE /identity/v3/projects/cf695913dab446e3ae21694253a3e58d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:13.811133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:13.826689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5729ee-b2b2-49d9-93f4-908e962a87de service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:13.922094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:13.923563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:13.923837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:13.924116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] PATH_INFO: `/v3/users/abc44485ad174efbb82a82be9a215c53` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:13.926116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc44485ad174efbb82a82be9a215c53)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:13.928249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:14.000195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc44485ad174efbb82a82be9a215c53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.012338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc44485ad174efbb82a82be9a215c53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.013147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc44485ad174efbb82a82be9a215c53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.014015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc44485ad174efbb82a82be9a215c53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.027375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36e6cbb3-373b-4474-844c-1a6b50d11ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc44485ad174efbb82a82be9a215c53'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.054195 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3453/6842] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:13 2022] DELETE /identity/v3/users/abc44485ad174efbb82a82be9a215c53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:14.427364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:14.430337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:14.450449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ad7a-3ba5-4888-841a-3ff16b558f83 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:14.524246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:14.525244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:14.525715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:14.526248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] PATH_INFO: `/v3/projects/a4502ae88bee43eea3be803e50344e2c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:14.528979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4502ae88bee43eea3be803e50344e2c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:14.531049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:14.586293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4502ae88bee43eea3be803e50344e2c', 'request_id': 'req-65e93083-0450-4d10-b140-510dba33ffa6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.593766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4502ae88bee43eea3be803e50344e2c', 'request_id': 'req-65e93083-0450-4d10-b140-510dba33ffa6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.601446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4502ae88bee43eea3be803e50344e2c', 'request_id': 'req-65e93083-0450-4d10-b140-510dba33ffa6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.629738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] The token cache is being invalidate because project a4502ae88bee43eea3be803e50344e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:14.630037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.631036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-65e93083-0450-4d10-b140-510dba33ffa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:14.633254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3390/6843] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:14 2022] DELETE /identity/v3/projects/a4502ae88bee43eea3be803e50344e2c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:14.641881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:14.642303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:14.642804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:14.667355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:14.668646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:14.754908 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3454/6844] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:14.763872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:14.764209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:14.764479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:14.797926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:14.800075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:14.823751 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3391/6845] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:14.828093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:14.845877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bf0e7-2fac-4dc7-966c-b2623bd3754b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:14.853552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:14.854448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:14.854745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:14.855145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:14.855980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:14.856526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:14.858314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:14.876355 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3455/6846] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:14:14.881583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:14.897797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98344a1-67b2-4512-aec1-8d788efec49d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:14.916063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:14.916863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:14.917384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:14.917700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:14.918452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:14.920383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:14.971493 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3392/6847] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:14 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:14.975291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:14.994579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a1e87-dabd-4c55-b7d7-67b75d0a88b8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.099564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.100341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.100675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.100972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.102010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.104119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.132520 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3456/6848] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:14 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:15.139742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:15.153927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e0be-6234-4dfa-974d-18f33d71ddd9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.160634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.161491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.161786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.162124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.165773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.168233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.191363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3393/6849] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:15.196382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:15.213454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a43f83-e957-4023-8c72-e9a6792e04ec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.221693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.222332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.222773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.222970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.223761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.225521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42c321-843d-42f7-bdb5-fcc72cf011e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.247689 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3457/6850] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:15.251053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:15.265358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc5017-23c2-4b2f-92f1-db5d94efaa1e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.271894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.275478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.275777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.276061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] PATH_INFO: `/v3/projects/e0f5b378586b4cec9ca62ed65dd8e2f0/users/bfa87a9e67dd45a18b82eb298b7b0142/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.299235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f5b378586b4cec9ca62ed65dd8e2f0, user_id=bfa87a9e67dd45a18b82eb298b7b0142, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.301968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.318507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3394/6851] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:15 2022] PUT /identity/v3/projects/e0f5b378586b4cec9ca62ed65dd8e2f0/users/bfa87a9e67dd45a18b82eb298b7b0142/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:15.331216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.331216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.331216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.359140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] MFA Rules not processed for user `bfa87a9e67dd45a18b82eb298b7b0142`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:15.360483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:15.428275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3458/6852] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:15.441481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:15.443530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:15.511602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008e6e8-c626-4941-8ed6-e172e8551a6a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.515304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.515959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.516252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.516568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.525114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.526557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2261e-6bd7-4aef-8bce-a90f8a33c80a service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.535739 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3395/6853] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:15.713816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:15.793067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdab3a-481e-42cb-bf53-925fee4dbdc7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:15.797802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:15.798684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.798968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.799243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] PATH_INFO: `/v3/users/bfa87a9e67dd45a18b82eb298b7b0142` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.800472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa87a9e67dd45a18b82eb298b7b0142)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:15.802400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:15.882396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa87a9e67dd45a18b82eb298b7b0142'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:15.897511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa87a9e67dd45a18b82eb298b7b0142'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:15.898302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa87a9e67dd45a18b82eb298b7b0142'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:15.899087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa87a9e67dd45a18b82eb298b7b0142'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:15.911216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa87a9e67dd45a18b82eb298b7b0142'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:15.944421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3459/6854] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:15 2022] DELETE /identity/v3/users/bfa87a9e67dd45a18b82eb298b7b0142 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:15.948747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:15.949231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:15.949684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:15.981449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:15.984712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:16.082139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3396/6855] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:16.090696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:16.093133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:16.179548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25fc02-8346-4edb-80ad-c7e8d1f0833c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:16.186098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:16.188379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:16.189068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:16.189350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:16.201399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:16.203054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df504-f9e1-46fb-9672-a5d8db959c86 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:16.214483 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3460/6856] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:16.675621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:16.678993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:16.708362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218eae8-98ae-4a87-9a93-452585c1b794 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:16.716133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:16.717508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:16.717830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:16.718300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] PATH_INFO: `/v3/projects/e0f5b378586b4cec9ca62ed65dd8e2f0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:16.720033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f5b378586b4cec9ca62ed65dd8e2f0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:16.722744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:16.789303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f5b378586b4cec9ca62ed65dd8e2f0', 'request_id': 'req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:16.796270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f5b378586b4cec9ca62ed65dd8e2f0', 'request_id': 'req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:16.803915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f5b378586b4cec9ca62ed65dd8e2f0', 'request_id': 'req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:16.820213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] The token cache is being invalidate because project e0f5b378586b4cec9ca62ed65dd8e2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:16.822931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:16.825141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-569a03d7-7ad6-4075-81f1-8caa3f3ba69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:16.829457 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3397/6857] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:16 2022] DELETE /identity/v3/projects/e0f5b378586b4cec9ca62ed65dd8e2f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:16.834415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:16.835313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:16.835665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:16.862045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:16.863202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:16.981382 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3461/6858] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:16.982672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:16.983332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:16.983776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.016272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:17.017550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:17.034018 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3398/6859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:17.038663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.049724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8c7d9-d511-4348-a32a-37c8f94d1a80 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.059463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.060251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.060767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.061149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.062002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:17.062562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.065064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.080016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3462/6860] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:17.084377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.095006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa2c90-222a-42cb-9959-a5054f9cf1b5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.101072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.102122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.102765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.103254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.104214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.106402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.142985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3399/6861] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:17 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:17.148172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.165615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98af13-1eaa-42fb-bf0c-a6a4cc1dfc96 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.249000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.249691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.249985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.250563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.251312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.253523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.297114 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3463/6862] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:17 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:17.299157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.320550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f04f-82d3-4c7b-9b81-592b40af8a7c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.326109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.326991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.327787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.328077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.328988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.332300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.349478 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3400/6863] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:17.351356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.370782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36610e-d236-4545-b536-3088d0ee3c3c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.377732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.378627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.379063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.379490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.380384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.383337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f646d-5ab7-479f-ac5e-0662b6779fd2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.403539 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3464/6864] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:17.404578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.417780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef116d-060c-4c6e-b6b1-7aaf99686a04 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.425027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.427723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.428025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.428378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] PATH_INFO: `/v3/projects/8c8b55dfbe11432badea37e1461b90ec/users/b196922a814b4091a5637e1409addaf7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.462677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8b55dfbe11432badea37e1461b90ec, user_id=b196922a814b4091a5637e1409addaf7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.466328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.496894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3401/6865] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:17 2022] PUT /identity/v3/projects/8c8b55dfbe11432badea37e1461b90ec/users/b196922a814b4091a5637e1409addaf7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:17.509360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.509778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.510160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.544423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] MFA Rules not processed for user `b196922a814b4091a5637e1409addaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:17.545755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:17.650821 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3465/6866] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:17.656192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.775736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f22-d7c9-4dc1-9f9a-ebfd9f4398b1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.783705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.784639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.784963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.785250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.786196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.788605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:17.851442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3402/6867] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:17 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:17.851774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:17.872533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79e5d-6353-4fb6-b755-023188047b62 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:17.965836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:17.967089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:17.967380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:17.967808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:17.968605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:17.970785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.007245 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3466/6868] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:17 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:18.008101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.022690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330134b-8a09-4abe-b704-a69534443360 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.033370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.034220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.034519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.034844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.035582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.037375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.059277 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3403/6869] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:18.065010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.079149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8167e0-1f25-4f3a-be97-6438dcef39bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.084038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.085063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.085421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.085774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.086567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.088666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040dfd-7931-49db-b2ac-265067e53184 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.098635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3467/6870] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:18.103344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.113447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2361-d1ab-4c18-9771-1355313812f0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.118953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.120046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.120544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.120985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] PATH_INFO: `/v3/projects/6bb427cd9c5c418096b9d92b54993b92/users/9cd98c6ccb3d42af9c4f55c78a5b1d85/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.137836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb427cd9c5c418096b9d92b54993b92, user_id=9cd98c6ccb3d42af9c4f55c78a5b1d85, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.140788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.159959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3404/6871] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:18 2022] PUT /identity/v3/projects/6bb427cd9c5c418096b9d92b54993b92/users/9cd98c6ccb3d42af9c4f55c78a5b1d85/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:18.171826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.172266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.172636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.218023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] MFA Rules not processed for user `9cd98c6ccb3d42af9c4f55c78a5b1d85`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:18.220524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:18.304066 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3468/6872] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:18.309103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.380444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bbf2-074e-49b8-866b-b8e70e062bc1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.386110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.387291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.387590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.387870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.388603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.390866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.426335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3405/6873] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:18 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:18.427662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.465147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d5d54-8797-4594-85ab-7e57d277fc0d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.576412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.577130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.577432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.577692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.578385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.580394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.605890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3469/6874] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:18 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:18.607446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.619345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab714f1-71c3-46d6-99d4-f02844dd44b7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.625039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.625833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.626226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.626601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.627433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.629383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.641498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3406/6875] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:18.646379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.657641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec10833-426a-4b6c-8c60-7e075317f6dd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.662820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.664001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.664917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.665216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] PATH_INFO: `/v3/projects/f4acc20488de487ab9946c2c61ca614e/users/14ca826004014a3e8a3109846cf07034/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.682908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4acc20488de487ab9946c2c61ca614e, user_id=14ca826004014a3e8a3109846cf07034, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.685579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.702019 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3470/6876] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:18 2022] PUT /identity/v3/projects/f4acc20488de487ab9946c2c61ca614e/users/14ca826004014a3e8a3109846cf07034/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:18.706861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.720239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b76f6-3d8d-4f1b-beb0-ec7b48e95ac3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.836765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.837776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.838075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.838359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.839263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.840953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda5f6-350c-4917-b0ec-4562176ac79f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.857999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3407/6877] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:18.861979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:18.878762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21673e-f1aa-4d4c-b3a8-38a065e1158d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:18.916299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:18.917667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.918023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.918493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] PATH_INFO: `/v3/projects/f4acc20488de487ab9946c2c61ca614e/users/14ca826004014a3e8a3109846cf07034/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:18.920861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4acc20488de487ab9946c2c61ca614e, user_id=14ca826004014a3e8a3109846cf07034, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:18.924763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:18.940033 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3471/6878] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:18 2022] PUT /identity/v3/projects/f4acc20488de487ab9946c2c61ca614e/users/14ca826004014a3e8a3109846cf07034/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:18.958302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:18.958604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:18.958888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:19.033162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] MFA Rules not processed for user `14ca826004014a3e8a3109846cf07034`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:19.037990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:19.155531 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3408/6879] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:19.175589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:19.187212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:19.335398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb397b4-b062-4481-9ec5-25e380c61475 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:19.339800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:19.340737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:19.341031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:19.341384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:19.421582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:19.425594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236393e-0475-4c32-a1ff-333ebd8dc3f5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:19.445548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3472/6880] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:19.591907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:19.594143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:19.694181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820896d-2943-4f0a-bf13-9e8a61f6756e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:19.701963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:19.703266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:19.703797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:19.704315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] PATH_INFO: `/v3/users/d74819209d5f45a5ae75ba6e5c9429b8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:19.705960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74819209d5f45a5ae75ba6e5c9429b8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:19.708646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:19.873639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74819209d5f45a5ae75ba6e5c9429b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:19.917530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74819209d5f45a5ae75ba6e5c9429b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:19.919113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74819209d5f45a5ae75ba6e5c9429b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:19.934067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74819209d5f45a5ae75ba6e5c9429b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:19.945009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74819209d5f45a5ae75ba6e5c9429b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:19.953482 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3409/6881] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:19 2022] DELETE /identity/v3/users/d74819209d5f45a5ae75ba6e5c9429b8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:14:19.958259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f82fa-7145-46d9-9971-13d602841928 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:19.959050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f82fa-7145-46d9-9971-13d602841928 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:19.959050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f82fa-7145-46d9-9971-13d602841928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:19.983036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-473f82fa-7145-46d9-9971-13d602841928 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:19.984843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-473f82fa-7145-46d9-9971-13d602841928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:20.087551 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3473/6882] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:20.413089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:20.417416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:20.559245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d2bc-9ba4-4b5a-8794-a141157afe2a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:20.567475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:20.568250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:20.569484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:20.569858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:20.582466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:20.585691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:20.605234 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3410/6883] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:21.333513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f82fa-7145-46d9-9971-13d602841928 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.335889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-473f82fa-7145-46d9-9971-13d602841928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.342369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.344706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.372227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655780-134b-4ae6-89b0-ddc89c4a82d6 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:21.373430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f82fa-7145-46d9-9971-13d602841928 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:21.378464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:21.382514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.383179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.383682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] PATH_INFO: `/v3/projects/752dbe7fcf844bb881addb074467167e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.384495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:21.386122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=752dbe7fcf844bb881addb074467167e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:21.386504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.387029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.387595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] PATH_INFO: `/v3/users/c79b89950d9640aa9f63ed6e829c3b9a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.389125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:21.391339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79b89950d9640aa9f63ed6e829c3b9a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:21.395189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:21.488002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752dbe7fcf844bb881addb074467167e', 'request_id': 'req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.488285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79b89950d9640aa9f63ed6e829c3b9a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.498377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752dbe7fcf844bb881addb074467167e', 'request_id': 'req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.498860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79b89950d9640aa9f63ed6e829c3b9a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.499762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79b89950d9640aa9f63ed6e829c3b9a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.501472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79b89950d9640aa9f63ed6e829c3b9a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.513805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752dbe7fcf844bb881addb074467167e', 'request_id': 'req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.520534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-01bf6649-b24a-47b3-a893-c18e85aaf248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79b89950d9640aa9f63ed6e829c3b9a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.563810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] The token cache is being invalidate because project 752dbe7fcf844bb881addb074467167e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:21.564498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.566500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f788c4ba-f81b-41fb-8d80-0d34e782fdfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:21.572914 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3411/6884] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:21 2022] DELETE /identity/v3/projects/752dbe7fcf844bb881addb074467167e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:21.574794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8bf1-ed60-4668-90d2-f7d0772e0515 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.575063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8bf1-ed60-4668-90d2-f7d0772e0515 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.575494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8bf1-ed60-4668-90d2-f7d0772e0515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.584265 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3474/6885] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:21 2022] DELETE /identity/v3/users/c79b89950d9640aa9f63ed6e829c3b9a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:21.589889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.590406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.590915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.616718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:21.618372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.621831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-33ba8bf1-ed60-4668-90d2-f7d0772e0515 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:21.623886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33ba8bf1-ed60-4668-90d2-f7d0772e0515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.716319 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3475/6886] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:21.738023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.739825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.744681 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3412/6887] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:21.753854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.754391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.763158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.798512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:21.801305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:21.836103 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3413/6888] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:21.837162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.849191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9d64-ed29-4902-bb36-59df3ceb1a39 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:21.853387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a8bcd-7af4-4d88-9815-a15d87219a50 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:21.853530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:21.854378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.854667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.855747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.870378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:21.871185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.871480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.871763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.873114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:21.873245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:21.875201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:21.878536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:21.879997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:21.893177 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3414/6889] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:21.894288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.895158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3476/6890] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:21.919019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc21f-471a-4934-83a5-b5e2512fd788 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:21.924787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:21.926055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:21.926055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:21.926272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:21.927068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:21.930497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:21.982471 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3415/6891] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:21 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:21.986778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:21.996937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bdebd-8fd6-4958-b8b5-7e0fa0e8a46b service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.067241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.067920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.068252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.068508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.069761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.071698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.108657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3477/6892] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:21 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:14:22.111932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:22.129623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f0e96-2f4a-4034-bc1f-996a66540486 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.138589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.138589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.138589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.138589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.140151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.140151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.159361 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3416/6893] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:22.160876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:22.178874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7263-feae-4b57-a204-c56470c0f450 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.189344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.190250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.190555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.190880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.191615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.198405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8770-a77f-4e74-80d0-bcdcf2b097ee admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.214403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3478/6894] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:22.218383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:22.233998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa489a3-ecd2-48c6-a904-923737aa77c5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.245725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.246706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.248775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.249125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] PATH_INFO: `/v3/projects/b5fe471f4a924fd98ef24aa24abb736c/users/08aca3700d594a349789d5f3847894dc/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.286620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fe471f4a924fd98ef24aa24abb736c, user_id=08aca3700d594a349789d5f3847894dc, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.290594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.329258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3417/6895] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:22 2022] PUT /identity/v3/projects/b5fe471f4a924fd98ef24aa24abb736c/users/08aca3700d594a349789d5f3847894dc/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:22.335463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.336012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.336012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.341793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:22.346132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.364238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:22.367864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.500123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3743-66f7-44e7-b0b3-d7b44f501dee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.506528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.507683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.508171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.508683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] PATH_INFO: `/v3/projects/359e6007027c41689cd67abd2e93ba69` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.509926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] RBAC: Authorizing `identity:delete_project(project_id=359e6007027c41689cd67abd2e93ba69)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.511870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.526193 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3479/6896] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:22.548479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:22.550107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.629994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359e6007027c41689cd67abd2e93ba69', 'request_id': 'req-9c325e53-3c3b-407b-9682-14e029a7814a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:22.643033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359e6007027c41689cd67abd2e93ba69', 'request_id': 'req-9c325e53-3c3b-407b-9682-14e029a7814a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:22.668199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359e6007027c41689cd67abd2e93ba69', 'request_id': 'req-9c325e53-3c3b-407b-9682-14e029a7814a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:22.699855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] The token cache is being invalidate because project 359e6007027c41689cd67abd2e93ba69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:22.700766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:22.702450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9c325e53-3c3b-407b-9682-14e029a7814a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:22.709542 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3418/6897] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:22 2022] DELETE /identity/v3/projects/359e6007027c41689cd67abd2e93ba69 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:22.715363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297a6e-dd1d-4ca2-acc1-ae59c8401ead None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.716300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297a6e-dd1d-4ca2-acc1-ae59c8401ead None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.716834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa297a6e-dd1d-4ca2-acc1-ae59c8401ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.721083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e5f6c-91e5-4d12-b54e-8220345d7e28 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:22.775143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-aa297a6e-dd1d-4ca2-acc1-ae59c8401ead None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:22.776983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa297a6e-dd1d-4ca2-acc1-ae59c8401ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.846160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:22.846792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.847081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.847358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.849483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.908507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3419/6898] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:22.914531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:22.916668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:22.917514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:22.957470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:22.961596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:22.963952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:22.965564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:22.987770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3420/6899] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:22.987770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.002879 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3480/6900] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:23.013607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85ad83-c931-4770-b43a-5495ec457c0a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.024127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.026477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.027229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.027358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.028198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:23.028568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.030920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.046302 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3421/6901] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:23.052949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.068202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365022-83fc-4445-bf91-acc7656ba2a6 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.087262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.088215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.088754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.089431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.090930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.094009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.152348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3481/6902] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:23 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:23.156872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.179999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfb79d-2e14-4dd8-9f19-72efd74780d9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.318349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.320050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.320050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.320642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.321324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.332785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.379724 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3422/6903] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:23 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:23.386009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.409569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe3f-a558-4f03-9813-fba64a5f5e69 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.422399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.423251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.423762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.424308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.425219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.427110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.464281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3482/6904] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:23.464429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.485084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2168e6d-319f-4772-8b99-abd283c6882b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.499985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.501607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.501953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.502232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.503171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.507275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7322-5a08-47d6-9fc1-6718f6405ca7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.532483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3423/6905] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:14:23.536110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.550348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12130-a246-4e21-81b1-10690b7ccfe0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:23.557675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:23.559081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.559513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.560631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] PATH_INFO: `/v3/projects/81bf4fa12da74e6c8f6c5aa3ddd40d26/users/6b2dbf34082047068b0bdc4dfd77f811/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.596635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf4fa12da74e6c8f6c5aa3ddd40d26, user_id=6b2dbf34082047068b0bdc4dfd77f811, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:23.599550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:23.629737 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3483/6906] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:23 2022] PUT /identity/v3/projects/81bf4fa12da74e6c8f6c5aa3ddd40d26/users/6b2dbf34082047068b0bdc4dfd77f811/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:23.647195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d316-4f3a-43bf-91e0-177c4062a9ad None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:23.650440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d316-4f3a-43bf-91e0-177c4062a9ad None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:23.650887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d316-4f3a-43bf-91e0-177c4062a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:23.700891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b413d316-4f3a-43bf-91e0-177c4062a9ad None None] MFA Rules not processed for user `6b2dbf34082047068b0bdc4dfd77f811`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:23.704101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b413d316-4f3a-43bf-91e0-177c4062a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:23.902322 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3424/6907] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:23.914717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:23.919499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:24.073401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5a716-2638-4f42-9656-49632bf27c0b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:24.077831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:24.084944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:24.084944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:24.084944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:24.101349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:24.103044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:24.121832 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3484/6908] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:24.168593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:24.169080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:24.169500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:24.215661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] MFA Rules not processed for user `08aca3700d594a349789d5f3847894dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:24.219758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:24.408438 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3425/6909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:24.424601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:24.426081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:24.563901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05808-19ba-4f32-ace6-3f0fe214c4df service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:24.569982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:24.570639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:24.571103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:24.571725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:24.593844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:24.595816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:24.614246 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3485/6910] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:25.075573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:25.077130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:25.332429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ff43d-02af-42e6-8aac-89f98b386571 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:25.354193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:25.354682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:25.355114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:25.355254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:25.361791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:25.444592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:25.450558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:25.499302 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3426/6911] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:33.112089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:33.114707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:33.343606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5aa399-9fb6-41a1-b05e-a2bfa18494b4 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:33.352862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:33.353549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:33.353887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:33.354169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:33.356406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:33.393316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:33.394980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:33.454710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3486/6912] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:34.494001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:34.531686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedfca1-afdd-4631-9c9b-c441e9367976 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:34.546800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:34.547507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:34.547799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:34.548080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:34.550067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:34.676162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:34.678213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:34.707106 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3427/6913] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:34.728063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:34.763168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1511bc-c928-4649-80c1-e9ce167650dc service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:34.791061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:34.791748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:34.792044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:34.792314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:34.804076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:34.990947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:34.993282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:35.023817 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3487/6914] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:37.580567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:37.582002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:37.617143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13216fd0-11b4-4439-b9dd-729c86790303 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:37.622174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:37.623617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:37.624194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:37.624736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:37.635590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:37.760427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:37.763733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:37.799887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3428/6915] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:41.565572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:41.569913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:41.628561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7c40c-29c2-412c-8334-220b6edf333a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:41.648387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:41.650650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:41.650945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:41.652075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:41.656770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:41.691160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:41.694344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59640c-1f5f-4176-acc6-36bf6f32529e service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:41.751104 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3488/6916] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:49.449330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:49.482881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678102-b30d-4f5f-a02d-cffed3fab804 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:49.498777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:49.500591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:49.502281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:49.502719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:49.509087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:49.679372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:49.681255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:49.708602 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3429/6917] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:53.387108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b372c6-0919-40b4-9cdb-f491361cf3c3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:53.387611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b372c6-0919-40b4-9cdb-f491361cf3c3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:53.387783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b372c6-0919-40b4-9cdb-f491361cf3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:53.445307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a1b372c6-0919-40b4-9cdb-f491361cf3c3 None None] MFA Rules not processed for user `08aca3700d594a349789d5f3847894dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:53.449986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a1b372c6-0919-40b4-9cdb-f491361cf3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:53.460550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3489/6918] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:54.756288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:54.758898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:54.782643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb327-dab3-4744-8f20-e5e6701a633e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:54.790071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:54.791127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:54.791451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:54.791774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] PATH_INFO: `/v3/users/b80790d4e9484dfd92f9ad7e840637c3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:54.793429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80790d4e9484dfd92f9ad7e840637c3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:54.795525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:54.898328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80790d4e9484dfd92f9ad7e840637c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:54.925485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80790d4e9484dfd92f9ad7e840637c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:54.926350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80790d4e9484dfd92f9ad7e840637c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:54.952294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80790d4e9484dfd92f9ad7e840637c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:54.999015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80790d4e9484dfd92f9ad7e840637c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.008667 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3430/6919] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:54 2022] DELETE /identity/v3/users/b80790d4e9484dfd92f9ad7e840637c3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:55.013315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:55.013807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:55.013904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:55.050267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:55.054733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:55.147314 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3490/6920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:14:55.165136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:55.169157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:55.347882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228985b-8f64-4f42-a68a-7a463135bc33 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:55.366307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:55.367594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:55.368632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:55.369060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:55.395100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:55.397015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc29be-9183-4a71-b9c7-832cd305b375 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:55.425353 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3431/6921] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:55.789856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:55.792575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:55.831560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5b0d9-72e9-44ed-994c-9f3981e68d24 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:55.862841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:55.863737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:55.864030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:55.864445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] PATH_INFO: `/v3/projects/3265dbc2dbab442dbb562ef4a3652650` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:55.866399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3265dbc2dbab442dbb562ef4a3652650)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:55.870775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:55.955276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3265dbc2dbab442dbb562ef4a3652650', 'request_id': 'req-65a4d1d6-d256-4479-ae2a-baff8fed12e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.963538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3265dbc2dbab442dbb562ef4a3652650', 'request_id': 'req-65a4d1d6-d256-4479-ae2a-baff8fed12e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.974640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3265dbc2dbab442dbb562ef4a3652650', 'request_id': 'req-65a4d1d6-d256-4479-ae2a-baff8fed12e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.987835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] The token cache is being invalidate because project 3265dbc2dbab442dbb562ef4a3652650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:55.988236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.990236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-65a4d1d6-d256-4479-ae2a-baff8fed12e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:55.992419 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3491/6922] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:55 2022] DELETE /identity/v3/projects/3265dbc2dbab442dbb562ef4a3652650 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:55.997900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:55.999273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:55.999783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.025297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:56.026951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:56.113414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3432/6923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:56.122378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.123362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.124133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.153494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:56.156431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:56.174328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3492/6924] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:56.174684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.193102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cd3aa-d169-41fe-b1f2-342a3d7f716f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.207186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.207946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.208291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.208610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.209366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:14:56.209672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.211365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.212911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.215277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:56.240200 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3433/6925] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:14:56.244112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.270542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad15bc-e95d-405e-979a-7535c41d598d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.280022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.281041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.281497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.282007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.282935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.285245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.291973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c73c3-381d-45c9-b1b5-016338105def None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.296236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.298562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.300913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.301524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.304958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:56.321071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.322982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.337336 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3434/6926] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:14:56 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:56.338582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.345169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3493/6927] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:14:56.429790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669b5a4-526e-47e8-ae2e-843d2b0c9da6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.444941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.447196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.447769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.448147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.449091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.452771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.478150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3435/6928] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:14:56 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:14:56.483322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.495403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80e2f2-6573-438d-a640-3cd5f58225ee service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.502096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.502958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.503253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.503534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.504270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.505988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.519375 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3494/6929] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:56.523489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.535179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81c4e5-0b19-4017-ac15-734d2122b935 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.541277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.542590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.542741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.543169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.543834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.545572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada3091-3bbf-41ed-9cec-89fd9f4d4772 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.559446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3436/6930] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:14:56.563475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.575373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d97482-81a7-485b-bba8-887ce497b897 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:56.581518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:56.583498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.584715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.587517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] PATH_INFO: `/v3/projects/f1f1bda071d042bfaa92c36f88a0582f/users/3ada81b2a79d458c807b333caddde24d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.622789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f1bda071d042bfaa92c36f88a0582f, user_id=3ada81b2a79d458c807b333caddde24d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:56.622789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:56.663821 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3495/6931] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:14:56 2022] PUT /identity/v3/projects/f1f1bda071d042bfaa92c36f88a0582f/users/3ada81b2a79d458c807b333caddde24d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:56.675987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:56.676197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:56.676392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:56.739774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] MFA Rules not processed for user `3ada81b2a79d458c807b333caddde24d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:14:56.741488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:56.905725 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3437/6932] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:14:56.924442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:56.928370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:57.031001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e9bce-a326-4edf-8bda-f84c52e58302 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:57.040644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:57.042632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:57.046992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:57.047676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:57.048131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:57.048422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:57.072910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:57.074385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:57.087664 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3496/6933] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:14:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:14:57.203987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fa00-2e8b-4d2c-bdc8-ed8a9890400d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:57.209574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:57.210462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:57.210754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:57.211032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] PATH_INFO: `/v3/users/912051f37cf84f30942319efc614fc12` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:57.212287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=912051f37cf84f30942319efc614fc12)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:57.214854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:57.296346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912051f37cf84f30942319efc614fc12'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:57.316785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912051f37cf84f30942319efc614fc12'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:57.318735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912051f37cf84f30942319efc614fc12'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:57.332011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912051f37cf84f30942319efc614fc12'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:57.344176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912051f37cf84f30942319efc614fc12'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:57.362710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3438/6934] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:57 2022] DELETE /identity/v3/users/912051f37cf84f30942319efc614fc12 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:57.924137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:57.937494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958f900-8547-46b3-88fd-e368442ef82c service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:58.035885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:58.037374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:58.037863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:58.038308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] PATH_INFO: `/v3/projects/3e69485d6b5e4cd6ba0ffbb3b210952b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:58.040383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e69485d6b5e4cd6ba0ffbb3b210952b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:58.042604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:58.105651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'request_id': 'req-7584f5ae-d066-4a42-aef7-31e9f943e6e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.112544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'request_id': 'req-7584f5ae-d066-4a42-aef7-31e9f943e6e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.123361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'request_id': 'req-7584f5ae-d066-4a42-aef7-31e9f943e6e8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.139275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] The token cache is being invalidate because project 3e69485d6b5e4cd6ba0ffbb3b210952b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:58.139779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.140502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.143479 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3497/6935] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:57 2022] DELETE /identity/v3/projects/3e69485d6b5e4cd6ba0ffbb3b210952b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:58.147356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:58.148855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:58.164421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d0599-ab23-4cc9-b3cf-14e1ddba6c5c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:58.230506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:58.232099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:58.232645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:58.232930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] PATH_INFO: `/v3/users/cef22d160ef540d9b2ef157b7082e1bc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:58.234412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef22d160ef540d9b2ef157b7082e1bc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:58.237231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:58.304566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef22d160ef540d9b2ef157b7082e1bc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.318182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef22d160ef540d9b2ef157b7082e1bc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.321907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef22d160ef540d9b2ef157b7082e1bc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.331719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef22d160ef540d9b2ef157b7082e1bc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.340811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef22d160ef540d9b2ef157b7082e1bc'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:58.349529 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3439/6936] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:14:58 2022] DELETE /identity/v3/users/cef22d160ef540d9b2ef157b7082e1bc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:14:58.971314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:14:58.973317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:14:58.999649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f5ae-d066-4a42-aef7-31e9f943e6e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:14:59.111170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:14:59.113232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:14:59.113586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:14:59.115340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] PATH_INFO: `/v3/projects/a44918b6e8e14b59a0ff928f20a37bed` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:14:59.118826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44918b6e8e14b59a0ff928f20a37bed)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:14:59.121872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:14:59.256437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44918b6e8e14b59a0ff928f20a37bed', 'request_id': 'req-2db857d2-54cc-4c40-a65e-51b8df9d91ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:59.275432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44918b6e8e14b59a0ff928f20a37bed', 'request_id': 'req-2db857d2-54cc-4c40-a65e-51b8df9d91ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:59.288297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44918b6e8e14b59a0ff928f20a37bed', 'request_id': 'req-2db857d2-54cc-4c40-a65e-51b8df9d91ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:59.301694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] The token cache is being invalidate because project a44918b6e8e14b59a0ff928f20a37bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:14:59.302383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:59.303385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:14:59.305934 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3498/6937] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:14:58 2022] DELETE /identity/v3/projects/a44918b6e8e14b59a0ff928f20a37bed => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:04.638842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:04.640673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:04.655766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2f4b9-1be0-4388-9efd-4142df62d834 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:04.726413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:04.727590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:04.727879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:04.728154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] PATH_INFO: `/v3/users/d7ebf8694d674ee38bb5f58a3687a415` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:04.729497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ebf8694d674ee38bb5f58a3687a415)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:04.731691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:04.780309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ebf8694d674ee38bb5f58a3687a415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:04.793387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ebf8694d674ee38bb5f58a3687a415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:04.794096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ebf8694d674ee38bb5f58a3687a415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:04.801021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ebf8694d674ee38bb5f58a3687a415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:04.808441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c30530b3-a529-4ec6-b2cf-b3f54dc382a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ebf8694d674ee38bb5f58a3687a415'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:04.814657 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3440/6938] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:04 2022] DELETE /identity/v3/users/d7ebf8694d674ee38bb5f58a3687a415 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:05.120063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.121688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.135539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db857d2-54cc-4c40-a65e-51b8df9d91ce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.220148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.221203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.221919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.222142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] PATH_INFO: `/v3/projects/e9e9483710f0424b9c347c74a9da708a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.224402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e9483710f0424b9c347c74a9da708a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.226418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.303061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e9483710f0424b9c347c74a9da708a', 'request_id': 'req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.311970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e9483710f0424b9c347c74a9da708a', 'request_id': 'req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.323470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e9483710f0424b9c347c74a9da708a', 'request_id': 'req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.337567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] The token cache is being invalidate because project e9e9483710f0424b9c347c74a9da708a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:05.338589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.339494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-634ba3c2-a0bd-4613-aa3d-a29b96e2e52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.341395 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3499/6939] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:05 2022] DELETE /identity/v3/projects/e9e9483710f0424b9c347c74a9da708a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:05.346109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.346394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.346677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.405559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:05.416036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.531504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3441/6940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:05.539544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.540072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.540737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.574047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:05.578887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.585480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.587820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.597139 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3500/6941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:05.598103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.608020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eeff8-cf61-436a-aafe-b085bda3ed03 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.608361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b99b-0fad-4212-8667-80ea75c73754 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.614162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.614617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.614984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.615335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.615678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.616373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.616567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:15:05.616707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.616964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.617091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] PATH_INFO: `/v3/users/b196922a814b4091a5637e1409addaf7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.618364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b196922a814b4091a5637e1409addaf7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.618918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.620801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.635142 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3501/6942] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:15:05.641005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.660523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb2a1-c807-45d7-8a2d-0bd5393a71e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.668496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.669657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.670187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.670820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.671820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.675262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.700427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b196922a814b4091a5637e1409addaf7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.719206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b196922a814b4091a5637e1409addaf7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.719923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b196922a814b4091a5637e1409addaf7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.724512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3502/6943] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:05 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:05.725552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.727539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.730494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b196922a814b4091a5637e1409addaf7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.741020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8482089b-81b6-46aa-8de1-647629af9e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b196922a814b4091a5637e1409addaf7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:05.749401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3442/6944] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:05 2022] DELETE /identity/v3/users/b196922a814b4091a5637e1409addaf7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:05.753910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.755104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.755558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.778264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:05.780177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.805159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461bf4e-54c2-4fe1-80f9-5a13a735d082 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.871414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3443/6945] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:15:05.879256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.879932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.880364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.881276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.881575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.882524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.883578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.884712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:05.923296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3503/6946] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:05 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:05.927838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.943275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a199-acf6-40b3-a9fb-73525956f4c0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.949585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.950764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.951323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.951806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.952663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:05.954790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:05.969438 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3504/6947] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:05.974595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:05.978386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5a854-1d5d-4720-abcf-d31e0c77ea2a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.982779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:05.984179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:05.984686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:05.985324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:05.992061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25aa82-dc91-47e6-82f8-02ec7942b84e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:05.999966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:06.001230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.001873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.003424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.004086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.005078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.006053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.008719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980258e-37ce-4336-bdbc-29a62c7268af admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.022290 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3444/6948] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:15:06.023491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3505/6949] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:06.027954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:06.043198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658d63-2bd2-406a-9566-c53d74659c25 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:06.056793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:06.057802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.058085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.058361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] PATH_INFO: `/v3/projects/596094c632d2408d8963534a88f04156/users/8b84c577baf8418180f894c99c643772/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.109403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596094c632d2408d8963534a88f04156, user_id=8b84c577baf8418180f894c99c643772, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.112629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.157288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3445/6950] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:06 2022] PUT /identity/v3/projects/596094c632d2408d8963534a88f04156/users/8b84c577baf8418180f894c99c643772/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:06.162853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.163355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.163613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.194882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:06.196858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:06.295609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3506/6951] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:06.325148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:06.343547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:06.346623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:06.371404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac69df0-7067-4f88-833e-b97a9adfa8bd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:06.393909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:06.399736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.400284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.400770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] PATH_INFO: `/v3/projects/8c8b55dfbe11432badea37e1461b90ec` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.402398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8b55dfbe11432badea37e1461b90ec)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.404805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.468202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63c4d-0950-42db-a1ce-d60c331e3626 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:06.508772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8b55dfbe11432badea37e1461b90ec', 'request_id': 'req-6effca8a-d0c0-4868-ac43-d01c2d28683b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.522937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8b55dfbe11432badea37e1461b90ec', 'request_id': 'req-6effca8a-d0c0-4868-ac43-d01c2d28683b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.538244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8b55dfbe11432badea37e1461b90ec', 'request_id': 'req-6effca8a-d0c0-4868-ac43-d01c2d28683b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.590399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] The token cache is being invalidate because project 8c8b55dfbe11432badea37e1461b90ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:06.591344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.592121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.594268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:06.594423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3507/6952] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:06 2022] DELETE /identity/v3/projects/8c8b55dfbe11432badea37e1461b90ec => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:06.600426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.604074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.604476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.606363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:06.608794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:06.611271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:06.716435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.718125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.746581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effca8a-d0c0-4868-ac43-d01c2d28683b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:06.753588 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3446/6953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:06.755942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:06.759011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:06.759479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:06.760116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] PATH_INFO: `/v3/users/9cd98c6ccb3d42af9c4f55c78a5b1d85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:06.761632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd98c6ccb3d42af9c4f55c78a5b1d85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:06.764721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:06.878527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd98c6ccb3d42af9c4f55c78a5b1d85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.891224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd98c6ccb3d42af9c4f55c78a5b1d85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.893411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd98c6ccb3d42af9c4f55c78a5b1d85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.894309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd98c6ccb3d42af9c4f55c78a5b1d85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.905894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd98c6ccb3d42af9c4f55c78a5b1d85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:06.931548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3508/6954] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:06 2022] DELETE /identity/v3/users/9cd98c6ccb3d42af9c4f55c78a5b1d85 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:07.515086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:07.516972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:07.537723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5bba-1d5f-4b73-a081-ac7f36603ef9 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:07.610839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:07.611730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:07.612018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:07.612340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] PATH_INFO: `/v3/users/3ada81b2a79d458c807b333caddde24d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:07.613536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ada81b2a79d458c807b333caddde24d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:07.616045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:07.672569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ada81b2a79d458c807b333caddde24d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.696001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ada81b2a79d458c807b333caddde24d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.700171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ada81b2a79d458c807b333caddde24d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.709432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ada81b2a79d458c807b333caddde24d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.716471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:07.717987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:07.719117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-348c5891-2c7e-4910-97da-016c1261bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ada81b2a79d458c807b333caddde24d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.730260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3447/6955] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:07 2022] DELETE /identity/v3/users/3ada81b2a79d458c807b333caddde24d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:07.732387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:07.733020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:07.733475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:07.740696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ebf9a-fa10-46b8-9f21-bff00010e797 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:07.753925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:07.755873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:07.855574 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3448/6956] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:07.867496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:07.874347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:07.887811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:07.889642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:07.889642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:07.890032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] PATH_INFO: `/v3/projects/6bb427cd9c5c418096b9d92b54993b92` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:07.891931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb427cd9c5c418096b9d92b54993b92)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:07.894422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:07.970521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb427cd9c5c418096b9d92b54993b92', 'request_id': 'req-a1e4ed4e-5a9c-4383-a82e-6745694c1321'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:07.986350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb427cd9c5c418096b9d92b54993b92', 'request_id': 'req-a1e4ed4e-5a9c-4383-a82e-6745694c1321'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.000121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467c942-0dc9-4eb7-b4b4-3894de896cc0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:08.002457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb427cd9c5c418096b9d92b54993b92', 'request_id': 'req-a1e4ed4e-5a9c-4383-a82e-6745694c1321'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.022484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] The token cache is being invalidate because project 6bb427cd9c5c418096b9d92b54993b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:08.022786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.024747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.030190 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3509/6957] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:07 2022] DELETE /identity/v3/projects/6bb427cd9c5c418096b9d92b54993b92 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:08.034128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:08.036780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:08.115449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:08.116130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:08.116416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:08.116720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:08.118631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:08.173517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ed4e-5a9c-4383-a82e-6745694c1321 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:08.191221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:08.193073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:08.195210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:08.195671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] PATH_INFO: `/v3/users/14ca826004014a3e8a3109846cf07034` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:08.197236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ca826004014a3e8a3109846cf07034)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:08.203698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:08.203947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:08.205188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5f218-0814-4f34-8e6d-3fdc77f53206 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:08.218378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3449/6958] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:08.219729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:08.220177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:08.220483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:08.280930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:08.282848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:08.307620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ca826004014a3e8a3109846cf07034'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.318779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ca826004014a3e8a3109846cf07034'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.319179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ca826004014a3e8a3109846cf07034'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.319939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ca826004014a3e8a3109846cf07034'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.328936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b561fb71-69f9-43a1-b967-f9ac7afa869f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ca826004014a3e8a3109846cf07034'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:08.359418 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3510/6959] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:08 2022] DELETE /identity/v3/users/14ca826004014a3e8a3109846cf07034 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:08.386083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3450/6960] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:08.396625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:08.396980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:08.397196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:08.459475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:08.462533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:08.606714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3511/6961] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:08.617098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:08.619001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:08.776564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea311a-b660-45aa-a12d-8ac6e95a1938 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:08.921515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:08.922539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:08.923200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:08.923526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:08.941668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:08.944574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:08.964171 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3451/6962] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:09.067394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.069777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.105440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.107674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.230296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a227ad-5412-4748-89de-7a6e12ed0dc1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.236258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.237274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.237629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.237983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] PATH_INFO: `/v3/projects/f4acc20488de487ab9946c2c61ca614e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.239389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4acc20488de487ab9946c2c61ca614e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.241444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.314299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef497d1-314e-40a9-a396-0864a2e5bef3 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.345066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4acc20488de487ab9946c2c61ca614e', 'request_id': 'req-885abfbd-b745-4283-861a-8d1f730f4026'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.352327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4acc20488de487ab9946c2c61ca614e', 'request_id': 'req-885abfbd-b745-4283-861a-8d1f730f4026'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.362419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4acc20488de487ab9946c2c61ca614e', 'request_id': 'req-885abfbd-b745-4283-861a-8d1f730f4026'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.377096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] The token cache is being invalidate because project f4acc20488de487ab9946c2c61ca614e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:09.377468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.378518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-885abfbd-b745-4283-861a-8d1f730f4026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.384290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3512/6963] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:09 2022] DELETE /identity/v3/projects/f4acc20488de487ab9946c2c61ca614e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:09.386517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd108-a75f-4ab7-9cc4-c0f0ce1b8391 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.386935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd108-a75f-4ab7-9cc4-c0f0ce1b8391 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.387334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd108-a75f-4ab7-9cc4-c0f0ce1b8391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.406098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.407552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.407912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.408263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] PATH_INFO: `/v3/projects/f1f1bda071d042bfaa92c36f88a0582f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.409885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f1bda071d042bfaa92c36f88a0582f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.412540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-26bcd108-a75f-4ab7-9cc4-c0f0ce1b8391 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:09.413651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.414005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26bcd108-a75f-4ab7-9cc4-c0f0ce1b8391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.432655 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3513/6964] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:09.435572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.435951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.436337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.465779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:09.466991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.488489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f1bda071d042bfaa92c36f88a0582f', 'request_id': 'req-9a103264-5e45-4b10-a63b-beec00b410e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.501942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f1bda071d042bfaa92c36f88a0582f', 'request_id': 'req-9a103264-5e45-4b10-a63b-beec00b410e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.511193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f1bda071d042bfaa92c36f88a0582f', 'request_id': 'req-9a103264-5e45-4b10-a63b-beec00b410e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.531770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] The token cache is being invalidate because project f1f1bda071d042bfaa92c36f88a0582f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:09.532302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.533077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9a103264-5e45-4b10-a63b-beec00b410e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:09.533754 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3514/6965] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:15:09.534960 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3452/6966] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:09 2022] DELETE /identity/v3/projects/f1f1bda071d042bfaa92c36f88a0582f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:09.538080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.539651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800871a-3766-442c-aba3-8211a9f188b4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.540046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800871a-3766-442c-aba3-8211a9f188b4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.540610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800871a-3766-442c-aba3-8211a9f188b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.547982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d10a-e610-453f-93de-351cc570ff80 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.553203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.553872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.554443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.554724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.556207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:15:09.556207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.557445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.564208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1800871a-3766-442c-aba3-8211a9f188b4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:09.565634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1800871a-3766-442c-aba3-8211a9f188b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.572513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3515/6967] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:15:09.574700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.580520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3453/6968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:09.580696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.583885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.584178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.584723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.594566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75342651-3414-4a54-bebe-e96a71a4ede9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.599275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.599939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.600229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.600564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.601258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.603424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.605934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:09.607377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:09.616861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3454/6969] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:09.621295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.632530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4633-1a04-418b-961a-1de6188f1d53 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.638331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.639236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.639523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.639802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.640558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:15:09.640870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.643242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.644858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3516/6970] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:09.649440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.659955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3455/6971] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:15:09.661153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.671720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae970b-16a2-4e13-97ce-dea431e412fc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.720917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334277c-ddfd-40e4-a985-548019e12fe8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.731152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.732446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.732446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.732446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.733517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.735015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.740221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.741046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.741488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.741873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.742671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.745127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.758016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3517/6972] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:09.761911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.773390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d833-fcfe-4868-b24f-702083e7f1b5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.778940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.779618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.780557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.780856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.781654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.783283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.783895 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3456/6973] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:09.789407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.798711 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3518/6974] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:09.799355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.811869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470dd4c-f032-497d-a455-1ea90110a636 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.867910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a3b5-4414-4ca5-a503-9cd5acce6117 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.874317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.875175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.875638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.876208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.877100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.879566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.892395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.896637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.897060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.909142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3457/6975] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:09 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:15:09.909800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3519/6976] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:15:09.913403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.916606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.927724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ef866-7036-4205-adec-3029c5ae7fb5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.932259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b8e76-98cf-4a51-84aa-585dad3dda21 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.933456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.934240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.934623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.935007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.935919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.937651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.956821 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3458/6977] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:09.957180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.958190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:09.958323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.958649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.958880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] PATH_INFO: `/v3/projects/fe5466912d1443d2adaba29a98b9f940/users/d056bc10ea254f17bbb89c5fefd1c050/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.972869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b5e27-0fe8-43a9-85ac-a38de5115909 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:09.985085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:09.985764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:09.986052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:09.986245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5466912d1443d2adaba29a98b9f940, user_id=d056bc10ea254f17bbb89c5fefd1c050, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.986369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:09.987651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:09.989904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:09.990583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8efb-bff0-42ca-b9a0-c21202d3ab60 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:10.016500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3459/6978] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:10.016710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3520/6979] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:09 2022] PUT /identity/v3/projects/fe5466912d1443d2adaba29a98b9f940/users/d056bc10ea254f17bbb89c5fefd1c050/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:10.016710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:10.027531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:10.027909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:10.030625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:10.092882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] MFA Rules not processed for user `d056bc10ea254f17bbb89c5fefd1c050`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:10.094299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:10.141767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62300-4b42-4810-875c-c306da057b1e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:10.156639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:10.158730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:10.159027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:10.159922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] PATH_INFO: `/v3/projects/d72eede125774117930b0fdb575ecb04/users/e037b5b9cea44165ba2a586418e047f7/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:10.186384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72eede125774117930b0fdb575ecb04, user_id=e037b5b9cea44165ba2a586418e047f7, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:10.189481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0196e2c-7fa3-46ed-9e6f-fb61e77cf002 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:10.220305 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3521/6980] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:10 2022] PUT /identity/v3/projects/d72eede125774117930b0fdb575ecb04/users/e037b5b9cea44165ba2a586418e047f7/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:10.236627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:10.237139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:10.238306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:10.249231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3460/6981] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:10.260296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:10.262756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:10.288117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] MFA Rules not processed for user `e037b5b9cea44165ba2a586418e047f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:10.289612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:10.377975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae7afe-aa92-4871-b251-67e0aedd550a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:10.420234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3522/6982] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:15:10.431276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:10.433839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:10.463224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:10.463974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:10.464357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:10.464734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:10.552267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3202-6b03-46fc-bf36-138d3398b66b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:10.552514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:10.556091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c34e9-7063-4d3b-8b0a-6171c103cc01 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:10.574282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:10.574944 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3461/6983] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:10.575945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:10.578038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:10.578436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:10.591529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:10.593105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60940516-6352-40c6-89f1-f7bcb86e31df service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:10.609661 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3523/6984] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:17.231680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:17.232232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:17.232686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:17.269296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:17.270994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:17.386674 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3462/6985] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:21.967145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:21.967684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:21.967898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:22.003468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:22.008436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:22.200732 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3524/6986] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:23.374397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:23.390390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aabbfc-74b3-4370-b57a-fc58d444f382 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:23.409157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:23.411004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:23.411473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:23.411908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:23.420225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:23.479857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:23.483389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:23.515995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3463/6987] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:24.599713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:24.602396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:24.820393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d11c7-22b2-4b3a-b06a-676a64b03bcc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:24.829910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:24.831610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:24.832100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:24.832751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:24.836208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:24.869666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:24.872438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5e58f-2a15-4577-a541-6cc54c0af76a service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:24.912698 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3525/6988] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:25.020293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:25.022487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:25.082990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:25.083301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:25.083538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:25.088391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ace14-9209-4c1c-8add-29692009c4da service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:25.099009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:25.100084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:25.100177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:25.100652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:25.106344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:25.130636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:25.132497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:25.138386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:25.144086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:25.163244 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3464/6989] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:25.180637 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3526/6990] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:25.745185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:25.748220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:25.925318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d535347-aa14-40a6-9721-3e8dd59be12d service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:25.947760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:25.949709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:25.950524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:25.950524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:25.958293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:25.980262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:25.984406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b2063-0e55-4cb9-97cd-1ba00db3fd6f service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:26.006785 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3465/6991] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:30.297063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:30.515715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135f2b5-3879-486c-8335-e517907c01a7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:30.531242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:30.532388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:30.532830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:30.533182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] PATH_INFO: `/v3/users/e037b5b9cea44165ba2a586418e047f7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:30.536089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e037b5b9cea44165ba2a586418e047f7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:30.542400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:30.634488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e037b5b9cea44165ba2a586418e047f7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:30.647933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e037b5b9cea44165ba2a586418e047f7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:30.656731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e037b5b9cea44165ba2a586418e047f7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:30.660729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e037b5b9cea44165ba2a586418e047f7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:30.672864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e037b5b9cea44165ba2a586418e047f7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:30.704958 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3527/6992] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:30 2022] DELETE /identity/v3/users/e037b5b9cea44165ba2a586418e047f7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:30.709721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:30.710294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:30.710294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:30.740789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:30.742644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:30.833260 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3466/6993] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:30.852327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:30.865270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:31.032001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220350-a77a-46b3-8a6d-c5ce4e734bf7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:31.036691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:31.068018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:31.070986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:31.073947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:31.108177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:31.111009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49412f07-66f5-49d7-a48d-c9bc93cc25a6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:31.132388 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3528/6994] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:31.751644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:31.754236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:31.775078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3c84-dfe0-4af3-83f5-227ce9ee4a05 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:31.781415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:31.782522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:31.783246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:31.784261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] PATH_INFO: `/v3/projects/d72eede125774117930b0fdb575ecb04` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:31.786326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72eede125774117930b0fdb575ecb04)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:31.790202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:31.878201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72eede125774117930b0fdb575ecb04', 'request_id': 'req-540e614b-84c2-4ea8-9cd0-01419615d338'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:31.889489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72eede125774117930b0fdb575ecb04', 'request_id': 'req-540e614b-84c2-4ea8-9cd0-01419615d338'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:31.901179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72eede125774117930b0fdb575ecb04', 'request_id': 'req-540e614b-84c2-4ea8-9cd0-01419615d338'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:31.932182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] The token cache is being invalidate because project d72eede125774117930b0fdb575ecb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:31.932812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:31.933718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-540e614b-84c2-4ea8-9cd0-01419615d338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:31.941621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:31.942601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:31.942950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:31.944577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3467/6995] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:31 2022] DELETE /identity/v3/projects/d72eede125774117930b0fdb575ecb04 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:31.965274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:31.966610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:32.056084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3529/6996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:32.064416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.064825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.065184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.088376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:32.089932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:32.107300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.107519 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3468/6997] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:32.136153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596ccf1-bd6c-41ae-8538-29ca8b38e367 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.144056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.144788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.145307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.146345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.146345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:15:32.148024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.150087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.174614 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3530/6998] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:15:32.176756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.187724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae9cd-3951-4757-a974-b188585bc1a8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.197456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.198443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.198901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.199337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.200511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.207031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.256834 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3469/6999] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:32 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:32.261665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.303051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc9751-8987-4ba0-a4a9-59d3f2428694 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.404690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.405397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.405688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.406296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.417358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.421391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.452953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3531/7000] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:32 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:32.459300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.473514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959d457-00b5-448f-ba2b-c7da1201d78c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.487543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.491916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.492398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.494402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.495321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.497196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.511596 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3470/7001] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:32.515712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.532488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206845a-d439-4673-ab9a-2b605c4847f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.539338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.540034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.540351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.541194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.543140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.544831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc539f-a9bc-4c78-a22c-9560dd487125 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.569513 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3532/7002] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:32.573632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.585978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2753d4e-7d5c-430e-b6eb-42f2e19f5897 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.596605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.598392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.598852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.599300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] PATH_INFO: `/v3/projects/f523714f06e1427cb2532d3bf68366b1/users/9afbc73cfa6844d48f99cb6747046e0b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.629646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f523714f06e1427cb2532d3bf68366b1, user_id=9afbc73cfa6844d48f99cb6747046e0b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.635972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.654066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3471/7003] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:32 2022] PUT /identity/v3/projects/f523714f06e1427cb2532d3bf68366b1/users/9afbc73cfa6844d48f99cb6747046e0b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:32.667506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d701c-859d-47d3-a696-e6bc1de77ff0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.667745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d701c-859d-47d3-a696-e6bc1de77ff0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.668117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d701c-859d-47d3-a696-e6bc1de77ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.702534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dd1d701c-859d-47d3-a696-e6bc1de77ff0 None None] MFA Rules not processed for user `9afbc73cfa6844d48f99cb6747046e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:32.704108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dd1d701c-859d-47d3-a696-e6bc1de77ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:32.796815 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3533/7004] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:32.806447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:32.811587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:32.897960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def705e-b817-4c72-bd5d-6646276da715 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:32.908355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:32.909427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:32.910374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:32.910825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:32.922362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:32.925409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:32.939472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3472/7005] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:37.163412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe010c0-40ef-4dfc-8192-fa467839526f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:37.164304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe010c0-40ef-4dfc-8192-fa467839526f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:37.164779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe010c0-40ef-4dfc-8192-fa467839526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:37.198682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2fe010c0-40ef-4dfc-8192-fa467839526f None None] MFA Rules not processed for user `27f570c67ed24546ac51341ef8ea2439`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:37.199939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2fe010c0-40ef-4dfc-8192-fa467839526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:37.313525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3534/7006] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:46.571643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:46.703834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1bf99-2951-447a-8e9b-b6c2ae7b7ccd service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:46.710789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:46.711948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:46.712230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:46.712744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] PATH_INFO: `/v3/users/9afbc73cfa6844d48f99cb6747046e0b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:46.714094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afbc73cfa6844d48f99cb6747046e0b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:46.716043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:46.782159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afbc73cfa6844d48f99cb6747046e0b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:46.799585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afbc73cfa6844d48f99cb6747046e0b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:46.800436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afbc73cfa6844d48f99cb6747046e0b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:46.811010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afbc73cfa6844d48f99cb6747046e0b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:46.823284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afbc73cfa6844d48f99cb6747046e0b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:46.831454 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3473/7007] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:15:46 2022] DELETE /identity/v3/users/9afbc73cfa6844d48f99cb6747046e0b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:46.836203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:46.836729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:46.836937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:46.873746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:46.875576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:47.003933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3535/7008] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:47.016815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:47.018563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:47.152821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b31f9e-0a4f-4c9c-a2ba-1db44daa77a8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:47.160444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:47.166853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:47.167765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:47.168296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:47.189876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:47.192367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801200c-8517-494f-9fc2-b35e20f70904 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:47.230358 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3474/7009] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:15:47.712776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:47.714784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:47.732898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b808-2c1d-468f-bbc2-4c2e73786de7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:47.744642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:47.745937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:47.746436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:47.746928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] PATH_INFO: `/v3/projects/f523714f06e1427cb2532d3bf68366b1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:47.748443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f523714f06e1427cb2532d3bf68366b1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:47.750670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:47.863501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f523714f06e1427cb2532d3bf68366b1', 'request_id': 'req-196f922b-98d0-4531-9ea2-d0c2be43938b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:47.878241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f523714f06e1427cb2532d3bf68366b1', 'request_id': 'req-196f922b-98d0-4531-9ea2-d0c2be43938b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:47.896216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f523714f06e1427cb2532d3bf68366b1', 'request_id': 'req-196f922b-98d0-4531-9ea2-d0c2be43938b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:47.917229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] The token cache is being invalidate because project f523714f06e1427cb2532d3bf68366b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:15:47.918312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:47.919895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-196f922b-98d0-4531-9ea2-d0c2be43938b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:15:47.929233 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3536/7010] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:15:47 2022] DELETE /identity/v3/projects/f523714f06e1427cb2532d3bf68366b1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:47.930921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:47.931462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:47.931557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:47.969566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:47.970884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:48.113806 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3475/7011] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:48.121460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.121751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.122066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.168600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:48.169862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:48.196794 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3537/7012] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:48.201233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.222742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ef61-9756-48f7-b874-2d852aa1baf1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.237493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.238988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.239201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.239540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.240414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:15:48.240753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.242414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.273490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3476/7013] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:15:48.274337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.290741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766562-21ec-4360-9d11-8ce7a4170605 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.299087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.300354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.300870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.301304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.302248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.304779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.340158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3538/7014] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:48 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:48.344058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.355499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4212995-42df-475b-bdd3-cd591b886403 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.459928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.460667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.460952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.461233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.461989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.464070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.491286 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3477/7015] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:48 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:48.495807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.510895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c049-5fd8-4a07-bccd-663800411444 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.516613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.517752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.518280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.519391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.521468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.523656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.538044 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3539/7016] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:48.542271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.556343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d37d54-2616-4da2-8821-31245e6542d5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.563417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.564193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.564514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.564801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.568127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.572382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bf7d3-04ab-4e75-8188-dc5a2dd5a03b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.599023 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3478/7017] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:15:48.603374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:48.631484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6ab0-9b60-410f-92eb-1d04280e20fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:48.643402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:48.645105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.645571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.646007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] PATH_INFO: `/v3/projects/73f99ad4a6bf4ec5ad3d7d4045018511/users/986a98734ff4476e83fcfbbf337274ca/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.687793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f99ad4a6bf4ec5ad3d7d4045018511, user_id=986a98734ff4476e83fcfbbf337274ca, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:48.695845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:48.729367 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3540/7018] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:48 2022] PUT /identity/v3/projects/73f99ad4a6bf4ec5ad3d7d4045018511/users/986a98734ff4476e83fcfbbf337274ca/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:48.740372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:48.740935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:48.741405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:48.809027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] MFA Rules not processed for user `986a98734ff4476e83fcfbbf337274ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:48.810447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:48.978359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3479/7019] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:48.984318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:49.137322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb20616-5f23-405e-9c59-a4d253790638 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:49.149537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:49.150522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.150956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.151405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.152275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:49.155463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:49.228786 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3541/7020] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:48 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:49.233414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:49.260016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f698d-91b8-4891-a86f-9a6538464800 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:49.421197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:49.422124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.422575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.423015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.423871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:49.430903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:49.489981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3480/7021] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:49 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:49.494211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:49.510341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f49a4-af30-4f18-8841-bde96e916724 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:49.527722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:49.528718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.529169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.529610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.530537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:49.532316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:49.574061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3542/7022] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:49.578175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:49.597282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c9d6-0954-4a4a-a885-4649c4ec28b3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:49.608300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:49.609160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.609632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.610075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.610994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:49.613398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091b5be-8f3f-4dc6-a2c9-01b5ca98a469 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:49.643094 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3481/7023] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:49.646981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:49.662405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254587c6-b5e0-47b1-84df-e453bc44133d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:49.676208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:49.678443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.678946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.679437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] PATH_INFO: `/v3/projects/96b7ec44448a40da864d462f75628fde/users/d11afedb121f4cffb4a9899738372524/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.717624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b7ec44448a40da864d462f75628fde, user_id=d11afedb121f4cffb4a9899738372524, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:49.721133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:49.743353 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3543/7024] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:49 2022] PUT /identity/v3/projects/96b7ec44448a40da864d462f75628fde/users/d11afedb121f4cffb4a9899738372524/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:15:49.757984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:49.759076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:49.759429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:49.833057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] MFA Rules not processed for user `d11afedb121f4cffb4a9899738372524`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:49.834271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:49.935405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3482/7025] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:49.941530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.045961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157e11-ad8a-40d5-9a55-e3e2e633c9c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.055538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.056509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.056957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.057392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.060310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.064485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.121596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3544/7026] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:15:49 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:50.122859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.142823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0602b87-b273-4076-bdfe-acc25ab6779a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.335743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.336584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.336941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.337864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.338634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.351594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.396104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3483/7027] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:15:50 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:15:50.400258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.413134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f805-edf2-4fc8-aebe-69bcf0ef0404 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.419379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.420170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.420567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.421184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.422153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.423911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.437765 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3545/7028] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:50.447541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.469535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133217d-20ce-4c73-b732-15ac8097c17e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.477093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.478696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.478981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.479263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] PATH_INFO: `/v3/projects/0dbb418c5e264552a2fc6fb651964c34/users/bcf586636b3d451eab0e4c23871346cd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.499443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbb418c5e264552a2fc6fb651964c34, user_id=bcf586636b3d451eab0e4c23871346cd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.504409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.547603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3484/7029] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:50 2022] PUT /identity/v3/projects/0dbb418c5e264552a2fc6fb651964c34/users/bcf586636b3d451eab0e4c23871346cd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:50.552250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.567538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0912fe8-08c4-41d9-8921-70ec534ff37d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.673762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.691182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.691790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.692851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.693815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.697235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc96c3-86be-440b-a63b-fef36fc078bd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.720793 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3546/7030] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:15:50.725284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:50.764281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fd2fc-392f-45a4-83cb-7641f4884bb0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:50.790925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:50.794433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.794636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.796010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] PATH_INFO: `/v3/projects/0dbb418c5e264552a2fc6fb651964c34/users/bcf586636b3d451eab0e4c23871346cd/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.804427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbb418c5e264552a2fc6fb651964c34, user_id=bcf586636b3d451eab0e4c23871346cd, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:50.811050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c750-7a7d-474f-8e86-7dc31e4bd693 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:50.845414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3485/7031] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:15:50 2022] PUT /identity/v3/projects/0dbb418c5e264552a2fc6fb651964c34/users/bcf586636b3d451eab0e4c23871346cd/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:15:50.856758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:50.857593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:50.858302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:50.959918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] MFA Rules not processed for user `bcf586636b3d451eab0e4c23871346cd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:50.966546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:51.097443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:51.097736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:51.098206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:51.114190 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3547/7032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:51.120923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:51.123132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:51.137715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:15:51.140395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:51.278372 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3486/7033] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:15:51.278658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67baf50-f236-4633-b31f-d0fc4b1a01ad None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:51.287516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:51.288803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:51.289089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:51.289370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:51.399558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:51.401778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc934186-16c6-4987-8ede-75837da88537 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:51.419372 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3548/7034] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:15:56.681752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:15:56.683387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:15:56.868809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec00b-a644-4f11-bbf2-30f344eee499 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:15:56.880397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:15:56.881379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:15:56.881830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:15:56.882259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:15:56.894290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:15:56.896010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09456dc-f566-403c-99b1-2d2675714077 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:15:56.911018 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3487/7035] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:15:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:16:04.538985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:04.539878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:04.540683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:04.612359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] MFA Rules not processed for user `986a98734ff4476e83fcfbbf337274ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:04.615492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:04.638887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3549/7036] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:07.635747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1946-6baa-496c-a792-b7d9e19ba4d4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:07.636348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1946-6baa-496c-a792-b7d9e19ba4d4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:07.636348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1946-6baa-496c-a792-b7d9e19ba4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:07.753889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ab6c1946-6baa-496c-a792-b7d9e19ba4d4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:07.755862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ab6c1946-6baa-496c-a792-b7d9e19ba4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:07.898984 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3488/7037] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:07.976023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:07.980119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:08.296297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179afb4b-8284-432f-ab8d-139a28cd0a45 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:08.319617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:08.321720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:08.322073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:08.323418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:08.367575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:08.373111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79da3f-b4b5-43e1-b97e-ed8cdc5b7547 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:08.390510 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3550/7038] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:16:20.000854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:20.001555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:20.001555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:20.044533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:20.046160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:20.063060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3489/7039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:40.050554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b8f2a-48c2-480a-8e5a-588c6e459843 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:40.051092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b8f2a-48c2-480a-8e5a-588c6e459843 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:40.051322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b8f2a-48c2-480a-8e5a-588c6e459843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:40.087294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-524b8f2a-48c2-480a-8e5a-588c6e459843 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:40.088988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-524b8f2a-48c2-480a-8e5a-588c6e459843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:40.098917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3551/7040] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:43.133534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:43.135758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:43.253737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399015d-eea3-49bc-aa68-a128cb40b1cb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:43.260130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:43.261334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:43.261788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:43.262299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] PATH_INFO: `/v3/users/6b2dbf34082047068b0bdc4dfd77f811` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:43.263705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2dbf34082047068b0bdc4dfd77f811)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:43.266590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:43.325922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2dbf34082047068b0bdc4dfd77f811'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:43.340905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2dbf34082047068b0bdc4dfd77f811'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:43.341816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2dbf34082047068b0bdc4dfd77f811'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:43.350904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2dbf34082047068b0bdc4dfd77f811'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:43.361263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2dbf34082047068b0bdc4dfd77f811'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:43.374114 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3490/7041] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:16:43 2022] DELETE /identity/v3/users/6b2dbf34082047068b0bdc4dfd77f811 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:16:43.379932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:43.381592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:43.381989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:43.416079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:43.418555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:43.571896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3552/7042] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:16:43.583973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:43.585504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:43.710102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711c18d-e695-4abf-8c56-c07e04013cf8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:43.716257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:43.717211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:43.717677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:43.718116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:43.736091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:43.738094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a088-a620-4944-a10c-20d757ed4e44 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:43.752865 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3491/7043] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:16:44.731859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:44.733369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:44.750586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98819958-f585-4c6b-a2cb-3b00b4b1647f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:44.757019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:44.758142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:44.758620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:44.759323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] PATH_INFO: `/v3/projects/81bf4fa12da74e6c8f6c5aa3ddd40d26` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:44.760799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bf4fa12da74e6c8f6c5aa3ddd40d26)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:44.763040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:44.858647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bf4fa12da74e6c8f6c5aa3ddd40d26', 'request_id': 'req-c0d95274-e3d9-4287-8ff1-940f2d6478d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:44.866249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bf4fa12da74e6c8f6c5aa3ddd40d26', 'request_id': 'req-c0d95274-e3d9-4287-8ff1-940f2d6478d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:44.877456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bf4fa12da74e6c8f6c5aa3ddd40d26', 'request_id': 'req-c0d95274-e3d9-4287-8ff1-940f2d6478d0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:44.892934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] The token cache is being invalidate because project 81bf4fa12da74e6c8f6c5aa3ddd40d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:16:44.894525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:44.896684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c0d95274-e3d9-4287-8ff1-940f2d6478d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:16:44.898399 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3553/7044] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:16:44 2022] DELETE /identity/v3/projects/81bf4fa12da74e6c8f6c5aa3ddd40d26 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:16:44.903985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:44.905341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:44.906008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:44.933136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:44.936138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:45.046089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3492/7045] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:45.054199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.054789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.055779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.080605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:45.082403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:45.091579 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3554/7046] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:45.096990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.110379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b46d9-a6bb-44a7-ae49-4537d271b62b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.122600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.124849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.126105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.126567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.127567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:16:45.128303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.130782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.161346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3493/7047] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:16:45.165686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.179209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa016c6-100b-40b5-af06-ba6ebaf065c3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.188629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.189406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.190591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.190955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.191733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.195615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.245131 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3555/7048] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:16:45 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:16:45.246538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.264572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b647-0dd5-445e-b9d6-b0f8e4208fd4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.336610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.337239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.337537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.337994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.339322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.340675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.371497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.372707 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3494/7049] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:16:45 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:16:45.387955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73362d62-8300-44bd-b325-cfa5bcbb4fe6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.397059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.397755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.398052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.398340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.399216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.402244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.415759 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3556/7050] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:16:45.419782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.433394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80379-a298-460a-80ad-a7a741b98ebd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.443834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.444895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.445361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.445844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.446585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.448865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57cda-d771-43e2-b4d3-b7cf4c48f844 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.463930 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3495/7051] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:16:45.467868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.478502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d564c7f-ce7b-43b8-8280-ee9107a5b409 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.483875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.485914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.486396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.486868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] PATH_INFO: `/v3/projects/9c1889b2ec3b47ba8d9acf747c541c88/users/f3309d5df6634ffdbff686da7afefca5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.518865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1889b2ec3b47ba8d9acf747c541c88, user_id=f3309d5df6634ffdbff686da7afefca5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.522604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.560701 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3557/7052] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:16:45 2022] PUT /identity/v3/projects/9c1889b2ec3b47ba8d9acf747c541c88/users/f3309d5df6634ffdbff686da7afefca5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:16:45.570768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.571060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.571338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.605731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] MFA Rules not processed for user `f3309d5df6634ffdbff686da7afefca5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:16:45.607290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:45.723762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3496/7053] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:16:45.760126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:45.763120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:45.863719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a687f-7b87-4e96-9514-ad3deb79cdf2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:45.871237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:45.871981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:45.872340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:45.872647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:45.885213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:45.886847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:45.899159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3558/7054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:16:51.574169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:51.589768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240cad-0a1c-4cc4-b4b0-c3c66ef460d1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:51.613477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:51.614829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:51.615214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:51.615634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:51.620994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:51.737878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:51.739442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:51.759064 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3497/7055] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:16:52.678447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:16:52.679948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:52.694466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d607c-04db-4706-8b57-49eea71d9396 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:16:52.703934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:16:52.704672 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:16:52.704954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:16:52.705438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:16:52.707527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:16:52.726528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:16:52.728201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186146-edce-49f8-b96f-50c99289a873 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:16:52.743873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3559/7056] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:00.212832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:00.233491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690701c0-d3ce-453b-8f31-19e6048e8063 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:00.243844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:00.245313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:00.245727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:00.246118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:00.250518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:00.284025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:00.286502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:00.309439 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3498/7057] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:03.555125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110e3f9-9aa7-49b2-a616-27decd710ec9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:03.555611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110e3f9-9aa7-49b2-a616-27decd710ec9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:03.555702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110e3f9-9aa7-49b2-a616-27decd710ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:03.573034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2110e3f9-9aa7-49b2-a616-27decd710ec9 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:03.574259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2110e3f9-9aa7-49b2-a616-27decd710ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:03.638312 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3560/7058] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:03.657581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:03.659896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:03.787072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18f04-d8b4-49eb-9e17-c81f1ff3de2b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:03.794373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:03.795254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:03.795702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:03.796432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:03.806694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:03.808882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:03.820342 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3499/7059] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:17:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:05.173834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9a67-b265-4194-b2f9-1049428164a5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:05.174437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9a67-b265-4194-b2f9-1049428164a5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:05.174657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9a67-b265-4194-b2f9-1049428164a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:05.224685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e9d9a67-b265-4194-b2f9-1049428164a5 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:05.226172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e9d9a67-b265-4194-b2f9-1049428164a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:05.314341 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3561/7060] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:11.711688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:11.788952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a841-4595-47f3-86f3-2d60820f75fe service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:11.794574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:11.796613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:11.797152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:11.797452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] PATH_INFO: `/v3/users/f3309d5df6634ffdbff686da7afefca5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:11.798808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3309d5df6634ffdbff686da7afefca5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:11.801137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:11.868618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3309d5df6634ffdbff686da7afefca5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:11.881964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3309d5df6634ffdbff686da7afefca5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:11.882818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3309d5df6634ffdbff686da7afefca5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:11.891693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3309d5df6634ffdbff686da7afefca5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:11.900991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92caef7e-4c07-4108-a8c9-635610f6f4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3309d5df6634ffdbff686da7afefca5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:11.907806 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3500/7061] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:11 2022] DELETE /identity/v3/users/f3309d5df6634ffdbff686da7afefca5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:11.912151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:11.912691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:11.912786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:11.933978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:11.935310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:12.022202 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3562/7062] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:12.039638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:12.039936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:12.040222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:12.066706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] MFA Rules not processed for user `08aca3700d594a349789d5f3847894dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:12.068209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:12.077901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:12.079576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:12.168348 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3501/7063] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:12.175361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eae98-4a2a-4772-b3e2-55a0f5932d4b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:12.181097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:12.182125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:12.182564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:12.183011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:12.195157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:12.200217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c153e-16ac-4c3f-ac07-7f9fb7bc4c3c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:12.240744 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3563/7064] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:12.950643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:12.954556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:12.980933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a90e-a0cf-4329-af7d-b703e7ae433b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:12.993512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:12.995066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:12.996679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:12.997073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] PATH_INFO: `/v3/projects/9c1889b2ec3b47ba8d9acf747c541c88` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:12.998813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1889b2ec3b47ba8d9acf747c541c88)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.002421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.128977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1889b2ec3b47ba8d9acf747c541c88', 'request_id': 'req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:13.136643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1889b2ec3b47ba8d9acf747c541c88', 'request_id': 'req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:13.159494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1889b2ec3b47ba8d9acf747c541c88', 'request_id': 'req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:13.189969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] The token cache is being invalidate because project 9c1889b2ec3b47ba8d9acf747c541c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:13.190397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:13.191342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab00be3e-8b76-4e83-a33d-55f5fb5340ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:13.196359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3502/7065] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:12 2022] DELETE /identity/v3/projects/9c1889b2ec3b47ba8d9acf747c541c88 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:13.201411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.201931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.202019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.238570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:13.239827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:13.344088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3564/7066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:13.352277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.352842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.353324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.373777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:13.375379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:13.387749 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3503/7067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:13.392822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.410526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bb86a-396f-4084-9df2-236bbaf4daa4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.449413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.450695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.451206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.453065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.454036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:13.454570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.456823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.482063 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3565/7068] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:17:13.487319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.504488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6788a2-195c-4e83-a3c5-e3e756b585b7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.511051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.512755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.513052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.513710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.515661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.519060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.573028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3504/7069] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:13 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:13.578995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.593931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9ddc7-7b18-4086-9839-6e5eccd97e66 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.680665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.681830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.682285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.683538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.684516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.705059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.740934 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3566/7070] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:13 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:13.741130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.766102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317819e3-2572-42c6-bed9-800df4fcc24b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.775977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.776987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.777427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.778019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.779650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.781553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.799147 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3505/7071] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:13.804257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.832298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88070-a8ce-429c-9c87-93223fdf5e02 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.847916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.849018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.849018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.849258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.849989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.851620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1909e-3b8d-48a1-aa23-92cb08f18d31 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.879212 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3567/7072] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:13.883403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:13.902558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d807b-64c6-4a4d-9f4a-33e9e0ae876a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:13.909593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:13.910890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.911279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.911656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] PATH_INFO: `/v3/projects/bac1a7112d804c72b8eb77d4ce4eadfb/users/28bda8838d60479bb4b235a360e6be1e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:13.950476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac1a7112d804c72b8eb77d4ce4eadfb, user_id=28bda8838d60479bb4b235a360e6be1e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:13.954372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:13.975272 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3506/7073] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:13 2022] PUT /identity/v3/projects/bac1a7112d804c72b8eb77d4ce4eadfb/users/28bda8838d60479bb4b235a360e6be1e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:13.987048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:13.987581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:13.988049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.018598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] MFA Rules not processed for user `28bda8838d60479bb4b235a360e6be1e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:14.020321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:14.221862 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3568/7074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:14.222800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.376510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195246ee-f410-4208-b5e2-78406c3b9c51 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.387850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.388941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.389415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.390037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.391003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.395363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.453511 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3507/7075] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:14 2022] POST /identity/v3/projects => generated 363 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:14.454362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.468949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dfec6-9812-469a-9ebd-f1d54736399e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.541806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.542483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.542767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.543043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.543759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.545695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.572560 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3569/7076] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:14 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:14.575295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.586571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1c333-c5a0-408a-a119-2c0b6fb0fa18 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.591394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.592067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.593900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.594167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.595232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.596912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.612412 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3508/7077] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:14.613701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.624439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88bb6f-5c6b-4b10-b02b-ca3edd7220b6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.629291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.630499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.630628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.630860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] PATH_INFO: `/v3/projects/103d2f678f92482e9dd46274c39f66a9/users/db8670ba0a3e4eee8fc4aca55875bc3e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.647560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103d2f678f92482e9dd46274c39f66a9, user_id=db8670ba0a3e4eee8fc4aca55875bc3e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.650593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.666275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3570/7078] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:14 2022] PUT /identity/v3/projects/103d2f678f92482e9dd46274c39f66a9/users/db8670ba0a3e4eee8fc4aca55875bc3e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:14.671337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.684122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f30e0-3c76-47b4-b8ee-74543acd7403 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.766362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.767238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.768576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.769411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.770338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.772492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faec82-d10f-4fa9-920c-ae2de0e1b540 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.785600 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3509/7079] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:14.791177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:14.807487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6deb2d-8750-4af5-81b3-33f2f66bd1e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:14.817537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:14.822362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.822362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.822362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] PATH_INFO: `/v3/projects/103d2f678f92482e9dd46274c39f66a9/users/db8670ba0a3e4eee8fc4aca55875bc3e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.825786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=103d2f678f92482e9dd46274c39f66a9, user_id=db8670ba0a3e4eee8fc4aca55875bc3e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:14.830196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:14.870562 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3571/7080] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:14 2022] PUT /identity/v3/projects/103d2f678f92482e9dd46274c39f66a9/users/db8670ba0a3e4eee8fc4aca55875bc3e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:14.875582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:14.875881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:14.876156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:14.924829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] MFA Rules not processed for user `db8670ba0a3e4eee8fc4aca55875bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:14.926871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:15.058536 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3510/7081] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:15.071422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:15.074237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:15.167575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4cc9b-fb47-457e-93e9-9636bb7360bb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:15.172335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:15.173483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:15.173831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:15.174193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:15.191061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:15.192874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:15.225334 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3572/7082] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:15.348710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:15.369021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3ae1-2f30-4fd0-83e8-d141f0de27e1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:15.375777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27857978-db01-4526-b99d-911d92702067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:15.376298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857978-db01-4526-b99d-911d92702067 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:15.376679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857978-db01-4526-b99d-911d92702067 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:15.376964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27857978-db01-4526-b99d-911d92702067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:15.511663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27857978-db01-4526-b99d-911d92702067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:15.513519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27857978-db01-4526-b99d-911d92702067 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:15.544803 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3511/7083] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:18.796600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:18.869396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e724-296f-4747-a633-33d5458fbd6b service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:18.874965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:18.876221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:18.876530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:18.877196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] PATH_INFO: `/v3/users/28bda8838d60479bb4b235a360e6be1e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:18.879356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bda8838d60479bb4b235a360e6be1e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:18.882207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:18.960780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bda8838d60479bb4b235a360e6be1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:18.974875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bda8838d60479bb4b235a360e6be1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:18.977445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bda8838d60479bb4b235a360e6be1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:18.979634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bda8838d60479bb4b235a360e6be1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:19.002637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bda8838d60479bb4b235a360e6be1e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:19.026844 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3573/7084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:18 2022] DELETE /identity/v3/users/28bda8838d60479bb4b235a360e6be1e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:19.031192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:19.031754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:19.032053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:19.052796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:19.054318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:19.129082 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3512/7085] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:19.138826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:19.141000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:19.225398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91720c77-0cc8-4a91-a866-cc0b804a14c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:19.229801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:19.230669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:19.231119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:19.231585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:19.244341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:19.245910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:19.262014 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3574/7086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:20.146807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:20.149311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:20.163698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6bfa1-5d04-4b36-ae5a-3fe7b0b417cb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:20.173081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:20.177260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:20.177618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:20.178098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] PATH_INFO: `/v3/projects/bac1a7112d804c72b8eb77d4ce4eadfb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:20.185637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac1a7112d804c72b8eb77d4ce4eadfb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:20.188135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:20.250775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac1a7112d804c72b8eb77d4ce4eadfb', 'request_id': 'req-b40584b6-9963-4ae3-ae86-e254e273d5df'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.258168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac1a7112d804c72b8eb77d4ce4eadfb', 'request_id': 'req-b40584b6-9963-4ae3-ae86-e254e273d5df'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.265158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac1a7112d804c72b8eb77d4ce4eadfb', 'request_id': 'req-b40584b6-9963-4ae3-ae86-e254e273d5df'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.285983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] The token cache is being invalidate because project bac1a7112d804c72b8eb77d4ce4eadfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:20.286710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.288700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.291122 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3513/7087] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:20 2022] DELETE /identity/v3/projects/bac1a7112d804c72b8eb77d4ce4eadfb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:20.296602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:20.310346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f2993-3544-4f5b-9495-a2d505003d81 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:20.400558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:20.401858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:20.402320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:20.402811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] PATH_INFO: `/v3/users/db8670ba0a3e4eee8fc4aca55875bc3e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:20.413899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8670ba0a3e4eee8fc4aca55875bc3e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:20.417169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:20.487301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8670ba0a3e4eee8fc4aca55875bc3e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.497995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8670ba0a3e4eee8fc4aca55875bc3e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.499598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8670ba0a3e4eee8fc4aca55875bc3e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.500727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8670ba0a3e4eee8fc4aca55875bc3e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.511547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f3e568eb-0430-4018-9141-063156db75ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8670ba0a3e4eee8fc4aca55875bc3e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:20.535177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3575/7088] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:20 2022] DELETE /identity/v3/users/db8670ba0a3e4eee8fc4aca55875bc3e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:20.996663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:20.998357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:21.018227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40584b6-9963-4ae3-ae86-e254e273d5df admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.112842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.114662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.115095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.115385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] PATH_INFO: `/v3/projects/103d2f678f92482e9dd46274c39f66a9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.118223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103d2f678f92482e9dd46274c39f66a9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.120224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.200788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103d2f678f92482e9dd46274c39f66a9', 'request_id': 'req-ad09cc7a-f977-441a-8a55-8561ae1da9e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:21.208913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103d2f678f92482e9dd46274c39f66a9', 'request_id': 'req-ad09cc7a-f977-441a-8a55-8561ae1da9e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:21.218397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103d2f678f92482e9dd46274c39f66a9', 'request_id': 'req-ad09cc7a-f977-441a-8a55-8561ae1da9e8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:21.235436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] The token cache is being invalidate because project 103d2f678f92482e9dd46274c39f66a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:21.235753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:21.236399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ad09cc7a-f977-441a-8a55-8561ae1da9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:21.238382 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3514/7089] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:20 2022] DELETE /identity/v3/projects/103d2f678f92482e9dd46274c39f66a9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:21.243305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.244075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.244075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.269732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:21.271378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:21.365781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.366415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.366868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.376439 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3576/7090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:21.391180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:21.392696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:21.409057 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3515/7091] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:21.409283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.419531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19542922-67e2-4f40-ac71-3d16f2a7b622 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.429183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.430066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.430520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.430984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.440805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:21.440805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.440805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.458777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3577/7092] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:17:21.463275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.477979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3dd48-81cd-4c3d-85d6-07ccbd7d365a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.489096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.489789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.490080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.490369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.491130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.493392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.542186 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3516/7093] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:21 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:21.546856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.562498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea62da-e787-4fe2-a8f3-24900c96c594 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.626298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.627593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.627593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.627593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.628220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.630300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.659721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3578/7094] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:21 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:21.660972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.672493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec8b5-4447-4cf2-88cf-e338de85c509 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.678728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.679514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.680209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.680375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.681266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.683911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.713745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3517/7095] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:17:21.715405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.731686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373622a-84e3-43f3-9b00-6cb54159236e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.742529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.744721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.747212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.747964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.751795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.758036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8c05-bd11-4828-be79-5b9c5f997e54 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.783589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:21.796949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3579/7096] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:21.813011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198b43-8a4c-4e88-8743-b7937ffc438a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:21.827144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:21.828407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.828930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.829365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] PATH_INFO: `/v3/projects/bdd4fc60def4456798130d3fcadb83da/users/96cae46738834216b9d7cb13be80452e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.856500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd4fc60def4456798130d3fcadb83da, user_id=96cae46738834216b9d7cb13be80452e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:21.863169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:21.889408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3fe5b-1bd1-418c-9e37-b33103772c4a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:21.889699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3fe5b-1bd1-418c-9e37-b33103772c4a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:21.889980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3fe5b-1bd1-418c-9e37-b33103772c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:21.891339 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3518/7097] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:21 2022] PUT /identity/v3/projects/bdd4fc60def4456798130d3fcadb83da/users/96cae46738834216b9d7cb13be80452e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:21.909343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9bc3fe5b-1bd1-418c-9e37-b33103772c4a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:21.911678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9bc3fe5b-1bd1-418c-9e37-b33103772c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:21.994123 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3580/7098] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:22.006162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:22.009655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:22.129520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712844fa-248b-4498-9d69-2c95d17836e1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:22.137361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:22.137934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:22.138233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:22.138514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:22.171572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:22.174219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:22.193067 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3519/7099] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:23.792109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:23.793093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:23.793516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:23.831922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] MFA Rules not processed for user `96cae46738834216b9d7cb13be80452e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:23.834076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:23.961525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:23.968572 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3581/7100] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:23.979619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723fbb-3508-4a17-b88a-dc8450f8d1eb service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.001766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.002864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.003603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.005755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.008211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.018200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f789-c245-46c2-a9c1-7175d4624b80 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.091990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:24.093648 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3520/7101] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:23 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:24.118773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2219-9ac8-43f2-a01c-ed1698f894bc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.157578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.157863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.159163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.220686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] MFA Rules not processed for user `8b84c577baf8418180f894c99c643772`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:24.222212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:24.320266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.321998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.322459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.323055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.323944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.333112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.382234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3582/7102] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:24 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:24.386799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:24.387863 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3521/7103] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:24.427624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fa0a-83ca-410f-a082-b12c12932629 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.432969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.433893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.434348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.434790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.435815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.437924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.472348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3583/7104] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:24.476477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:24.504645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50092-096f-47ec-9450-b8fc92bbd874 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.510504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.512349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.512883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.513360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] PATH_INFO: `/v3/projects/3a51c5a49425493d9c8e4449996641bb/users/b3ab42ab0b534304aa5f8b0c9af4e87d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.534392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a51c5a49425493d9c8e4449996641bb, user_id=b3ab42ab0b534304aa5f8b0c9af4e87d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.538169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.558310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3522/7105] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:24 2022] PUT /identity/v3/projects/3a51c5a49425493d9c8e4449996641bb/users/b3ab42ab0b534304aa5f8b0c9af4e87d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:24.562160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:24.585469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5714-301a-468a-ac9f-80c2f8766639 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.761922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.762717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.764798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.764994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.768900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.774866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.810026 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3584/7106] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:24.814061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:24.830626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77b1a-e2cd-47b1-8bea-a773635f6f48 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:24.856028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:24.858698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:24.859356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:24.860143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] PATH_INFO: `/v3/projects/3a51c5a49425493d9c8e4449996641bb/users/b3ab42ab0b534304aa5f8b0c9af4e87d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:24.863167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a51c5a49425493d9c8e4449996641bb, user_id=b3ab42ab0b534304aa5f8b0c9af4e87d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:24.866773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eb71c-38c4-4be4-bca9-6086cc24d755 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:24.886232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3523/7107] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:24 2022] PUT /identity/v3/projects/3a51c5a49425493d9c8e4449996641bb/users/b3ab42ab0b534304aa5f8b0c9af4e87d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:25.682517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:25.685905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:25.813732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695340c-70e4-436d-9964-5eeff8af2002 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:25.917362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:25.918080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:25.918434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:25.919561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:25.922408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:25.942686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:25.944750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0bff-0a9f-4995-adbd-8235e2a5f247 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:25.962958 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3585/7108] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:26.299480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:26.300081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:26.300081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:26.366298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] MFA Rules not processed for user `b3ab42ab0b534304aa5f8b0c9af4e87d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:26.368237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:26.549144 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3524/7109] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:26.560957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:26.561256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:26.561728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:26.585875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] MFA Rules not processed for user `96cae46738834216b9d7cb13be80452e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:26.587439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:26.650559 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3586/7110] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:26.665173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:26.666704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:26.825676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dab50-bbeb-4b95-889c-19f059ddcd7a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:26.841233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:26.842799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:26.843068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:26.843503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:26.868734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:26.870360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:26.900296 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3525/7111] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:27.192486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:27.199237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:27.332983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2d393-2e30-42d6-85f3-9044f56cde10 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:27.337818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:27.338730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:27.339018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:27.339297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:27.341335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:27.414784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:27.417172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:27.431627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3587/7112] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:17:29.938970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:29.955241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230705-a43d-4bed-bf5e-96259ad79254 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:29.966904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:29.968124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:29.968623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:29.969065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:29.971189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:29.989210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:29.990939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:30.007392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3526/7113] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:35.753315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:35.755436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:35.770971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36d8c7-c5fb-41f3-88ac-1f95c4a832a9 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:35.777267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:35.778383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:35.778589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:35.778885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] PATH_INFO: `/v3/users/27f570c67ed24546ac51341ef8ea2439` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:35.780301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f570c67ed24546ac51341ef8ea2439)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:35.782125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:35.840247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f570c67ed24546ac51341ef8ea2439'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:35.856666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f570c67ed24546ac51341ef8ea2439'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:35.857505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f570c67ed24546ac51341ef8ea2439'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:35.858548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f570c67ed24546ac51341ef8ea2439'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:35.872551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7debc67f-d76e-4a59-bfdc-9ddda503387e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f570c67ed24546ac51341ef8ea2439'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:35.894285 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3588/7114] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:35 2022] DELETE /identity/v3/users/27f570c67ed24546ac51341ef8ea2439 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:36.116080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.134696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b48ec1-db07-4644-9f22-1aa3112049b2 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.251680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.253584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.254080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.254575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] PATH_INFO: `/v3/projects/e25481b7efed4632bcd054e2cec3b161` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.255858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25481b7efed4632bcd054e2cec3b161)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.257843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.341384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25481b7efed4632bcd054e2cec3b161', 'request_id': 'req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:36.350155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25481b7efed4632bcd054e2cec3b161', 'request_id': 'req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:36.363371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25481b7efed4632bcd054e2cec3b161', 'request_id': 'req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:36.397834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] The token cache is being invalidate because project e25481b7efed4632bcd054e2cec3b161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:36.398260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:36.399273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b3d309e2-e64c-4ee7-bc0e-91f34d566ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:36.402089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3527/7115] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:36 2022] DELETE /identity/v3/projects/e25481b7efed4632bcd054e2cec3b161 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:36.407855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.408153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.408509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.430483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:36.431718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:36.500759 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3589/7116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:36.508362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.508760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.509282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.533629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:36.535483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:36.549209 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3528/7117] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:36.553827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.565839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10150-1436-43a9-af4d-8ac6f5d017e2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.579116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.580255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.580799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.581306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.582404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:36.582835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.585507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.604093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3590/7118] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:17:36.605515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.618561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83bc9a-4c23-48d9-9f74-57476431825a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.625754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.626688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.627502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.627866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.629292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.632552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.680179 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3529/7119] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:36 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:36.684667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.698559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c4146-fe05-4c2e-849c-11b94749597f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.774011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.776294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.776971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.777440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.778809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.781400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.815013 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3591/7120] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:36 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:36.819160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.834173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d30be-5dae-4b45-af5b-54ef61c02807 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.851330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.852045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.852336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.852782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.853539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.855837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.880349 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3530/7121] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:36.881327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.899104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781a1-13b4-4090-a4dc-d6dddc65a1a6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.905918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.906938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.907516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.908022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.909012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.912308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9314d4-d4ff-4d6b-a358-bffc4d9ca9b6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:36.928267 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3592/7122] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:36.933015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:36.953133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04a429-c0f1-4cd8-aebc-fcd772ce71fd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:36.958408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:36.959414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:36.959705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:36.959981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] PATH_INFO: `/v3/projects/f97a5ac274614973bfd3070db537d0b0/users/df9b3a6417fa482a8d2feb3552fec06d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:36.976180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97a5ac274614973bfd3070db537d0b0, user_id=df9b3a6417fa482a8d2feb3552fec06d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:36.979425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:37.006639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3531/7123] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:36 2022] PUT /identity/v3/projects/f97a5ac274614973bfd3070db537d0b0/users/df9b3a6417fa482a8d2feb3552fec06d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:37.013020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb020ab-f0f0-4fd1-809c-ee33c28f88f5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:37.013336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb020ab-f0f0-4fd1-809c-ee33c28f88f5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:37.013982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb020ab-f0f0-4fd1-809c-ee33c28f88f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:37.043865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eeb020ab-f0f0-4fd1-809c-ee33c28f88f5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:37.046542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eeb020ab-f0f0-4fd1-809c-ee33c28f88f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:37.133916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3593/7124] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:37.155043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:37.157727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:37.241076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77b61-f958-4110-b24d-596c3d8c522b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:37.246657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:37.247589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:37.248885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:37.249173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:37.262573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:37.266407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f104598-77c0-41ec-b0c1-b6e2901630a9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:37.280712 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3532/7125] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:38.169472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:38.170543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:38.170657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:38.212992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] MFA Rules not processed for user `df9b3a6417fa482a8d2feb3552fec06d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:38.214216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:38.329174 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3594/7126] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:38.344083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:38.344588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:38.344675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:38.373476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] MFA Rules not processed for user `df9b3a6417fa482a8d2feb3552fec06d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:38.374819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:38.382832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3533/7127] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:38.395419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:38.396884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:38.511999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe925e75-0d20-42b1-a374-b0986cbce86b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:38.518792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:38.519576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:38.519871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:38.520148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:38.529738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:38.530905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:38.540721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3595/7128] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:47.695530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:47.697508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:47.767547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cfc0-78c7-470d-a6c1-59fee0fbb9e0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:47.772222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:47.773220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:47.773517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:47.773805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:47.775680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:47.924531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:47.927229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ae2c-0fed-4dee-9307-dbdccce5245a service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:47.945603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3534/7129] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:49.348046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:49.350301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:49.381972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251fb1-025c-488f-a1c3-1692eb43f518 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:49.391820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:49.392884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:49.393265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:49.393639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] PATH_INFO: `/v3/users/d056bc10ea254f17bbb89c5fefd1c050` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:49.394944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d056bc10ea254f17bbb89c5fefd1c050)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:49.398705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:49.507065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd056bc10ea254f17bbb89c5fefd1c050'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:49.538288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd056bc10ea254f17bbb89c5fefd1c050'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:49.541125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd056bc10ea254f17bbb89c5fefd1c050'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:49.542129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd056bc10ea254f17bbb89c5fefd1c050'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:49.553909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd056bc10ea254f17bbb89c5fefd1c050'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:49.586458 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3596/7130] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:49 2022] DELETE /identity/v3/users/d056bc10ea254f17bbb89c5fefd1c050 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:49.587816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:49.588321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:49.588643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:49.616277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:49.617552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:49.700779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3535/7131] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:49.711081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:49.712783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:49.816829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d4ac9-6636-4d12-a359-1d510c26c92c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:49.825242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:49.826956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:49.827905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:49.828299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:49.840755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:49.843142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57c86-9502-4dfa-a99a-4fc712578fcf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:49.871113 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3597/7132] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:50.123238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:50.124989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:50.159879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b06fe-c561-4569-af72-2e0bc8cb2a48 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:50.167533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:50.168863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.169308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.169741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] PATH_INFO: `/v3/projects/fe5466912d1443d2adaba29a98b9f940` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.171114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5466912d1443d2adaba29a98b9f940)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:50.173366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:50.308294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5466912d1443d2adaba29a98b9f940', 'request_id': 'req-21479fdf-ba7e-4483-abc9-55ab1867d4a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:50.315604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5466912d1443d2adaba29a98b9f940', 'request_id': 'req-21479fdf-ba7e-4483-abc9-55ab1867d4a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:50.321701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5466912d1443d2adaba29a98b9f940', 'request_id': 'req-21479fdf-ba7e-4483-abc9-55ab1867d4a6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:50.340221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] The token cache is being invalidate because project fe5466912d1443d2adaba29a98b9f940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:50.340548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:50.341319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-21479fdf-ba7e-4483-abc9-55ab1867d4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:50.345566 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3536/7133] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:50 2022] DELETE /identity/v3/projects/fe5466912d1443d2adaba29a98b9f940 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:50.349913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.350376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.350490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.371744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:50.373528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:50.458785 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3598/7134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:50.467335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.468306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.469031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.510593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:50.511955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:50.536284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3537/7135] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:50.540905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:50.568486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae58b-266a-4dd5-8d57-8c46f8635b05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:50.576224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:50.577032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.577999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.578352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.579307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:50.579589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:50.582826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b057a2c-1e66-4fdd-b094-907a258de5f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:50.601088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3599/7136] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:17:50.602487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:50.613568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb0826-5bd3-4c36-99b8-4d2b6aa3de33 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:50.626767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:50.629610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.629904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.630047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.630181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.630491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.630876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.635821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:50.638535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:50.694353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] MFA Rules not processed for user `986a98734ff4476e83fcfbbf337274ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:50.698067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:50.708244 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3538/7137] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:50 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:50.713055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:50.850627 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3600/7138] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:50.894626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318c6e3-de79-4c86-ada4-8f01d8d63fcc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:50.910134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:50.911117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:50.911597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:50.914100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:50.915030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:50.920586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:50.969065 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3539/7139] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:50 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:50.970489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:50.984885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141ea9-22ad-474b-8171-6c596b1e92a8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:51.015198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:51.016190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:51.016779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:51.017281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:51.018239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:51.020090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:51.033170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3601/7140] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:51.037272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:51.051145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889935c-f2a5-4a9b-b7aa-1481e367f37d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:51.064157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:51.065515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:51.066114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:51.068138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:51.069189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:51.071084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c248f-59d8-4323-8c75-50c45de68398 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:51.092871 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3540/7141] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:17:51.097334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:51.112377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448ed62-cc5d-4438-b15b-ecf2186c11b1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:51.120181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:51.126669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:51.127324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:51.127831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] PATH_INFO: `/v3/projects/2e01bca9861644f1b3a842d31a790e8f/users/d272a985eb714e4398421571b9785a93/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:51.176053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e01bca9861644f1b3a842d31a790e8f, user_id=d272a985eb714e4398421571b9785a93, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:51.178885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:51.216000 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3602/7142] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:51 2022] PUT /identity/v3/projects/2e01bca9861644f1b3a842d31a790e8f/users/d272a985eb714e4398421571b9785a93/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:51.226110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:51.226408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:51.226685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:51.284353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] MFA Rules not processed for user `d272a985eb714e4398421571b9785a93`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:51.285643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:51.443446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3541/7143] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:51.499282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:51.503923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:51.687052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39233-a4bf-4df3-bbf0-0258d36dd2b9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:51.695869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:51.696701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:51.697088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:51.697483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:51.718718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:51.733336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a6fa7-972f-45c5-a495-433c27ec9a49 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:51.750634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3603/7144] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:52.173742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:52.324268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e809802-3d3f-443c-91ae-92d4bd25dc8a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:52.330224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:52.332312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:52.332312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:52.332638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] PATH_INFO: `/v3/users/d272a985eb714e4398421571b9785a93` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:52.334079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d272a985eb714e4398421571b9785a93)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:52.336417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:52.426026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd272a985eb714e4398421571b9785a93'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:52.443798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd272a985eb714e4398421571b9785a93'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:52.454711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd272a985eb714e4398421571b9785a93'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:52.467185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd272a985eb714e4398421571b9785a93'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:52.492743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd272a985eb714e4398421571b9785a93'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:52.514411 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3542/7145] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:52 2022] DELETE /identity/v3/users/d272a985eb714e4398421571b9785a93 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:52.515363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:52.515844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:52.516111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:52.547817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:52.553129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:52.720277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3604/7146] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:17:52.730397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:52.736258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:52.867848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4df9-e09f-4226-afe2-c6a5853817ba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:52.873616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:52.881350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:52.881860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:52.882341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:52.897893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:52.899940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d529c-8364-46e2-85ac-8d71dc23f1e8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:52.919429 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3543/7147] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:53.567961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:53.570123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:53.600449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa91c8-40dd-4986-8534-0c3d75d838a7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:53.605522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:53.606416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:53.607248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:53.607703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] PATH_INFO: `/v3/projects/2e01bca9861644f1b3a842d31a790e8f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:53.609299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e01bca9861644f1b3a842d31a790e8f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:53.611540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:53.707999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e01bca9861644f1b3a842d31a790e8f', 'request_id': 'req-2a44d9be-ea42-4bd6-b81a-20884da786fd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:53.715858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e01bca9861644f1b3a842d31a790e8f', 'request_id': 'req-2a44d9be-ea42-4bd6-b81a-20884da786fd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:53.724545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e01bca9861644f1b3a842d31a790e8f', 'request_id': 'req-2a44d9be-ea42-4bd6-b81a-20884da786fd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:53.736626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] The token cache is being invalidate because project 2e01bca9861644f1b3a842d31a790e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:53.736916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:53.737823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2a44d9be-ea42-4bd6-b81a-20884da786fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:53.739575 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3605/7148] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:53 2022] DELETE /identity/v3/projects/2e01bca9861644f1b3a842d31a790e8f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:53.745183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:53.745667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:53.745860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:53.765808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:53.767106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:53.837472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3544/7149] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:53.845258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:53.845881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:53.846313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:53.868035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:53.869365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:53.880596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3606/7150] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:53.882520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:53.895535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5eeaf-1654-40ae-94d3-84f43a34b415 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:53.900683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:53.901367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:53.901653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:53.902113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:53.903025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:53.903838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:53.905676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:53.925191 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3545/7151] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:17:53.929188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:53.943044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f128d6-b535-4faa-9283-40202b53ce5a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:53.951075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:53.951758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:53.952082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:53.952570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:53.953262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:53.955163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:53.985712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3607/7152] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:53 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:53.990481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:54.002266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf298b-d33b-4c0e-9765-fa672a64b075 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:54.076146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:54.077075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.077377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.077820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.078690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:54.080987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:54.111015 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3546/7153] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:53 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:17:54.115142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:54.127373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f49d1-b118-4852-9b90-ab0e21a8399a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:54.137325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:54.144744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.148419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.148927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.149925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:54.151740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:54.167753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3608/7154] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:54.168817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:54.182518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aeebf-1672-4423-953d-a83fbf8abfb8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:54.199095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:54.199562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.199854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.200305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.200922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:54.202742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c393-a39a-4132-965c-65b5359db18a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:54.217608 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3547/7155] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:17:54.219259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:54.230825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc622-b726-4b69-a13c-946443c28a12 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:54.239020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:54.240022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.240384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.240819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] PATH_INFO: `/v3/projects/552778e1fdfe4759ac6f731e4a7038c5/users/6bae848c15354448ba13348d3a77e853/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.261184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552778e1fdfe4759ac6f731e4a7038c5, user_id=6bae848c15354448ba13348d3a77e853, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:54.265115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:54.287777 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3609/7156] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:54 2022] PUT /identity/v3/projects/552778e1fdfe4759ac6f731e4a7038c5/users/6bae848c15354448ba13348d3a77e853/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:54.301522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.301917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.302215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.342460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] MFA Rules not processed for user `6bae848c15354448ba13348d3a77e853`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:54.344552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:54.521122 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3548/7157] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:54.577943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:54.580081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:54.686635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234fbbe-ee64-4ccb-acc5-560b9d9a8c91 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:54.691373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:54.692176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:54.692678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:54.693159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:54.707414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:54.709741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:54.724176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3610/7158] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:57.748660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:57.750210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:57.823014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898ec8-3267-42f5-a0a6-71a982d2ddd6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:57.827907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:57.828838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:57.829130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:57.829411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] PATH_INFO: `/v3/users/df9b3a6417fa482a8d2feb3552fec06d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:57.830660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9b3a6417fa482a8d2feb3552fec06d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:57.832654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:57.881470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9b3a6417fa482a8d2feb3552fec06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:57.893329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9b3a6417fa482a8d2feb3552fec06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:57.894090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9b3a6417fa482a8d2feb3552fec06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:57.902117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9b3a6417fa482a8d2feb3552fec06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:57.910199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c7f73e71-39e5-4b3f-9596-6c16cfc1dedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9b3a6417fa482a8d2feb3552fec06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:57.916262 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3549/7159] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:17:57 2022] DELETE /identity/v3/users/df9b3a6417fa482a8d2feb3552fec06d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:58.107712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.127056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690244c-4c82-4ab8-953b-b0c100c0a599 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.239559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.240367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.241169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.241463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] PATH_INFO: `/v3/projects/f97a5ac274614973bfd3070db537d0b0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.242681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97a5ac274614973bfd3070db537d0b0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.244620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.305267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97a5ac274614973bfd3070db537d0b0', 'request_id': 'req-48b91f14-897a-4f70-943d-3adbb78beccf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:58.315610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97a5ac274614973bfd3070db537d0b0', 'request_id': 'req-48b91f14-897a-4f70-943d-3adbb78beccf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:58.331857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97a5ac274614973bfd3070db537d0b0', 'request_id': 'req-48b91f14-897a-4f70-943d-3adbb78beccf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:58.352793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] The token cache is being invalidate because project f97a5ac274614973bfd3070db537d0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:17:58.353394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:58.354224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-48b91f14-897a-4f70-943d-3adbb78beccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:17:58.357151 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3611/7160] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:17:58 2022] DELETE /identity/v3/projects/f97a5ac274614973bfd3070db537d0b0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:17:58.366838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.367335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.367700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.389744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:58.391261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:58.481373 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3550/7161] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:58.482385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.482385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.482385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.512321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:58.513994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:58.523288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3612/7162] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:58.527656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.539907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47ea1-9e02-4a5b-b690-536e88b112e6 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.546343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.547072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.547368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.547649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.548376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:17:58.549239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.550995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.569173 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3551/7163] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:17:58.570330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.579586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064f8dc-6de0-47b4-87db-976d3d80cd9a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.584576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.585214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.585498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.585778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.586543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.588493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.618411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3613/7164] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:17:58 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:58.622861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.637829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe13a-6fd4-40a1-b18e-b3614e06b4af admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.706347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.707171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.707457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.707781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.708677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.711295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.746980 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3552/7165] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:17:58 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:17:58.748217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.764058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c28076-d0df-48ee-af16-9d5172884497 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.769938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.770623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.770908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.771187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.771909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.773574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.784958 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3614/7166] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:58.789115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.800026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f334d5-0f85-4241-867b-9e9f1073229f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.804734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.805435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.805750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.806031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.806781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.808388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf62b81-2a0c-45d3-bb6a-0f92cd316988 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.819310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3553/7167] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:17:58.823552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.838313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e87059-c550-458b-8087-0502a466a467 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:58.843122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:58.844077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.844442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.844806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] PATH_INFO: `/v3/projects/581bd6e5aa8549e88914f48abe9466c3/users/bf9fca6965154280ba112fb0026d500c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.859634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581bd6e5aa8549e88914f48abe9466c3, user_id=bf9fca6965154280ba112fb0026d500c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:58.862418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:58.875986 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3615/7168] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:17:58 2022] PUT /identity/v3/projects/581bd6e5aa8549e88914f48abe9466c3/users/bf9fca6965154280ba112fb0026d500c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:17:58.881269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9419-12d6-4a95-af56-6bec97f5cc18 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:58.881566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9419-12d6-4a95-af56-6bec97f5cc18 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:58.881852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9419-12d6-4a95-af56-6bec97f5cc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:58.900094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a7bf9419-12d6-4a95-af56-6bec97f5cc18 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:58.901302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a7bf9419-12d6-4a95-af56-6bec97f5cc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:58.961577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3554/7169] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:17:58.972336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:17:58.974158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:17:59.034582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc4d0-d855-4670-af5f-ae1fb02d2274 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:17:59.039122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:17:59.039882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:59.040276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:59.040820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:59.051363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:17:59.053088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:17:59.063542 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3616/7170] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:17:59.955611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:17:59.956260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:17:59.956569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:17:59.993518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] MFA Rules not processed for user `bf9fca6965154280ba112fb0026d500c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:17:59.994872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:00.083593 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3555/7171] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:00.088097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:00.101849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de282c-3126-4698-bfc2-de54c1754d12 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:00.116364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:00.118030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:00.118517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:00.119007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:00.120085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:00.123361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:00.173706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3617/7172] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:00 2022] POST /identity/v3/projects => generated 405 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:00.180358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:00.196621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e57beb-22e7-4bf6-9cbe-f01e7817158a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:00.290520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:00.291826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:00.292050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:00.292349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:00.293487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:00.295597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:00.323231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3556/7173] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:00 2022] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:00.327353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:00.345227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e9ca-6dcf-483b-abad-3ff9b1ce05fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:00.359538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:00.360226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:00.360564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:00.360847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:00.361577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:00.363187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:00.379506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3618/7174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:00.384595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:00.400882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390c6af-59af-4108-be7d-a2f6afc30351 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:00.407117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:00.407969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:00.408313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:00.408624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:00.409679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:00.411376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea467771-2e8c-4650-9f60-3151a6a8a9c0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:00.435759 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3557/7175] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:00.448760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:00.468680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c05039-53fe-447e-af1d-ac633a5c3b73 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:00.474371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:00.475457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:00.475845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:00.476224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] PATH_INFO: `/v3/projects/0eacea7c5e96458aadf1679f0627dd19/users/fb0c120a388b48e0bb4e0b12e5f013dd/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:00.647419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eacea7c5e96458aadf1679f0627dd19, user_id=fb0c120a388b48e0bb4e0b12e5f013dd, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:00.650116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d713647-222c-4505-b552-60705e53d9cf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:00.665204 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3619/7176] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:00 2022] PUT /identity/v3/projects/0eacea7c5e96458aadf1679f0627dd19/users/fb0c120a388b48e0bb4e0b12e5f013dd/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:01.724874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:01.725380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:01.725484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:01.775265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] MFA Rules not processed for user `fb0c120a388b48e0bb4e0b12e5f013dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:01.776632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:01.900534 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3558/7177] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:01.910284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:01.910859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:01.910859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:01.937410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] MFA Rules not processed for user `bf9fca6965154280ba112fb0026d500c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:01.938760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:02.014211 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3620/7178] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:02.124992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:02.129598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:02.151071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:02.152890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:02.235843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023218f-a6d9-4a00-a514-f33cc3f2a72e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:02.258688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:02.259819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:02.260407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:02.261062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:02.262170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2be56-0063-4633-8858-25849cf9ea52 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:02.274708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:02.277072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:02.277303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:02.278195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:02.279112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:02.279681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:02.282506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:02.291871 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3559/7179] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:02.305121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:02.308052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:02.330684 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3621/7180] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:08.805427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:08.820113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7e0e5-e70a-4196-bd9a-d9b8b6e305ef service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:08.827596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:08.828311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:08.828833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:08.829300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:08.833017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:08.867235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:08.868961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:08.902384 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3560/7181] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:10.160698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:10.162344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:10.242069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ddae2-de77-4e39-8232-3e0d74e5ef45 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:10.246887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:10.247789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:10.248068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:10.248341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] PATH_INFO: `/v3/users/96cae46738834216b9d7cb13be80452e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:10.252646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cae46738834216b9d7cb13be80452e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:10.254624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:10.304986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cae46738834216b9d7cb13be80452e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.312544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cae46738834216b9d7cb13be80452e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.313170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cae46738834216b9d7cb13be80452e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.313809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cae46738834216b9d7cb13be80452e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.321409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cae46738834216b9d7cb13be80452e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.338825 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3622/7182] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:10 2022] DELETE /identity/v3/users/96cae46738834216b9d7cb13be80452e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:10.525093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:10.544113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dab40-f4a1-477d-8a15-ad506221caa7 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:10.604976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:10.605850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:10.606139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:10.606423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] PATH_INFO: `/v3/projects/bdd4fc60def4456798130d3fcadb83da` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:10.607621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd4fc60def4456798130d3fcadb83da)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:10.610368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:10.659359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd4fc60def4456798130d3fcadb83da', 'request_id': 'req-bde60e7c-0254-4ced-9e07-895b707036a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.666464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd4fc60def4456798130d3fcadb83da', 'request_id': 'req-bde60e7c-0254-4ced-9e07-895b707036a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.672066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd4fc60def4456798130d3fcadb83da', 'request_id': 'req-bde60e7c-0254-4ced-9e07-895b707036a9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.686646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] The token cache is being invalidate because project bdd4fc60def4456798130d3fcadb83da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:10.687467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.688121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.689876 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3561/7183] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:10 2022] DELETE /identity/v3/projects/bdd4fc60def4456798130d3fcadb83da => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:10.694060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:10.696424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:10.710757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38991d4b-328e-4876-8b99-de7ef1372dda admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:10.768480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:10.769499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:10.769896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:10.770273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] PATH_INFO: `/v3/users/b3ab42ab0b534304aa5f8b0c9af4e87d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:10.771617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ab42ab0b534304aa5f8b0c9af4e87d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:10.776073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:10.835487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ab42ab0b534304aa5f8b0c9af4e87d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.862369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ab42ab0b534304aa5f8b0c9af4e87d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.863081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ab42ab0b534304aa5f8b0c9af4e87d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.863843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ab42ab0b534304aa5f8b0c9af4e87d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.878957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bc13c841-e6b1-4ecc-b1cd-f415332a5aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ab42ab0b534304aa5f8b0c9af4e87d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:10.904543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3623/7184] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:10 2022] DELETE /identity/v3/users/b3ab42ab0b534304aa5f8b0c9af4e87d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:11.177859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.179491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:11.202021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde60e7c-0254-4ced-9e07-895b707036a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.266418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.267294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.267586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.267866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] PATH_INFO: `/v3/projects/3a51c5a49425493d9c8e4449996641bb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.269092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a51c5a49425493d9c8e4449996641bb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.271038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.328962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a51c5a49425493d9c8e4449996641bb', 'request_id': 'req-ab5bbf2c-af17-4246-b25e-40e7549c19a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:11.337184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a51c5a49425493d9c8e4449996641bb', 'request_id': 'req-ab5bbf2c-af17-4246-b25e-40e7549c19a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:11.344117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a51c5a49425493d9c8e4449996641bb', 'request_id': 'req-ab5bbf2c-af17-4246-b25e-40e7549c19a7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:11.358848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] The token cache is being invalidate because project 3a51c5a49425493d9c8e4449996641bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:11.359407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:11.360728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ab5bbf2c-af17-4246-b25e-40e7549c19a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:11.362937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3562/7185] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:11 2022] DELETE /identity/v3/projects/3a51c5a49425493d9c8e4449996641bb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:11.369285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.370399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.370890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.398403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:11.400056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:11.476865 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3624/7186] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:11.486333 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.487147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.487628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.511204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:11.512520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:11.523918 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3563/7187] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:11.528587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.538615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714b865-9306-4743-8ee4-c5afc464c4b4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.544184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.545105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.545466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.545812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.546882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:11.547293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.550133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.565819 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3625/7188] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:11.566961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.576891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5ea6e-4d43-45de-9108-f4f584c6e9cc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.583702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.584381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.584713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.584998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.585707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.587630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.619928 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3564/7189] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:11 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:11.621197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.633267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a944-f1a0-4474-a940-5effa556424f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.695958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.696833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.697137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.697606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.698307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.701482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.725665 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3626/7190] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:11 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:11.729711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.740652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3655a4-1364-4ca5-acb6-abf1f9478e73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.746187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.747287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.747684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.748038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.748920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.751006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.765456 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3565/7191] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:11.770317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.784582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a6ffa-813c-425c-abad-740f18583b09 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.790977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.791732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.792317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.792764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.793915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.795591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed21190-9fc3-4b60-b290-e5210d4acf3f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.826768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3627/7192] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:11.834627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:11.852927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd173b2-6e79-410f-931c-be7638821fad admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:11.858744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:11.859707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.860785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.861073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] PATH_INFO: `/v3/projects/1ce8744f73784c569b7e4dc524d5b011/users/5e3c9dbc7fca49ebb2f99d0d7a4ca12a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.878103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce8744f73784c569b7e4dc524d5b011, user_id=5e3c9dbc7fca49ebb2f99d0d7a4ca12a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:11.880859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:11.897513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3566/7193] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:11 2022] PUT /identity/v3/projects/1ce8744f73784c569b7e4dc524d5b011/users/5e3c9dbc7fca49ebb2f99d0d7a4ca12a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:11.907843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:11.908142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:11.908427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:11.938931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] MFA Rules not processed for user `5e3c9dbc7fca49ebb2f99d0d7a4ca12a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:11.940300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:12.017172 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3628/7194] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:12.025122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:12.027118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:12.138060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4d045-e34f-4be6-b340-1063690a2801 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:12.154815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:12.155508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:12.155798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:12.156083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:12.173235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:12.175776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:12.188111 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3567/7195] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:16.161138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:16.163971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:16.298418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbe358-b634-41c4-bbbe-17e17852eeb3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:16.307759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:16.310103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:16.310568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:16.311028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:16.313839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:16.513481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:16.515493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:16.526935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3629/7196] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:16 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:16.817574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:16.820298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:16.900402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a8ee8-bd42-4b44-b8ba-b429b69c948e service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:16.920911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:16.922992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:16.924959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:16.927813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:16.937487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:16.990320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:16.992160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:17.020873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3568/7197] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:22.925153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:22.926643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:23.015366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0249ed-1b3d-4546-882b-d62b0c628b9e service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:23.021094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:23.022536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:23.022986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:23.023434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] PATH_INFO: `/v3/users/bf9fca6965154280ba112fb0026d500c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:23.025127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9fca6965154280ba112fb0026d500c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:23.027830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:23.088872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9fca6965154280ba112fb0026d500c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.100665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9fca6965154280ba112fb0026d500c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.101513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9fca6965154280ba112fb0026d500c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.102217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9fca6965154280ba112fb0026d500c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.114705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9fca6965154280ba112fb0026d500c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.180682 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3630/7198] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:22 2022] DELETE /identity/v3/users/bf9fca6965154280ba112fb0026d500c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:23.553477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:23.575039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9879-503f-4a84-aa04-7daf0873bab8 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:23.650299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:23.651181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:23.651470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:23.651749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] PATH_INFO: `/v3/projects/581bd6e5aa8549e88914f48abe9466c3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:23.653662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581bd6e5aa8549e88914f48abe9466c3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:23.655641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:23.710601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581bd6e5aa8549e88914f48abe9466c3', 'request_id': 'req-019aebed-f32d-47f7-8a0d-06de49ee9686'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.720034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581bd6e5aa8549e88914f48abe9466c3', 'request_id': 'req-019aebed-f32d-47f7-8a0d-06de49ee9686'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.727245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581bd6e5aa8549e88914f48abe9466c3', 'request_id': 'req-019aebed-f32d-47f7-8a0d-06de49ee9686'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.742006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] The token cache is being invalidate because project 581bd6e5aa8549e88914f48abe9466c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:23.742306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.742937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.744506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3569/7199] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:23 2022] DELETE /identity/v3/projects/581bd6e5aa8549e88914f48abe9466c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:23.748579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:23.750075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:23.764597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2a10-5a0c-4288-8ddf-4111b79d786a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:23.819313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:23.820294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:23.820611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:23.820887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] PATH_INFO: `/v3/users/fb0c120a388b48e0bb4e0b12e5f013dd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:23.822086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0c120a388b48e0bb4e0b12e5f013dd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:23.824858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:23.870005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0c120a388b48e0bb4e0b12e5f013dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.878061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0c120a388b48e0bb4e0b12e5f013dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.878691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0c120a388b48e0bb4e0b12e5f013dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.879314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0c120a388b48e0bb4e0b12e5f013dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.888033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9230708-125e-4f2a-9dcd-c7dd8f7b0678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0c120a388b48e0bb4e0b12e5f013dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:23.907523 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3631/7200] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:23 2022] DELETE /identity/v3/users/fb0c120a388b48e0bb4e0b12e5f013dd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:24.148899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.150947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:24.176121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aebed-f32d-47f7-8a0d-06de49ee9686 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.299443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.300420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.300934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.301325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] PATH_INFO: `/v3/projects/0eacea7c5e96458aadf1679f0627dd19` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.302798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eacea7c5e96458aadf1679f0627dd19)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.304900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.400246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eacea7c5e96458aadf1679f0627dd19', 'request_id': 'req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:24.409026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eacea7c5e96458aadf1679f0627dd19', 'request_id': 'req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:24.419977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eacea7c5e96458aadf1679f0627dd19', 'request_id': 'req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:24.457492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] The token cache is being invalidate because project 0eacea7c5e96458aadf1679f0627dd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:24.458077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:24.460479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ef2537d2-eef5-474c-a95b-c1bfa18aefe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:24.469346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3570/7201] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:24 2022] DELETE /identity/v3/projects/0eacea7c5e96458aadf1679f0627dd19 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:24.475690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.476629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.477111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.499830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:24.501564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:24.593746 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3632/7202] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:24.595323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.595800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.596035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.634320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:24.635918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:24.655873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3571/7203] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:24.659862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.672108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828acec9-b2eb-4914-9d3b-83e4ee2d5a12 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.677564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.678249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.678532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.678812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.679597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:24.679914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.681760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.700902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.716843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3633/7204] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:24.717654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4375ef9-1dfa-4b51-a756-c39b29014e8e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.722882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.723578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.723863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.724144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.724919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.727021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.759855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3572/7205] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:24.765310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.778212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e697f3-e7c4-45d7-9150-f2c2cb2479fd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.854057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.854844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.855910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.856321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.857237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.859591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.896417 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3634/7206] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:24 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:24.897854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.909491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb918-4480-41d1-98a4-656f2a56d874 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.914963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.915912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.916382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.916939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.917761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.920135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.936250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3573/7207] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:24.937199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.950870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f575-aae4-4516-b903-a8470b767fad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.956020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.956847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.957191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.957529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:24.958320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:24.960057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029478-e614-4924-bb87-6d7a6eabf6f7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:24.978089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3635/7208] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:24.979475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:24.991061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c50d72-a4e3-4a88-b5dc-1aff91c9ada3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:24.996952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:24.998062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:24.998522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:24.999090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] PATH_INFO: `/v3/projects/34e6054deb234f4e8260e8523482242a/users/7fa33c15d5384c56aea2d6c1116bf246/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.018222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e6054deb234f4e8260e8523482242a, user_id=7fa33c15d5384c56aea2d6c1116bf246, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.021365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.053507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3574/7209] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:24 2022] PUT /identity/v3/projects/34e6054deb234f4e8260e8523482242a/users/7fa33c15d5384c56aea2d6c1116bf246/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:25.054343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.054700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.055069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.089290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] MFA Rules not processed for user `7fa33c15d5384c56aea2d6c1116bf246`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:25.091095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:25.096481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.098423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:25.218874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56c080-91d8-4073-adb0-c62e6806255e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.222730 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3636/7210] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:25.228076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.233509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.237896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.238239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.239292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] PATH_INFO: `/v3/users/8b84c577baf8418180f894c99c643772` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.243176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21315f35-7e64-4780-b76b-0486cbd4c39e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.243608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b84c577baf8418180f894c99c643772)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.248197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.249290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.250434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.251078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.251557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.252544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.279180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.349648 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3637/7211] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:25 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:25.351065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.387518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b84c577baf8418180f894c99c643772'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:25.423187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b84c577baf8418180f894c99c643772'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:25.426212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b84c577baf8418180f894c99c643772'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:25.478988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b84c577baf8418180f894c99c643772'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:25.490593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b84c577baf8418180f894c99c643772'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:25.498968 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3575/7212] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:25 2022] DELETE /identity/v3/users/8b84c577baf8418180f894c99c643772 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:25.527998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ffc8f-e43f-4ac5-bac3-67612fa8c9b8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.636105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.637942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.638449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.639142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.640079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.647868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.679881 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3638/7213] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:25 2022] POST /identity/v3/users => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:25.684767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.687210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:25.708681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74f2d-f8fe-4ee9-bf1c-65a36f234915 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.715889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.717774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.718205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.718631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.719676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.722562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.735654 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3576/7214] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:25.740364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.753659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c509ed-c7d1-4e87-b6c3-299f372a5bb3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.762857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.765232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.765751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.784935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] PATH_INFO: `/v3/projects/193e800d3e144eec960340ffeabc68a3/users/fe2ddf48a55946fe9076b4fc49a024ca/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.816413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193e800d3e144eec960340ffeabc68a3, user_id=fe2ddf48a55946fe9076b4fc49a024ca, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.819832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.861432 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3639/7215] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:25 2022] PUT /identity/v3/projects/193e800d3e144eec960340ffeabc68a3/users/fe2ddf48a55946fe9076b4fc49a024ca/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:25.861637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.875181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:25.877039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:25.877175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f74cf1-c39b-4d41-ae81-4f036d9afffb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.982243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8e678-b401-48d8-aedb-df633ecca004 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:25.987597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.988556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:25.988852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.988852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.989063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:25.989161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.989462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:25.989595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] PATH_INFO: `/v3/projects/596094c632d2408d8963534a88f04156` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:25.990248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.990809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596094c632d2408d8963534a88f04156)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:25.992749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:25.993328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.013650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3577/7216] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:26.015103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.026946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e289a0-6b6a-4265-89b3-b8ef878ce660 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.033513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.034532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.034928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.035317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] PATH_INFO: `/v3/projects/193e800d3e144eec960340ffeabc68a3/users/fe2ddf48a55946fe9076b4fc49a024ca/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.040182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193e800d3e144eec960340ffeabc68a3, user_id=fe2ddf48a55946fe9076b4fc49a024ca, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.043239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f37918-69c3-418f-92de-d8413e95cca6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.056937 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3578/7217] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:26 2022] PUT /identity/v3/projects/193e800d3e144eec960340ffeabc68a3/users/fe2ddf48a55946fe9076b4fc49a024ca/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:26.063732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596094c632d2408d8963534a88f04156', 'request_id': 'req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:26.066902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc544b1d-16dc-434b-a854-9918217006de None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.067197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc544b1d-16dc-434b-a854-9918217006de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.068032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc544b1d-16dc-434b-a854-9918217006de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.070970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596094c632d2408d8963534a88f04156', 'request_id': 'req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:26.080144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596094c632d2408d8963534a88f04156', 'request_id': 'req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:26.093887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] The token cache is being invalidate because project 596094c632d2408d8963534a88f04156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:26.094255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:26.095172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4aa8d6b2-9e18-4e47-9fce-a38f78aed3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:26.100128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3640/7218] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:25 2022] DELETE /identity/v3/projects/596094c632d2408d8963534a88f04156 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:26.101640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca0de-d63f-4e15-b6ad-a6b450771ff2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.101930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca0de-d63f-4e15-b6ad-a6b450771ff2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.102209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ca0de-d63f-4e15-b6ad-a6b450771ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.102663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fc544b1d-16dc-434b-a854-9918217006de None None] MFA Rules not processed for user `fe2ddf48a55946fe9076b4fc49a024ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:26.104528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc544b1d-16dc-434b-a854-9918217006de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:26.123201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cf0ca0de-d63f-4e15-b6ad-a6b450771ff2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:26.125206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf0ca0de-d63f-4e15-b6ad-a6b450771ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:26.188021 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3579/7219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:26.190364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc544b1d-16dc-434b-a854-9918217006de None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.200444 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3641/7220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:26.208316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc544b1d-16dc-434b-a854-9918217006de None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.208804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532675-9807-488c-bff3-644e151c9979 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.209422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532675-9807-488c-bff3-644e151c9979 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.209779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532675-9807-488c-bff3-644e151c9979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.216102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.216834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.217267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.217564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.218323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.220580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.231573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c532675-9807-488c-bff3-644e151c9979 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:26.233579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c532675-9807-488c-bff3-644e151c9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:26.241997 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3580/7221] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/domains => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:26.243419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.251928 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3642/7222] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:26.255859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532675-9807-488c-bff3-644e151c9979 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.270818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532675-9807-488c-bff3-644e151c9979 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.342113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4d849-8ff8-4f82-9fc2-11f557ed2f66 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.347785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.349038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.349336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.349618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.350357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.350514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=78156ad2c41f4111852035415d186b9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.351420 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:26.351420 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:26.351420 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:26.351709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.352229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.352350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.353122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.354119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:26.354862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.357682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.381776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3643/7223] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:26.382890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.400898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c4df-974e-4ffa-804f-c7f81edfe681 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.412395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.412843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.418045 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3581/7224] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:18:26 2022] PUT /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config => generated 138 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:26.418272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.418272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.418272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.419214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.419753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.446004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e379e-131e-4319-b76a-36fe025abbd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.458381 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3644/7225] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/projects => generated 403 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:26.459413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.460692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.460982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.461618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.462670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.467147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=78156ad2c41f4111852035415d186b9b, group=identity)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.468721 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:26.468721 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:26.468721 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:26.469740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.491341 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3582/7226] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config/identity => generated 45 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:26.494063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.518811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d34ec-5d66-4929-8fea-7adf75912259 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.592480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38403-5d4e-46dd-b736-8646d77ee9fd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.598118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.598903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.599250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.599595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.600844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.603024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.637899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3645/7227] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:26.638971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.641053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.641342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.641635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config/identity/driver` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.642785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.644162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=78156ad2c41f4111852035415d186b9b, group=identity, option=driver)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.645865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.664795 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3583/7228] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config/identity/driver => generated 31 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:26.666836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.680495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9892-119c-4282-94d2-3148cbc3953c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.686401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313820-47c7-45a8-ae69-ecb95325b6fe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.691235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.692277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.692788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.693910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.694700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.696503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.699303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.700184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.700493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.700785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.702030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=78156ad2c41f4111852035415d186b9b, group=ldap)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.703844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.709279 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3646/7229] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:26.713987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3584/7230] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap => generated 106 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:26.715339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.720902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.728266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dba0-52bb-4e06-ae84-7403869a6089 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.735565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.736253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.736640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.736925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.737653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.739358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.747664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26700a94-cb50-4348-b463-9a8451f9fc00 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.755504 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3647/7231] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:26.759540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.761891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.765068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.766030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.766924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap/url` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.770427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=78156ad2c41f4111852035415d186b9b, group=ldap, option=url)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.772085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238d83-aba0-4b16-b2fa-b1b0fa784dce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.772736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.782570 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3585/7232] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap/url => generated 46 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:26.786616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.787020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.787315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.787600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] PATH_INFO: `/v3/projects/fc29d48aeebc49bc9841ccf5afd53666/users/e609540f88044011b2f131ce1796896b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.788848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.807469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc29d48aeebc49bc9841ccf5afd53666, user_id=e609540f88044011b2f131ce1796896b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.809403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf02b2e-29ac-40c7-8098-119464090f9c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.811542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77636-7835-4e28-b5c6-14dcdbbeb16f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.817338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:26.819525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.819890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.820261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap/user_tree_dn` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.821616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=78156ad2c41f4111852035415d186b9b, group=ldap, option=user_tree_dn)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:26.823802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:26.836508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3648/7233] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:26 2022] PUT /identity/v3/projects/fc29d48aeebc49bc9841ccf5afd53666/users/e609540f88044011b2f131ce1796896b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:26.848861 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3586/7234] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:18:26 2022] GET /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config/ldap/user_tree_dn => generated 63 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:26.852882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:26.859937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:26.860319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:26.860646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:26.890916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ebccf-883d-4a39-9b05-50238c90a73f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:26.966331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] MFA Rules not processed for user `e609540f88044011b2f131ce1796896b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:26.969876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:27.023834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.025236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.026697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.027726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.030127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=78156ad2c41f4111852035415d186b9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.034395 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:27.034395 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:27.034395 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:27.035732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:27.059224 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3587/7235] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:26 2022] DELETE /identity/v3/domains/78156ad2c41f4111852035415d186b9b/config => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:27.065231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.098874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374275-5770-4e0a-a516-0a021b3c0284 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.106150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.107316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.107792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.110072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.112367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=78156ad2c41f4111852035415d186b9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.114862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:27.119810 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3649/7236] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:27.129867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.154377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.158533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.208224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.209737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.217953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3588/7237] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:27 2022] PATCH /identity/v3/domains/78156ad2c41f4111852035415d186b9b => generated 276 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:27.219782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.225288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:27.232957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb9c6-bf1c-4009-b1c0-61d5033d1513 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.334808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.336019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.336435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.336877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] PATH_INFO: `/v3/users/e609540f88044011b2f131ce1796896b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.338620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e609540f88044011b2f131ce1796896b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.341124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:27.349187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a53f83-7da1-430b-820b-20428d70fa19 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.368817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.369801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.370164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.370517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.388077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=78156ad2c41f4111852035415d186b9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.400590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:27.442004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e609540f88044011b2f131ce1796896b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.455710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e609540f88044011b2f131ce1796896b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.456154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e609540f88044011b2f131ce1796896b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.456941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e609540f88044011b2f131ce1796896b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.465660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b95e5028-5995-4e80-8f90-2528ba77ce8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e609540f88044011b2f131ce1796896b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.472713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.492926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '78156ad2c41f4111852035415d186b9b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.506390 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3650/7238] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:27 2022] DELETE /identity/v3/users/e609540f88044011b2f131ce1796896b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:27.508012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.512266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.512266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.545798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:27.548508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:27.573279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.590553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.605922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.630851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] The token cache is being invalidate because project 78156ad2c41f4111852035415d186b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:27.631227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.632322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.646293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.653051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.654884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '78156ad2c41f4111852035415d186b9b', 'request_id': 'req-8d37be4c-4b6b-4c94-865d-66b1ceddae25'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:27.667444 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3589/7239] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:27 2022] DELETE /identity/v3/domains/78156ad2c41f4111852035415d186b9b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:27.674177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.684582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:27.689743 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3651/7240] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:27.690743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.692187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:27.831194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37be4c-4b6b-4c94-865d-66b1ceddae25 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.844419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.845129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.845422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.845780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.846453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.848062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:27.872940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c653fa5-b4b3-4eb5-8be1-2499636873d7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.879070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3590/7241] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:18:27 2022] POST /identity/v3/domains => generated 277 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:27.881126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:27.986933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0e49-d791-4401-9675-3262fdd3348a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:27.992484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.993468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.993773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:27.993914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.994195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.994441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:27.994881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:27.995007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:27.995164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:27.997160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.051445 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3591/7242] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:18:27 2022] PUT /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 138 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:28.056854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.077903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35789-1b33-40fd-bf14-71dddf1bbd71 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.084491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.085945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.086432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.087109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.088693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.091332 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:28.091332 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:28.091332 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:28.091975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.092901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.095088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.117503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3652/7243] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:28.143063 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3592/7244] 10.222.0.18 () {60 vars in 1270 bytes} [Sat Apr 2 21:18:28 2022] PATCH /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 142 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:28.147983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.170481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41f997-013a-4dc0-b4fa-c3a9baa3451b service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.179565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.182836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.184077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.185008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.187818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.190190 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:28.190190 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:18:28.190190 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:18:28.192105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.205762 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3653/7245] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:28 2022] GET /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 142 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:28.206955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.225085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f792c-9337-4802-a2b8-417f06634850 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.255337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.256268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.257072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.257361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.258289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.261452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.276741 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3593/7246] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:28 2022] DELETE /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:28.280295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.319221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e254ed7-d87a-48c0-b309-ccd2e12d69f1 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.327278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.328414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.328928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.329290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.331904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.334601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.350532 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find any options in domain configuration for domain 716e0ad9906c47399530a1d96eb99cbb.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 716e0ad9906c47399530a1d96eb99cbb. Apr 02 21:18:28.352100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3654/7247] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:28 2022] GET /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 151 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:18:28.356961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.368545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3d03-c5c5-4d8c-9a26-aa678688ee59 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.374846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.376844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.377155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.377920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.379130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.382840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.399875 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3594/7248] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:28 2022] DELETE /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb/config => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:28.401227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.415970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb137-8a47-4b03-bec2-040c36e9a745 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.443174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.448509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.459822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.461184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.465886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.473294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.528065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.533383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.589466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.592688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.601179 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3655/7249] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:28 2022] PATCH /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb => generated 278 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:28.606233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.608423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:28.628321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c96c-8896-464a-92d9-89c141296173 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.734291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.734987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:28.735725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:28.736611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:28.736825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:28.737101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:28.760417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=716e0ad9906c47399530a1d96eb99cbb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:28.763925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:28.793305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.805535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.860171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.869453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.880017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.915319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] The token cache is being invalidate because project 716e0ad9906c47399530a1d96eb99cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:28.915689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.916484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.932619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.934274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e4e2d-af51-4bad-82e3-935fcfe5ae7e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:28.943007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.946976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '716e0ad9906c47399530a1d96eb99cbb', 'request_id': 'req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:28.973308 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3595/7250] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:28 2022] DELETE /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:28.974320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:28.982621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:29.043243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.045123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.045491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.046177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] PATH_INFO: `/v3/projects/fc29d48aeebc49bc9841ccf5afd53666` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.047972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc29d48aeebc49bc9841ccf5afd53666)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.050300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.109445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357c6d-7b1d-4d9d-9b85-a3dc7c6f9987 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.123961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc29d48aeebc49bc9841ccf5afd53666', 'request_id': 'req-c7d2a229-cdbb-4dca-97d7-adad38d40b12'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:29.131061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc29d48aeebc49bc9841ccf5afd53666', 'request_id': 'req-c7d2a229-cdbb-4dca-97d7-adad38d40b12'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:29.141669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc29d48aeebc49bc9841ccf5afd53666', 'request_id': 'req-c7d2a229-cdbb-4dca-97d7-adad38d40b12'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:29.153182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] The token cache is being invalidate because project fc29d48aeebc49bc9841ccf5afd53666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:29.153480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:29.154037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7d2a229-cdbb-4dca-97d7-adad38d40b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:29.155616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3656/7251] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:28 2022] DELETE /identity/v3/projects/fc29d48aeebc49bc9841ccf5afd53666 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:29.166714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969815-f418-4dd9-8cb9-1120ca63f01d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.167015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969815-f418-4dd9-8cb9-1120ca63f01d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.168427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969815-f418-4dd9-8cb9-1120ca63f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.203474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c5969815-f418-4dd9-8cb9-1120ca63f01d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:29.204300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c5969815-f418-4dd9-8cb9-1120ca63f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:29.220402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.220402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.220402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.220879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.221462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.223116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.257019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3596/7252] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:18:28 2022] POST /identity/v3/domains => generated 276 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:29.271377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.308358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:29.368165 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3657/7253] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:29.377868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.380706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.381806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.407492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:29.408875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:29.428934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10660f-f49b-45f8-99ca-1aceb77bffd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.436787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.437948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.438407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.439360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.441401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.443837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.545184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3597/7254] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Apr 2 21:18:29 2022] PUT /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config => generated 138 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:29.546877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.554179 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3658/7255] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:29.555989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.577538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bfc50-6770-4742-8f3b-bcccef39872c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.581634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e935353-862e-4166-9e85-3ea6c84f2147 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.590153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.591027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.591442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.591861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.593019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.594215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.595164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.595689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.596158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.597401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:29.597748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.598076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.600396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.617250 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3659/7256] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:29.622052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.640068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db8953-3c22-489f-8c25-0fbd87586f3a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.648157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.649396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.650048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.650591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.651503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.654971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.655249 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3598/7257] 10.222.0.18 () {60 vars in 1296 bytes} [Sat Apr 2 21:18:29 2022] PATCH /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity => generated 177 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:29.659978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.700028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c668-1817-4df2-9dc6-290b238b202a tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.701915 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3660/7258] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:29 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:29.703526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.785279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.786334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.786798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.786925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.787625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity, option=driver)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.789269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.797798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bd00-65ea-46f1-b753-d894100beebb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.810596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.811529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.812002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.812395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.814180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.817594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.849639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3599/7259] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Apr 2 21:18:29 2022] PATCH /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver => generated 177 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:29.849858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3661/7260] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:29 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:29.854033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.855913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.876002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acb4c7-898d-42ca-b9af-e6ba4bd12ce4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.880428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5188-f68d-426b-8381-e6f35cca2d34 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.887304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.888203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.888517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.888660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.888791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.889456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity, option=driver)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.889597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.890134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.890491 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:29.890491 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:18:29.890491 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:18:29.891847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.892147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.893100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.894850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.911896 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3600/7261] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:29.915957 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3662/7262] 10.222.0.18 () {58 vars in 1298 bytes} [Sat Apr 2 21:18:29 2022] DELETE /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:29.917433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.917619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.928789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680a3f-a429-40cf-a7cd-e02bf503fca4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.936583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.937493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.937882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.938175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.938437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a3c0a-6d33-4524-b9d3-ec699fd96235 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.939550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity, option=driver)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.941215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.945529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.946214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.946504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.946786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.947542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.949778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:29.959615 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find option driver in group identity in domain configuration for domain 3031c7fb367c455b96267f258fe1340d.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 3031c7fb367c455b96267f258fe1340d. Apr 02 21:18:29.960489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3601/7263] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:29.964133 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3663/7264] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 21:18:29 2022] GET /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity/driver => generated 171 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:18:29.965497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.967757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:29.976155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f859c-557b-4d34-84a2-5eeba377b5e8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.978501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55668-1ee3-488a-9f68-4ee193964cab tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:29.981559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.982561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.982925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.983274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] PATH_INFO: `/v3/projects/e70585684cfd47abaefc439b16236ae4/users/00a94eccf6414721a36224e438a392de/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.984433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:29.985556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:29.985981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:29.986378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:29.987167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:29.988958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.000695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70585684cfd47abaefc439b16236ae4, user_id=00a94eccf6414721a36224e438a392de, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.003717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af029b63-02a1-457e-b06d-978fac4d50a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.013491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3664/7265] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 21:18:29 2022] DELETE /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:30.017698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.027258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3602/7266] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:29 2022] PUT /identity/v3/projects/e70585684cfd47abaefc439b16236ae4/users/00a94eccf6414721a36224e438a392de/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:30.031359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941688e-c38d-431f-b3a8-f6a803480377 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.041385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.041746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.042003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.089129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] MFA Rules not processed for user `00a94eccf6414721a36224e438a392de`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:30.091331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.107220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.108787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.109203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.109496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.111201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d, group=identity)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.113231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.133403 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find group identity in domain configuration for domain 3031c7fb367c455b96267f258fe1340d.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 3031c7fb367c455b96267f258fe1340d. Apr 02 21:18:30.139708 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3665/7267] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:18:30 2022] GET /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config/identity => generated 154 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:18:30.149179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.162090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1149-a6d5-4a5f-a6ce-93a76ecf4a75 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.174410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.175299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.175549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.175829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d/config` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.177289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3031c7fb367c455b96267f258fe1340d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.179429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.200750 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3666/7268] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:30 2022] DELETE /identity/v3/domains/3031c7fb367c455b96267f258fe1340d/config => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:30.202475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.207291 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3603/7269] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:30.219266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec178e3-044f-4505-a63e-ad0838697ab4 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.221544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.222953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.225424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.227328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.227627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.227952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.229718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3031c7fb367c455b96267f258fe1340d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.231733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.283719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.286003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.341935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924e1e-b37e-4058-b332-11fcfec1b2d8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.350245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.351169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.373411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3667/7270] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:30 2022] PATCH /identity/v3/domains/3031c7fb367c455b96267f258fe1340d => generated 277 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:30.377934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.379823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.418995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.419991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.420439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.420925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.423145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.475685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda47f-1cbc-4a21-a272-fa65450bdd4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.482881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.483854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.484223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.484670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] PATH_INFO: `/v3/users/986a98734ff4476e83fcfbbf337274ca` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.486042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986a98734ff4476e83fcfbbf337274ca)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.488185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.519308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.520990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.533174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3604/7271] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:30.534103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.535777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.553364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986a98734ff4476e83fcfbbf337274ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.564597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986a98734ff4476e83fcfbbf337274ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.566090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986a98734ff4476e83fcfbbf337274ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.567010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986a98734ff4476e83fcfbbf337274ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.579643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-046d4f15-62ca-42fa-b0ba-76428c5f9a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986a98734ff4476e83fcfbbf337274ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.606447 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3668/7272] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:30 2022] DELETE /identity/v3/users/986a98734ff4476e83fcfbbf337274ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:30.611087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.611659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.612125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.634579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540005c-fe4e-4491-a099-2336090dc337 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.644573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:30.646550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.744796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:30.745825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:30.746235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:30.746392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:30.759760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3031c7fb367c455b96267f258fe1340d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:30.762615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:30.766635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3669/7273] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:30.768106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:30.769673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:30.795328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.808034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3031c7fb367c455b96267f258fe1340d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.860899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac09074-2bf9-47aa-a812-e661623d3031 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:30.882829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.899181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.924670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.958870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] The token cache is being invalidate because project 3031c7fb367c455b96267f258fe1340d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:30.960663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.962119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.974002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.984140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:30.986386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3031c7fb367c455b96267f258fe1340d', 'request_id': 'req-5e77f9ec-2788-45e7-8bea-9b3694713771'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.019969 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3605/7274] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:30 2022] DELETE /identity/v3/domains/3031c7fb367c455b96267f258fe1340d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:31.029258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.030583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.031552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.032146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.032561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.039911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:31.042375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:31.254472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.256150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.284881 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3670/7275] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:31.294603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77f9ec-2788-45e7-8bea-9b3694713771 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.314703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.316368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.317592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.319569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.320545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.322274 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:31.322274 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:31.322274 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:31.325606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.337309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3606/7276] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:31.341655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.357760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d592b-5946-429a-b01d-4fe17df5c3ae service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.368972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.375761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.375761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.378684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.379375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.383004 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:31.383004 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:18:31.383004 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:18:31.383973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.387902 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3671/7277] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.391941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.411603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50992-e626-485b-9366-0c98558be230 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.436362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.437687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.446411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.446603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.457976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.464124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.467504 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3607/7278] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.470518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.499838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1f12-8d34-4288-8eff-dff1aa7f3414 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.518315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.519664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.521252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.521734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.522583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.524850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.527343 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3672/7279] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:31.532148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.556816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5ad57-1a68-4634-955a-a21451166b2b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.571991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.574388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.575932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.576486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.577288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.581768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.589154 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3608/7280] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:31.593833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.607308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fffa2-53d3-4f82-b78c-4855497b58ae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.621669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.623204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.624795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.625250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.639454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.643967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.652211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.652930 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3673/7281] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.673463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221dc88-350a-415c-ae71-67871e28ecc5 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.686974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.688174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.688611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.689087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.690043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.692402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.720185 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3609/7282] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.721442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.741654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.746703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68b596-8456-40c7-924b-997fe2dcc59b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.748121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:31.763415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.765525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.765674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da233d3f-2928-4f4d-a48e-3e29cfb3efbf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.766499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.768780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.771653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.771960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.772905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.773192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.773555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] PATH_INFO: `/v3/projects/73f99ad4a6bf4ec5ad3d7d4045018511` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.774712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f99ad4a6bf4ec5ad3d7d4045018511)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.777188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.778603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.780980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3674/7283] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.785037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.825142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd940b04-9dc1-4d6d-a6b5-6f625ea45c89 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.840289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.842491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.844078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.844487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.846885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.852725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.854509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3675/7284] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.859160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.872431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a97318-9b8b-4b77-a0dc-fbf9cdc715fb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:31.873496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f99ad4a6bf4ec5ad3d7d4045018511', 'request_id': 'req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.880720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f99ad4a6bf4ec5ad3d7d4045018511', 'request_id': 'req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.886808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f99ad4a6bf4ec5ad3d7d4045018511', 'request_id': 'req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.904761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] The token cache is being invalidate because project 73f99ad4a6bf4ec5ad3d7d4045018511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:31.905111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.906114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:31.911030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3610/7285] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:31 2022] DELETE /identity/v3/projects/73f99ad4a6bf4ec5ad3d7d4045018511 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:31.916050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.918808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:31.947046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:31.947984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:31.948427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:31.948995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:31.949769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:31.951811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:31.953721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3676/7286] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:31.957424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:31.963938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:31.995167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448c8ac-5ca9-4e0b-abd2-3bb7c84627cf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.002001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.002808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.003091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.003540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.003965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d98c1e-9ed0-4d39-b8c2-0a93c2c470b0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.009244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.010780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.010780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.011102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.011257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] PATH_INFO: `/v3/users/d11afedb121f4cffb4a9899738372524` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.012563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.014496 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3677/7287] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:31 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.018121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.018263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11afedb121f4cffb4a9899738372524)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.020062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.033675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36624811-996e-4a5b-85fd-e60df73d67a6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.039315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.040247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.040680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.041092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.042005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.044286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.046554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3678/7288] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:32.050412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.063904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170563-06e7-4133-837c-38ea5c2e1acf tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.070416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.071274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.071568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.071854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.073557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.077966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.084193 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3679/7289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:32.085477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.099401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be99f0-d797-4a21-b6da-15c0df7fb0b6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.107019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11afedb121f4cffb4a9899738372524'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:32.107943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.108869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.109165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.109441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.110110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.113311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.117907 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3680/7290] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.119413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.132112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b669e-a784-4137-962b-bd5260a9a12c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.138458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11afedb121f4cffb4a9899738372524'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:32.138664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.139401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.139534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11afedb121f4cffb4a9899738372524'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:32.139684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.139944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.140673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.142290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.143719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3681/7291] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.148688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.150861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:32.151451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11afedb121f4cffb4a9899738372524'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:32.163931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11afedb121f4cffb4a9899738372524'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:32.173153 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3611/7292] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:31 2022] DELETE /identity/v3/users/d11afedb121f4cffb4a9899738372524 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:32.175173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12637c0-9382-4bc6-95ae-2698e29d8b7f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.283530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.287627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.288538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.289906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.290667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.297731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.299753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3682/7293] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.304414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.320797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69b223-1470-49db-9c52-262383537e10 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.326751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.328921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.329331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.329709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.330576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.332775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.338692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.344604 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3612/7294] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.350967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb34de-cf8d-4ff3-a69c-a3721100b54d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.360593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.361493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.361969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.362315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.363337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.365185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.370885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.371132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3683/7295] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.398340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02611e3-5d33-4d76-be4d-7e5d5f40b237 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.411540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.412440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.412706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.412997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.413729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.415593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.420232 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3613/7296] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.422425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.441147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65d223-e40b-4b32-9a99-e0189eef705c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.447328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.448142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.448427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.448797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.449462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.451342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.456760 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3684/7297] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.458387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.472825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fcbf3-bfa3-4d74-a8d7-74532e768532 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.487024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.488000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.488294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.488666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.489617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.492667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.494179 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3614/7298] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:32.497924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.511843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a02d5-9a11-4835-b95e-1535061e0b6d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.518518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.519584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.519870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.520144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.520843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.523618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.530288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3685/7299] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:32.530504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.542392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc2075-9c66-458e-96cd-48acfc79abb6 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.550010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.551167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.551805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.552206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.553818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.556279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.557662 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3615/7300] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:32.561969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.576919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90239-fdd0-42e9-a77b-19b01566d620 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.583640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.585387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.585952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.586461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.587441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.590305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.591864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3686/7301] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.597937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.612644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d5c5a-be12-420a-aa4d-4329db53fbfe tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.630452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.631945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.632101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.632369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.633619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.638490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.640627 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3616/7302] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.645236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.661205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb57c2e-4ad6-48a6-a075-139611998024 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.674011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.675821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.678781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.679102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.680200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.685909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.688843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3687/7303] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.700989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.712279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf592aa-6610-4a12-afca-a4beef9c5365 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.719115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.720070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.720433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.720815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.721557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.723301 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.724640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3617/7304] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.728995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.742343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7301-08ed-4274-9713-ecb49cc3470e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.749160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.750509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.750921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.751324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.752155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.754221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.756150 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3688/7305] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.762205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.781517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe87fc-7af6-4e6b-8148-26560009cba3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.809202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.810151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.810540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.810940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.811715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.813790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.818012 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3618/7306] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.819209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.836883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f51a-0ff9-4427-a15a-38c9ce8181d9 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.848054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.849138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.849956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.850227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.852106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.860771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.864544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3689/7307] 10.222.0.18 () {58 vars in 1307 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.869802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.892886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8603-cee0-4d45-ae96-4eeda6e01c05 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.906569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.906569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.912816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.912816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.912816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.912816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.917148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.917785 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3619/7308] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.934212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e047e50-2238-465d-a76e-a18859ca2882 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.949623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.950438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.950731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.951018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.951698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.953445 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.954629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3690/7309] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.959316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:32.972507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d60a-641b-4d9f-842b-e3cda8243393 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:32.977799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:32.978882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:32.979168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:32.979446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:32.980171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:32.981877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:32.983219 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3620/7310] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:32.987245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.007946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb971d12-14c6-4896-9c4e-b9432c1e5279 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.019284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.020798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.021310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.021891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.022925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.024906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.026415 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3691/7311] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:32 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.030581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.043266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a592f-f52b-41f1-a9e4-18d3efd27f94 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.048313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.051112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.051411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.051694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.052417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.055234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.056840 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3621/7312] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:33.061195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.072955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8952be-f177-4742-b05f-b777c15a5a85 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.079143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.080229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.080788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.081249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.082110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.083913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.085768 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3692/7313] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.089698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.101911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565b71-1646-454b-9993-82daf289b235 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.107938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.108854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.109210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.109554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.110553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.112304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.116495 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3622/7314] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.117727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.132343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd485789-9864-4fbd-a889-e7839f439ead tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.138431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.139246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.139534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.139822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.140513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.142221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.143535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3693/7315] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.147692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.158688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bc87f-82fd-4b4c-9972-11f9d6df6b1b tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.164552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.165832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.166370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.166828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.167558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.169186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.173404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3623/7316] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.174867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.188184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618bbb4-d41a-4920-8099-40e94b85b1b2 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.194089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.194717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.195172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.195530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.196365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.198238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.203743 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3694/7317] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:33.205327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.218848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f1c0-bcb8-46fa-b468-bc9b006f7ebb tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.229188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.230126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.231314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.232127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.233236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.234927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.236104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3624/7318] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.240232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.251815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd717c2-315f-4471-993b-08bb3cea6c8d tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.258570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.259306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.260183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.261007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.261007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.262269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.262466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:33.264209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.268488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3695/7319] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.269803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.281957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707656db-dfb1-4567-bde1-463447bd1945 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.288390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.289255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.289664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.289957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.290654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.292325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.293880 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3696/7320] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.298281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.317682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12530-98dd-4798-8787-500ce1626dd7 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.327417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.328262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.328671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.328953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.329624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.331720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.333875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3697/7321] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.337915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.349596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ceef-953f-475f-9cea-ac745b5f36e3 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.359330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.360187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.360550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.360943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.361616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.363622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.368400 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3698/7322] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.369580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.380691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92832-e80e-4d8b-aae3-3fc23d4c4c14 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.381568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c60a-c08c-4fd1-911a-853b4dfa3c4c tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.387604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.388098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.389091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.389226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.389390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.389505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.389674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.390337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.390474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] PATH_INFO: `/v3/projects/96b7ec44448a40da864d462f75628fde` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.391765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b7ec44448a40da864d462f75628fde)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.391985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.393671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.394069 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3699/7323] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.397985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.415255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26cb29-52a9-4cf3-aefd-69e0a22c21bd tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.427138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.428341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.428912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.429758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.430779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.434093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.435877 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3700/7324] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:33.441573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.461470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50897de3-b25e-402d-a810-960b8577727f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.463688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b7ec44448a40da864d462f75628fde', 'request_id': 'req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.470853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b7ec44448a40da864d462f75628fde', 'request_id': 'req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.478359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b7ec44448a40da864d462f75628fde', 'request_id': 'req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.498863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] The token cache is being invalidate because project 96b7ec44448a40da864d462f75628fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:33.499203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.500131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.506469 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3625/7325] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:33 2022] DELETE /identity/v3/projects/96b7ec44448a40da864d462f75628fde => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:33.508167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.510307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:33.540187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.541582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.542100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.543172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.544172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.545951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.550522 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3701/7326] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.552919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.555607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:33.571941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace25664-91a4-4458-9169-bfe2828f7e61 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.582173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.582990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.583282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.583781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.584516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.586294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.587731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3702/7327] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.592920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.604278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8579e3-45a4-47dd-9c2c-43d1fa818b8e tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.610662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f93ae-652b-4f08-b8c8-b2b23e3c95d9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.614326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.615561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.616483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.617119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.618112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.618676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.619748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.620064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.620273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.620475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] PATH_INFO: `/v3/users/bcf586636b3d451eab0e4c23871346cd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.622943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf586636b3d451eab0e4c23871346cd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.626634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.627522 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3703/7328] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 02 21:18:33.628505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.640109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46cd48-6bf4-4410-a9dd-0837c5df4a92 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.654403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.655880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.656246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.656689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.657456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.659752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.665850 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3704/7329] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.667029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.679915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434c6ff-c2fe-4470-851b-c63a77ce78bc tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.688740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.689547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.689833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.690142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.690976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.692605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.696867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3705/7330] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.700044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.708497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf586636b3d451eab0e4c23871346cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.722735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db38be0-e90b-4f56-b6b4-d6401cdfcb4f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.725498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf586636b3d451eab0e4c23871346cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.726562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf586636b3d451eab0e4c23871346cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.729575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.731063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.731370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.731918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.732684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.734973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.740132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3706/7331] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.741309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.744603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:33.753115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf586636b3d451eab0e4c23871346cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.760222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe48a63-4ac0-4b13-a207-5d67bf218600 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.765464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf586636b3d451eab0e4c23871346cd'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:33.767650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.768836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.769121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.769401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.770069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:33.773346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:33.775338 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3707/7332] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 21:18:33 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 02 21:18:33.781031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3626/7333] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:33 2022] DELETE /identity/v3/users/bcf586636b3d451eab0e4c23871346cd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:33.781577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.795703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6166c3-7211-4aed-8d72-1e9a7cc6c4d0 tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.877416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.878492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.878905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.879292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/3031c7fb367c455b96267f258fe1340d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.892394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:18:33.902535 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find domain: 3031c7fb367c455b96267f258fe1340d.: keystone.exception.DomainNotFound: Could not find domain: 3031c7fb367c455b96267f258fe1340d. Apr 02 21:18:33.904288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3708/7334] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:33 2022] PATCH /identity/v3/domains/3031c7fb367c455b96267f258fe1340d => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:18:33.909938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.932851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d186561-3471-461b-8ad0-6f8f80cd4a7a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:33.940062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:33.941799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:33.941962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:33.942112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/716e0ad9906c47399530a1d96eb99cbb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:33.950562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:18:33.960737 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find domain: 716e0ad9906c47399530a1d96eb99cbb.: keystone.exception.DomainNotFound: Could not find domain: 716e0ad9906c47399530a1d96eb99cbb. Apr 02 21:18:33.966192 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3627/7335] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:33 2022] PATCH /identity/v3/domains/716e0ad9906c47399530a1d96eb99cbb => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:18:33.967567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:33.987448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb046c5-f710-4ba0-93ce-4146d362a43f tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.001541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2ddf48a55946fe9076b4fc49a024ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '193e800d3e144eec960340ffeabc68a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.002581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.002863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.003286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] PATH_INFO: `/v3/domains/78156ad2c41f4111852035415d186b9b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.023100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 02 21:18:34.038509 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Could not find domain: 78156ad2c41f4111852035415d186b9b.: keystone.exception.DomainNotFound: Could not find domain: 78156ad2c41f4111852035415d186b9b. Apr 02 21:18:34.040626 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3709/7336] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:33 2022] PATCH /identity/v3/domains/78156ad2c41f4111852035415d186b9b => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 02 21:18:34.046711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.048953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.061849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.067528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.217822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3448-d33d-45a6-a553-ba9423637cea tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.233070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.234055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.234939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca70c8-2aa9-4531-afb9-e9ec8249fdae tempest-DomainConfigurationTestJSON-1721187917 tempest-DomainConfigurationTestJSON-1721187917-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.237106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.239794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] PATH_INFO: `/v3/users/7fa33c15d5384c56aea2d6c1116bf246` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.242887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa33c15d5384c56aea2d6c1116bf246)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.244750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.246931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.247220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.247636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] PATH_INFO: `/v3/projects/0dbb418c5e264552a2fc6fb651964c34` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.248135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.249699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbb418c5e264552a2fc6fb651964c34)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.253450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.338925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa33c15d5384c56aea2d6c1116bf246'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.353645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbb418c5e264552a2fc6fb651964c34', 'request_id': 'req-66eafb56-fd84-44a4-9c99-ab17dc09d422'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.359988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa33c15d5384c56aea2d6c1116bf246'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.361880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa33c15d5384c56aea2d6c1116bf246'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.373264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbb418c5e264552a2fc6fb651964c34', 'request_id': 'req-66eafb56-fd84-44a4-9c99-ab17dc09d422'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.380186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa33c15d5384c56aea2d6c1116bf246'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.388787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbb418c5e264552a2fc6fb651964c34', 'request_id': 'req-66eafb56-fd84-44a4-9c99-ab17dc09d422'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.402755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-16911e13-7ff3-4e9f-9c6f-181950bc7647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa33c15d5384c56aea2d6c1116bf246'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.412163 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3628/7337] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:34 2022] DELETE /identity/v3/users/7fa33c15d5384c56aea2d6c1116bf246 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:34.416442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.416911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.417533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.423939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] The token cache is being invalidate because project 0dbb418c5e264552a2fc6fb651964c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:34.424269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.425061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-66eafb56-fd84-44a4-9c99-ab17dc09d422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:34.426659 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3710/7338] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:34 2022] DELETE /identity/v3/projects/0dbb418c5e264552a2fc6fb651964c34 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:34.431578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4980-6a18-4b47-9570-182a0b3efe25 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.431868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4980-6a18-4b47-9570-182a0b3efe25 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.432152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4980-6a18-4b47-9570-182a0b3efe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.443064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:34.445647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.479052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e78e4980-6a18-4b47-9570-182a0b3efe25 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:34.481578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e78e4980-6a18-4b47-9570-182a0b3efe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.552061 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3629/7339] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:34.565125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.568703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.584933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3711/7340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:34.594240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.594537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.594823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.621309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:34.623083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:34.652282 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3712/7341] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:34.657373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.676118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b036-4b38-4c23-94f3-35f7df9006e4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.684513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.685413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.685986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.686342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.687328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:34.687781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.690040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.706445 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3713/7342] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:34.712657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.729071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec119bc9-45b5-4866-8587-e5942274fef2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.729771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9d7b-171e-4e00-a301-658e2c107529 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.741640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.742335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.742624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.742898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.746001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.746999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.747509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.748004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.754677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.757023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.758249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.759867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.774251 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3630/7343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:34.804629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3714/7344] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:34 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:34.806465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.819520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4893fb8-dc86-406c-9ffb-251ef9baba26 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.894036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.895255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.895255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.895677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.896510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.899139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.928531 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3631/7345] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:34 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:34.930070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.946244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddde29-270a-4075-ae66-b5e29ceec4e3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:34.960611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:34.960844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:34.960962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:34.961233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:34.962034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:34.963543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:34.974498 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3715/7346] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:34.978380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:34.993604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c886-e9fe-4e3f-90b3-e0e5d2bafa00 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:35.002121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:35.002806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.003094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.003372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.004099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:35.005746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27080-d615-499b-8d6b-fb15a4c8a9c9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:35.024272 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3632/7347] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:35.026276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:35.037210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640e665-7c3f-4821-8d6a-5c3952c22ba6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:35.042200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:35.043630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.043907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.044182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] PATH_INFO: `/v3/projects/be8b83e669854377af9bc768398a35af/users/46d0c6b2806a46ce9621af36b828e17e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.064251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8b83e669854377af9bc768398a35af, user_id=46d0c6b2806a46ce9621af36b828e17e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:35.067340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:35.084576 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3716/7348] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:35 2022] PUT /identity/v3/projects/be8b83e669854377af9bc768398a35af/users/46d0c6b2806a46ce9621af36b828e17e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:35.087863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.088192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.089358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.108873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:35.110603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:35.170019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3633/7349] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:35.180489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:35.182529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:35.240800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1353c-eb47-4336-a1af-0797bbf1819a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:35.247160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:35.247953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.248251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.248643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.260926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:35.262775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:35.275412 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3717/7350] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:35.304214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:35.306326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:35.326103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36ec8-90d2-4de1-bd4d-1b77fee47848 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:35.331834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:35.332886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.333246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.333603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] PATH_INFO: `/v3/projects/34e6054deb234f4e8260e8523482242a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.335111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e6054deb234f4e8260e8523482242a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:35.337254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:35.399063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e6054deb234f4e8260e8523482242a', 'request_id': 'req-c5092320-ddd5-458e-9be9-896fb8f12300'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.406557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e6054deb234f4e8260e8523482242a', 'request_id': 'req-c5092320-ddd5-458e-9be9-896fb8f12300'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.412479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e6054deb234f4e8260e8523482242a', 'request_id': 'req-c5092320-ddd5-458e-9be9-896fb8f12300'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.428380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] The token cache is being invalidate because project 34e6054deb234f4e8260e8523482242a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:35.428750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.430259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.434698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3634/7351] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:35 2022] DELETE /identity/v3/projects/34e6054deb234f4e8260e8523482242a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:35.437988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:35.466211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded40b-d004-436e-b035-9c30c25c66f1 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:35.586926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:35.589876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:35.591067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:35.591387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] PATH_INFO: `/v3/users/fe2ddf48a55946fe9076b4fc49a024ca` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:35.595544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2ddf48a55946fe9076b4fc49a024ca)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:35.598769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:35.708723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2ddf48a55946fe9076b4fc49a024ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.727773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2ddf48a55946fe9076b4fc49a024ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.729319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2ddf48a55946fe9076b4fc49a024ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.730553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2ddf48a55946fe9076b4fc49a024ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.739963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4c6cf48b-02db-4564-95ef-638f61b71e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2ddf48a55946fe9076b4fc49a024ca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:35.761866 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3718/7352] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:35 2022] DELETE /identity/v3/users/fe2ddf48a55946fe9076b4fc49a024ca => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:36.184819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:36.186439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:36.213417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5092320-ddd5-458e-9be9-896fb8f12300 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:36.336710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:36.337431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:36.337721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:36.338003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] PATH_INFO: `/v3/projects/193e800d3e144eec960340ffeabc68a3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:36.341030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=193e800d3e144eec960340ffeabc68a3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:36.344001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:36.417046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193e800d3e144eec960340ffeabc68a3', 'request_id': 'req-5aa386a8-1488-46df-9773-385052cabb9d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:36.427522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193e800d3e144eec960340ffeabc68a3', 'request_id': 'req-5aa386a8-1488-46df-9773-385052cabb9d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:36.447425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193e800d3e144eec960340ffeabc68a3', 'request_id': 'req-5aa386a8-1488-46df-9773-385052cabb9d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:36.483908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] The token cache is being invalidate because project 193e800d3e144eec960340ffeabc68a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:36.484417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:36.489281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5aa386a8-1488-46df-9773-385052cabb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:36.492109 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3635/7353] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:36 2022] DELETE /identity/v3/projects/193e800d3e144eec960340ffeabc68a3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:36.498176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:36.498665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:36.498771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:36.549980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:36.551588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:36.661394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3719/7354] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:36.671083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:36.671619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:36.672073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:36.695709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:36.698004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:36.716364 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3636/7355] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:36.723032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:36.740631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94610-7787-4b59-9a33-bc9916215433 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:36.758735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:36.764950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:36.765334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:36.765749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:36.766754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:36.767315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:36.769948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:36.788424 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3720/7356] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:36.793905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:36.807716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90ca5d-a57e-4641-8ceb-e27cbf773a31 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:36.814535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:36.816259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:36.816700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:36.817384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:36.818543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:36.821951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:36.876127 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3637/7357] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:36 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:36.882041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:36.907593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8970218-7e27-4df9-b139-b41496f7b088 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.076443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.077553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.077907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.078335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.079415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.102701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.140179 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3721/7358] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:36 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:37.143931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.157762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ebc2d-2598-4b15-b62d-d20d078dd077 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.165167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.166178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.169229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.169641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.170575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.172265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.204790 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3638/7359] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:37.211106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.226718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff8eb8-d17c-45e4-ab9b-195fefb625d7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.239634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.242205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.242559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.242842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.243592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.246976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daedcd0-22d8-414c-899c-d46b646ff4f4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.286332 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3722/7360] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:37.290723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.316918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcece6-d8ab-42cb-93cd-aecc2d1f7a3e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.324772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.326217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.326749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.327257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] PATH_INFO: `/v3/projects/499b2c73c21e412d805643148d308089/users/36aef13c0c474add876ed211ac5c064b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.363955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499b2c73c21e412d805643148d308089, user_id=36aef13c0c474add876ed211ac5c064b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.369459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.397561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3639/7361] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:37 2022] PUT /identity/v3/projects/499b2c73c21e412d805643148d308089/users/36aef13c0c474add876ed211ac5c064b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:37.408922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.409604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.410335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.472272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] MFA Rules not processed for user `36aef13c0c474add876ed211ac5c064b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:37.473655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:37.559014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.560969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:37.595864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3723/7362] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:37.599890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.684822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255686f5-7335-45ab-8927-f4b8bc3d0467 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.692527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.694246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.695216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.699609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.700411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.704052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.743846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babef48-bb14-4174-a4dc-46e01e612023 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.753873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.755041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.755573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.756067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] PATH_INFO: `/v3/users/5e3c9dbc7fca49ebb2f99d0d7a4ca12a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.763356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3c9dbc7fca49ebb2f99d0d7a4ca12a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.768032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.772172 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3724/7363] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:37 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:37.776800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.874813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3c9dbc7fca49ebb2f99d0d7a4ca12a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:37.894122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3c9dbc7fca49ebb2f99d0d7a4ca12a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:37.896086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3c9dbc7fca49ebb2f99d0d7a4ca12a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:37.918713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7250-e3a1-429e-b08d-a4b67022d0ad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:37.929876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3c9dbc7fca49ebb2f99d0d7a4ca12a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:37.935061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:37.935724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.936002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.936272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.936998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:37.938986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:37.940016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-eed6503f-e7a5-484a-bb5c-e832ec6891c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3c9dbc7fca49ebb2f99d0d7a4ca12a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:37.965710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3640/7364] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:37 2022] DELETE /identity/v3/users/5e3c9dbc7fca49ebb2f99d0d7a4ca12a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:37.971696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:37.972555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:37.973266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:37.979281 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3725/7365] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:37 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:37.984108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:37.985847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:37.998113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:37.999445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:38.000906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a7c-5d20-481e-84b7-1f14bd318117 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.107921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.108662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.109426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.109721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.110950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.112596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.129514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3726/7366] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:38.137733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.155105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a07a6-603d-4805-9f29-5de88135cf52 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.159719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3641/7367] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:38.168761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.169866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.170222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.170815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] PATH_INFO: `/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78/users/e157a9d4d14c441d867a95c24b6c1356/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.172175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.175977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:38.225750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb024cb918d4132a3a077a7dd2a7b78, user_id=e157a9d4d14c441d867a95c24b6c1356, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.233837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.261439 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3727/7368] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:38 2022] PUT /identity/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78/users/e157a9d4d14c441d867a95c24b6c1356/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:38.262955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.317796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f718-a7fa-4215-a624-44fdc68d7a2a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.409358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.410289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.410581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.410864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.417259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935541b0-a8cc-42c9-b526-b77da45ca8f7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.428825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.429831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.430337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.430831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.432172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.435490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.441892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.443369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa806e5-d1dc-4fc4-8ebb-bb781dd2fd20 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.467475 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3728/7369] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:38.471407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.488746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14617-faa9-4fe6-a4d8-b46f11ada4a8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.490663 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3642/7370] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:38.495266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.497169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.497679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.498325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] PATH_INFO: `/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78/users/e157a9d4d14c441d867a95c24b6c1356/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.501441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb024cb918d4132a3a077a7dd2a7b78, user_id=e157a9d4d14c441d867a95c24b6c1356, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.509803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.539815 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3729/7371] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:38 2022] PUT /identity/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78/users/e157a9d4d14c441d867a95c24b6c1356/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:38.555291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.555814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.557369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.616963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] MFA Rules not processed for user `e157a9d4d14c441d867a95c24b6c1356`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:38.619340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:38.759225 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3643/7372] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:38.763577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.780601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182862-a16d-4bd5-9291-7c7be419ab75 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:38.805266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:38.806347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:38.807281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:38.807779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:38.809005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:38.810717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:38.834835 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3730/7373] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Apr 2 21:18:38 2022] POST /identity/v3/domains => generated 277 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:38.843215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:38.865316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bec6a5-c9a1-4cd8-a169-2139f31a9dff None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.051815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.055786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.056200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.058460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.065594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.068973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.161371 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3644/7374] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:38 2022] POST /identity/v3/groups => generated 280 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:39.165019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.203497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854256a-bcfc-41d3-bbeb-fa9e17e5bc08 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.220827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.222130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.222615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.223070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/1fd910d879c046528055b7358909cbfc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.231041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:update_group(group_id=1fd910d879c046528055b7358909cbfc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.233252 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:39.233252 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:18:39.233252 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:18:39.234133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.262733 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3731/7375] 10.222.0.18 () {60 vars in 1246 bytes} [Sat Apr 2 21:18:39 2022] PATCH /identity/v3/groups/1fd910d879c046528055b7358909cbfc => generated 292 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:39.267180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.312421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3104c77-4489-4d5e-9398-e5a3e0b00071 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.341541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.342426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.342916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.343388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/1fd910d879c046528055b7358909cbfc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.351052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:get_group(group_id=1fd910d879c046528055b7358909cbfc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.352326 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:39.352326 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:39.352326 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:39.353943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.355922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3645/7376] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:39 2022] GET /identity/v3/groups/1fd910d879c046528055b7358909cbfc => generated 292 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:39.360186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.375000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edec0-47ce-484c-af63-100d83261766 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.390016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.390862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.391210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.395147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/1fd910d879c046528055b7358909cbfc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.399066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:update_group(group_id=1fd910d879c046528055b7358909cbfc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.406256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.469840 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3732/7377] 10.222.0.18 () {60 vars in 1245 bytes} [Sat Apr 2 21:18:39 2022] PATCH /identity/v3/groups/1fd910d879c046528055b7358909cbfc => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:39.475727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.489066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3a0a-5b84-4436-ae58-c54f06e389ed tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.507008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.508037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.508429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.508840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/1fd910d879c046528055b7358909cbfc` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.521050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1fd910d879c046528055b7358909cbfc)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.523288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.559630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.562111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:39.663916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3646/7378] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:39 2022] DELETE /identity/v3/groups/1fd910d879c046528055b7358909cbfc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:39.666442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.773910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2141a51-ae76-4ef2-aae6-057a46a8b076 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.824711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312c79-940b-4f54-be3c-72fb82fe8c44 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:39.832307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:39.833781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:39.835149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:39.837048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:39.839184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:39.842581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:39.899589 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3647/7379] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:39 2022] POST /identity/v3/groups => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:39.900790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:39.964325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2655-efef-4884-a36a-751d10bc767b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.000672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.000984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.001279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.001565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.002259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.004271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.019244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.024513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.025107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.025631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] PATH_INFO: `/v3/projects/1ce8744f73784c569b7e4dc524d5b011` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.032396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce8744f73784c569b7e4dc524d5b011)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.035623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.065840 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3648/7380] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:39 2022] POST /identity/v3/users => generated 321 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:40.074298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.095762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa56c-38dd-4fcf-b388-df4afe96d9e8 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.130569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.131568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.135090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.135090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.201008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=a255704f2db04e06b257f237e548e80d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.216276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.247788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce8744f73784c569b7e4dc524d5b011', 'request_id': 'req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:40.289287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce8744f73784c569b7e4dc524d5b011', 'request_id': 'req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:40.322517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3649/7381] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:18:40 2022] PUT /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:40.326738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.334491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce8744f73784c569b7e4dc524d5b011', 'request_id': 'req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:40.367660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] The token cache is being invalidate because project 1ce8744f73784c569b7e4dc524d5b011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:40.369633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:40.372413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ca4c6b3-85fc-43fe-8e2e-e07e422cf976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:40.380942 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3733/7382] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:39 2022] DELETE /identity/v3/projects/1ce8744f73784c569b7e4dc524d5b011 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:40.384797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f3c5-160e-4bb8-95c0-cfcdd73fb8cf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.386395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f3c5-160e-4bb8-95c0-cfcdd73fb8cf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.386916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06f3c5-160e-4bb8-95c0-cfcdd73fb8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.438596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5e06f3c5-160e-4bb8-95c0-cfcdd73fb8cf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:40.440007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e06f3c5-160e-4bb8-95c0-cfcdd73fb8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:40.481878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f52f-7b51-4aa6-8dcb-c5cd722307a7 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.500734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.501744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.502812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.503278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.504118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.506035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.562216 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3650/7383] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/users => generated 323 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:40.563371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3734/7384] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:40.563674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.571005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:40.575344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.575761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.576243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.598265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ada474-b67d-4d40-acef-e11e0a581323 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.607668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:40.609301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:40.613472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.614532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.614889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.615171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.622795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3735/7385] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:40.627168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.641385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e032fb-f787-47bc-8071-225ee19a0f09 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.648661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.650057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.650444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.650613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=4ee7b638a9314391a3ccd6429f4d29fe)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.651099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.652201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:40.652698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.652912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.655171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.672269 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3736/7386] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:40.677167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.696991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d314a2-f133-49c9-9fd6-6790ce91783b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.707151 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3651/7387] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:18:40 2022] PUT /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:40.711593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.815703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.816823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.816823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.817072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.817752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.822045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.876155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75142a-4c89-460e-bbcf-63fcf72dc433 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:40.887555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3737/7388] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/projects => generated 399 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:40.888693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:40.891575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:40.893902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:40.896387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:40.896871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:40.897940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:40.905376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:40.971129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3652/7389] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/users => generated 323 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:40.981229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.025527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870192b-121a-4ae9-8584-894967daae14 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.061643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba2b02-52d6-4702-bafb-2a6e6d95abff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.076638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.077737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.078589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.079049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.079939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.086051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.135249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3738/7390] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:40 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:41.136617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.138483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.139734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.140278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.142251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.154190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0262a-5cf3-4811-8e9a-3d43abe4b9f6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.172728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.173685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.174156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.174440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.175914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.180213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=eec06d4060974d03a40733dcbca7eba8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.180794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.184280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.224660 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3739/7391] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:41.232274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.254519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c977-160f-402f-9ca0-de3149fa819c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.269002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.269890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.275040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.275452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.277758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.282506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.304516 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3740/7392] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:41.310838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.350368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a7072-72cd-4734-a296-b6cc3a217062 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.377228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.378532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.379060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.379458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] PATH_INFO: `/v3/projects/e800c1df9c74462ea992a2316cf1eb25/users/367fbc336ceb487d967b92dc50a4310d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.434197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e800c1df9c74462ea992a2316cf1eb25, user_id=367fbc336ceb487d967b92dc50a4310d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.440815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d20f38-8401-44d3-97f2-eab212274866 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.496618 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3741/7393] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:41 2022] PUT /identity/v3/projects/e800c1df9c74462ea992a2316cf1eb25/users/367fbc336ceb487d967b92dc50a4310d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:41.498605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.499036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.499360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.595366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] MFA Rules not processed for user `367fbc336ceb487d967b92dc50a4310d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:41.596896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:41.624443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3653/7394] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:18:40 2022] PUT /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:41.627203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.759907 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3742/7395] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:41.770411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.772343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:41.792993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518a0d-8e65-4a4e-9edc-81ccdbd6e88a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.809266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.810122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.810409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.810692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.813457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=cef246894d544e57a8b7ff37cbd8eb35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.814559 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:41.814559 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:41.814559 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:41.815765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.873749 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3654/7396] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:41 2022] GET /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users => generated 1083 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:41.874932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:41.893804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa0f93-9f21-4c80-a595-2d90971c3a3c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.909516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c9c28-5ab8-4ba0-8c69-33cda7ee5a43 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:41.910462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.913373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.914174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.915007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.922317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:41.926045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:41.928849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:41.929461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:41.934895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=a255704f2db04e06b257f237e548e80d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.939061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:41.939799 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:41.939799 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:41.939799 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:41.941108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.945917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:41.961058 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3743/7397] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:41.979487 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3655/7398] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Apr 2 21:18:41 2022] HEAD /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:41.983853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.003353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996aace-f1ab-4956-98ad-4d87ca4c9c9f service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.009957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.012085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.012819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.013391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.016899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=a255704f2db04e06b257f237e548e80d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.019446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.038146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.078937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3744/7399] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:18:41 2022] DELETE /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/a255704f2db04e06b257f237e548e80d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.080779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.106710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb30ed7-9e7e-4c04-ab95-45f5b1c7835c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.264319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.265549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.266103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.266616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.274082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=4ee7b638a9314391a3ccd6429f4d29fe)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.276944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.315803 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3656/7400] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Apr 2 21:18:42 2022] HEAD /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.318785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.341334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21383-a2bb-414b-bc2d-517a44db6a6a tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.357940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.358869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.362630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.362962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.370064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=4ee7b638a9314391a3ccd6429f4d29fe)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.374591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.425104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.494530 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3745/7401] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:18:42 2022] DELETE /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/4ee7b638a9314391a3ccd6429f4d29fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.498380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.504867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.516590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e0cfe-1586-4ec9-b1e5-f07043f2d1a4 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.517759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:42.671876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.672708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f37c7-5557-434c-af3b-5ea99f25f9df tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.673018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.673632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.674015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.679316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.681617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.682235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.683214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=eec06d4060974d03a40733dcbca7eba8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.683678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] PATH_INFO: `/v3/users/00a94eccf6414721a36224e438a392de` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.685459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.686148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a94eccf6414721a36224e438a392de)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.693044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.718276 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3657/7402] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Apr 2 21:18:42 2022] HEAD /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.720602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.739027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8dba86-0711-433c-8a5c-3ff128a1e416 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:42.753637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:42.754762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.756616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.757038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.762870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cef246894d544e57a8b7ff37cbd8eb35, user_id=eec06d4060974d03a40733dcbca7eba8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:42.766601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:42.788945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.806025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a94eccf6414721a36224e438a392de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.821094 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3658/7403] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Apr 2 21:18:42 2022] DELETE /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users/eec06d4060974d03a40733dcbca7eba8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.822361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:42.825856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a94eccf6414721a36224e438a392de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.827145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a94eccf6414721a36224e438a392de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.828175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a94eccf6414721a36224e438a392de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.844205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3fb3ba28-6029-409f-88e4-b27156f31cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a94eccf6414721a36224e438a392de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:42.886883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3746/7404] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:42 2022] DELETE /identity/v3/users/00a94eccf6414721a36224e438a392de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:42.894992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:42.894992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:42.894992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:42.935310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:42.936824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:42.952493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921971b1-9a15-4a00-9ea8-166afd61557b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:43.070239 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3747/7405] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:43.082042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:43.083183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:43.083688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:43.084315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:43.088331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=cef246894d544e57a8b7ff37cbd8eb35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:43.091300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:43.100224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:43.101875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:43.114693 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3659/7406] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:42 2022] GET /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35/users => generated 145 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:43.119875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:43.128112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:43.154841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbecdd8-26c2-4d7f-9951-2a21ec851135 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:43.169105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:43.170235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:43.171831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:43.172251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users/eec06d4060974d03a40733dcbca7eba8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:43.174879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eec06d4060974d03a40733dcbca7eba8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:43.183763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:43.233679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40104-ee3d-4ca6-9ca2-ca94cedb9310 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:43.243764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:43.244713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:43.247511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:43.247661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:43.270710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:43.272257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:43.274418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.296133 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3748/7407] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:43.301275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.307265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.321192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.328795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec06d4060974d03a40733dcbca7eba8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.352757 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3660/7408] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:43 2022] DELETE /identity/v3/users/eec06d4060974d03a40733dcbca7eba8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:43.357577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:43.376425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767834f1-7502-44df-aa5a-ecfd283bb078 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:43.543455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:43.545394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:43.546365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:43.548796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users/4ee7b638a9314391a3ccd6429f4d29fe` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:43.550548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ee7b638a9314391a3ccd6429f4d29fe)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:43.557725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:43.634780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.698708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.704909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.712860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.728916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee7b638a9314391a3ccd6429f4d29fe'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:43.756499 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3749/7409] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:43 2022] DELETE /identity/v3/users/4ee7b638a9314391a3ccd6429f4d29fe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:43.758383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:43.760223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:43.795210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63154d14-aaf4-48cd-b054-b203ff678e48 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:43.938823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:43.939902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:43.940633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:43.940932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users/a255704f2db04e06b257f237e548e80d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:43.944599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a255704f2db04e06b257f237e548e80d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:43.947146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.056146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.092330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.093561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.099229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.100922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:44.107286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.127394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a255704f2db04e06b257f237e548e80d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.141640 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3661/7410] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:43 2022] DELETE /identity/v3/users/a255704f2db04e06b257f237e548e80d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:44.149298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.151286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:44.207572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bfa73-4e4a-43bd-975f-b72774a3251c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.299873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.301921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.302099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.302395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] PATH_INFO: `/v3/projects/e70585684cfd47abaefc439b16236ae4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.304361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70585684cfd47abaefc439b16236ae4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.307006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.372565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70585684cfd47abaefc439b16236ae4', 'request_id': 'req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.380166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70585684cfd47abaefc439b16236ae4', 'request_id': 'req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.382096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440dea8-efda-4c5a-b7a3-e19071e81f15 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.395071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70585684cfd47abaefc439b16236ae4', 'request_id': 'req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.407807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] The token cache is being invalidate because project e70585684cfd47abaefc439b16236ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:44.408488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.409166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1424e8dd-e3fd-49d2-91c5-b66e51b6ebb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:44.414076 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3750/7411] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:44 2022] DELETE /identity/v3/projects/e70585684cfd47abaefc439b16236ae4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:44.416430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537bd1-3c39-4b64-b797-2a78d0067af9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.416870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537bd1-3c39-4b64-b797-2a78d0067af9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.417352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537bd1-3c39-4b64-b797-2a78d0067af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.463733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f537bd1-3c39-4b64-b797-2a78d0067af9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:44.466435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f537bd1-3c39-4b64-b797-2a78d0067af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:44.530913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.531869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.532403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.533638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/cef246894d544e57a8b7ff37cbd8eb35` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.538856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cef246894d544e57a8b7ff37cbd8eb35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.541164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.596843 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3751/7412] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:44.599566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.600163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.600671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.626577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3662/7413] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:44 2022] DELETE /identity/v3/groups/cef246894d544e57a8b7ff37cbd8eb35 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:44.631142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:44.631854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:44.632798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.634680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:44.725982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a845a28-0125-40b4-bf98-46a847edb2d5 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.730092 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3752/7414] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:44.733826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.735548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.736242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.739502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.739502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.739768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.741645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.753505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8eb7c-be41-439f-9b6f-4418cd456a29 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.765166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.765896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.766553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.766838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.767582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:44.767958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.770215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.772838 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3663/7415] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/groups => generated 327 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:44.776686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.784724 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3753/7416] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:44.787925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.792917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0f098-a05f-4930-b5aa-47de234291cc tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.801040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.801253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac77c79-8f04-4f7d-b073-7ee0af09f01a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.801714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.801997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.802272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.802954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.804950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.807152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.808775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.809162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.809872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.810803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.813219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.823370 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3664/7417] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/groups => generated 325 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:44.827767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.841999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8289a-cfd8-427a-a751-082ac41c0e98 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.846159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3754/7418] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:44.850215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.853890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.855120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.855406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.855683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.856417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.858368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:44.886679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3665/7419] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/groups => generated 326 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:44.888415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:44.908267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec952daf-cf52-4ffa-8a4c-c3247fe63ac0 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.946124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411632f5-f5be-412b-a808-f6715889fbc9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:44.960656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:44.961792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:44.962200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:44.963307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:44.964709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:44.972192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debaa89-811e-493b-ad4a-e1d7865f07ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.015485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.016267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.016644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.016927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.017701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.020795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3755/7420] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:44 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:45.020916 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:45.020916 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:18:45.020916 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:18:45.021166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.021263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.021349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.021349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.036246 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3666/7421] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:18:44 2022] GET /identity/v3/groups => generated 1488 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:45.036246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.050700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9792-3131-4885-9083-4b2df396bc7c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.080282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.082350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.083407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.087277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.088289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.092246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.100961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] MFA Rules not processed for user `46d0c6b2806a46ce9621af36b828e17e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:45.102760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:45.106952 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3667/7422] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:45.108056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.127969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669672-5f7c-41fd-832f-a66ce08f4e5e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.153838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.156632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.156930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.157216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/a71100fe401a49efa59d5315937e5ffa` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.170640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a71100fe401a49efa59d5315937e5ffa)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.172636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.238291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3756/7423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:45.239812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.270777 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3668/7424] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:45 2022] DELETE /identity/v3/groups/a71100fe401a49efa59d5315937e5ffa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:45.279926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.282373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:45.283639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73156ad2-c61c-4192-9091-8c334506b75c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.419153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.419932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.420218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.420525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.421402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.423028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.439463 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3757/7425] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:45.440544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.467677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20d4db-7925-4907-bd47-f0a6b153801b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.475453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.477271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.477816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.478321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.479273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.482878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.531199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3669/7426] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:45 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:45.532960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.551658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce16b5-7c82-4a35-a621-bf3ed5cd74be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.620266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc4ea4-0397-4e19-bbab-41ae94274544 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.625198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.626378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.626846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.627013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.627181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] PATH_INFO: `/v3/projects/473b58b2a2bc43919bf1a157a2bdf3df/users/15b02fbc671c4a80abaf5e414d668e35/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.628243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.628765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.629510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/1d3fd65cb036416e86d5b9fc8ce0a23b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.637401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1d3fd65cb036416e86d5b9fc8ce0a23b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.640072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f8620-00ea-475b-8ee1-c2d7c0163605 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.652141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=473b58b2a2bc43919bf1a157a2bdf3df, user_id=15b02fbc671c4a80abaf5e414d668e35, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.654869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.684748 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3670/7427] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:45 2022] PUT /identity/v3/projects/473b58b2a2bc43919bf1a157a2bdf3df/users/15b02fbc671c4a80abaf5e414d668e35/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:45.685751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.712544 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3758/7428] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:45 2022] DELETE /identity/v3/groups/1d3fd65cb036416e86d5b9fc8ce0a23b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:45.712764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.713164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.713302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.787799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] MFA Rules not processed for user `15b02fbc671c4a80abaf5e414d668e35`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:45.793783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:45.839384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d456fc-b14a-4f2d-8069-657fc7ec16aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.912771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.913373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.913660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.913940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.914632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.916752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:45.944978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3671/7429] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:45 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:45.946220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.951550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3759/7430] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:45.956925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:45.971852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31694-be50-4c08-aa6c-a8bec7c50285 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:45.985686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:45.985686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:45.985686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:45.996447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:45.996447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:45.996447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.023905 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3760/7431] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:46.027978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.038305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24716a3-198c-4218-a294-abcfa3c651b6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.047253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.049146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.049146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.049146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.050169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.052333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.084853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af776d-5d64-4b73-ae17-88c1e4dc10f2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.090308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.091198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.091488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.091769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/75b502e1d96147bfa9e0c050976ad45c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.098314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=75b502e1d96147bfa9e0c050976ad45c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.102701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.103817 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3761/7432] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:46 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:46.105617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.179558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3672/7433] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:45 2022] DELETE /identity/v3/groups/75b502e1d96147bfa9e0c050976ad45c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:46.186810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.208091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69c05-0bb9-4421-b7c8-e4b06dd26ab5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.324675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.325899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.326060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.326330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] PATH_INFO: `/v3/projects/08287b395fcf45c38195909db7f53878/users/f21abe9d0e7647b08690bc957f3960b1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.331989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d9f2-3ccf-48d1-a59d-a38c18bd5c53 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.340166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.341570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.342110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.342562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.343488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.346334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.374152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08287b395fcf45c38195909db7f53878, user_id=f21abe9d0e7647b08690bc957f3960b1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.377556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.393237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3673/7434] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:46 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:46.394155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.403377 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3762/7435] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:46 2022] PUT /identity/v3/projects/08287b395fcf45c38195909db7f53878/users/f21abe9d0e7647b08690bc957f3960b1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:46.404590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.531401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769b942-8d6b-43cf-874f-89c1c707362b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.559924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299ee3-42cb-433d-bb01-c27c3fca6168 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.571086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.571797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.572669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.572960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.575093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.576741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.591820 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3763/7436] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:46.593328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.613955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5b2b-56b6-43ac-8a6a-8c84b75a1e87 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.622189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.624052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.625197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.625723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.626666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.628646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.644779 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3764/7437] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:46.646169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.655603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.655978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.656263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.656572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.657265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.662312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.662441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa8742-ac13-4e87-afab-f21979bbdd7d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.671379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.672435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.673014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.673829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] PATH_INFO: `/v3/projects/154ae568d9654af3bad36466938a57ff/users/c346fc0df15b40b0ad7735ff003d2d19/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.697320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=154ae568d9654af3bad36466938a57ff, user_id=c346fc0df15b40b0ad7735ff003d2d19, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.701725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.712312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3674/7438] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:46 2022] POST /identity/v3/users => generated 321 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:46.715035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.734318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484616b0-9ba2-4ac1-9f5b-7b00d4e3245c tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.737694 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3765/7439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:46 2022] PUT /identity/v3/projects/154ae568d9654af3bad36466938a57ff/users/c346fc0df15b40b0ad7735ff003d2d19/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:46.741539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.828699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.830097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.830387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.830845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] PATH_INFO: `/v3/projects/08287b395fcf45c38195909db7f53878/users/f21abe9d0e7647b08690bc957f3960b1/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.833512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08287b395fcf45c38195909db7f53878, user_id=f21abe9d0e7647b08690bc957f3960b1, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.840311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.851624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512f145-006a-48ff-9a43-6db880c842fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.855957 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3675/7440] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:46 2022] PUT /identity/v3/projects/08287b395fcf45c38195909db7f53878/users/f21abe9d0e7647b08690bc957f3960b1/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:46.855957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.941195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.942040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.942431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.942817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.943616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.945710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.951704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7e690-8205-4f5b-a874-12f13b701ee4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.960969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:46.961714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:46.961999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:46.962356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:46.963291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:46.965931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:46.974492 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3766/7441] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:46 2022] POST /identity/v3/groups => generated 325 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:46.976150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.981244 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3676/7442] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:46.982322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:46.992330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602412fa-9291-40d1-b81b-2ccbb04f2894 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:46.999295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679b14e-576a-4d66-8cb4-aeefc272b1d1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.004677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.006358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.007315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.008196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/356a10aa5d83408981dd4c3a6d678865/users/e5da81be1a084279b7d10ef9fa0cba9f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.009754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.011436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.011775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.012074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] PATH_INFO: `/v3/projects/154ae568d9654af3bad36466938a57ff/users/c346fc0df15b40b0ad7735ff003d2d19/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.019129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154ae568d9654af3bad36466938a57ff, user_id=c346fc0df15b40b0ad7735ff003d2d19, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.022457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d418122-9caa-4b2c-a6d3-b0662a59a043 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.035467 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3677/7443] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:46 2022] PUT /identity/v3/projects/154ae568d9654af3bad36466938a57ff/users/c346fc0df15b40b0ad7735ff003d2d19/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:47.047691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.048185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.048864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.052975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=356a10aa5d83408981dd4c3a6d678865, user_id=e5da81be1a084279b7d10ef9fa0cba9f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.060561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.083816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] MFA Rules not processed for user `c346fc0df15b40b0ad7735ff003d2d19`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:47.085739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:47.110111 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3767/7444] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:18:46 2022] PUT /identity/v3/groups/356a10aa5d83408981dd4c3a6d678865/users/e5da81be1a084279b7d10ef9fa0cba9f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:47.114517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.234434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832397-2ba6-4ffe-b2e5-5467bfdffa24 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.235859 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3678/7445] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:47.240732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.244206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.245712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.246088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.247767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.248595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.251368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.261209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276821d-83d8-49e0-9231-5790df77d306 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.301890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3768/7446] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:47 2022] POST /identity/v3/groups => generated 326 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:47.304146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.337126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1299a-3683-4b07-a431-4f1e77308fb9 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.345590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.347090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.347541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.347964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/24c0cd4d1d0a482f840c4584bc36fa51/users/e5da81be1a084279b7d10ef9fa0cba9f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.358253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=24c0cd4d1d0a482f840c4584bc36fa51, user_id=e5da81be1a084279b7d10ef9fa0cba9f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.358827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.359708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.360205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.360673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.361020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.361693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.363937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.396537 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3769/7447] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Apr 2 21:18:47 2022] PUT /identity/v3/groups/24c0cd4d1d0a482f840c4584bc36fa51/users/e5da81be1a084279b7d10ef9fa0cba9f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:47.399408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.438075 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3679/7448] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:18:47 2022] POST /identity/v3/projects => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:47.440077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.582069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7e4ef-0b61-4316-8dee-303ce0fffb33 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.589999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.591462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.591853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.592343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.593671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.597238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.607885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98596f3-1518-487e-a3ee-c10d323d5f40 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.682601 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3680/7449] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:47 2022] POST /identity/v3/projects => generated 350 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:47.688207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.832762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.835634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.836094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.836391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users/e5da81be1a084279b7d10ef9fa0cba9f/groups` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.839543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=e5da81be1a084279b7d10ef9fa0cba9f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.853240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.875383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3563-ab00-4bfa-9aa4-3df9b5d780b9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.894255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.895246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.895542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.895883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/users/15b02fbc671c4a80abaf5e414d668e35` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.899227 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3770/7450] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:18:47 2022] GET /identity/v3/users/e5da81be1a084279b7d10ef9fa0cba9f/groups => generated 837 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:47.902528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.905790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:get_user(user_id=15b02fbc671c4a80abaf5e414d668e35)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.908382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:47.918406 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3681/7451] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:18:47 2022] GET /identity/v3/users/15b02fbc671c4a80abaf5e414d668e35 => generated 288 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:47.932259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d9757-d008-4351-bb00-ac39db1a7214 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.933834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:47.966835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96f92-d553-4ae6-9a19-bb607794e0f0 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:47.981869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:47.984756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:47.985647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:47.985967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:47.990192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:47.994680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.037442 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3682/7452] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Apr 2 21:18:47 2022] POST /identity/v3/credentials => generated 431 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:48.043075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.079309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9dcb8-c96c-4a71-b8e9-3c49f41dced8 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.095900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.097761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.098107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.098368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.102289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.103826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.105115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.107355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.108972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.110425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.111568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.112666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/24c0cd4d1d0a482f840c4584bc36fa51` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.115012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=24c0cd4d1d0a482f840c4584bc36fa51)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.118782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.131969 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3683/7453] 10.222.0.18 () {60 vars in 1357 bytes} [Sat Apr 2 21:18:48 2022] PATCH /identity/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1 => generated 436 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:48.136219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.150426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fd587-b552-462f-b6f1-4a4cbeab6db3 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.157282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.158543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.158835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.159158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.166628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.173898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.186119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3684/7454] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Apr 2 21:18:48 2022] GET /identity/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1 => generated 436 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:48.190317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.217106 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3771/7455] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:47 2022] DELETE /identity/v3/groups/24c0cd4d1d0a482f840c4584bc36fa51 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:48.218567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4462d9-17b7-48ef-82dd-1f888ca41447 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.222350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.334700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c2e2e-795c-474e-ac79-544359baa6e1 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.339902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.341411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.341893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.342189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.342579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.343568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.344033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.344370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/groups/356a10aa5d83408981dd4c3a6d678865` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.346336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.346504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_group(group_id=356a10aa5d83408981dd4c3a6d678865)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.348879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.349047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.375298 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3685/7456] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Apr 2 21:18:48 2022] DELETE /identity/v3/credentials/45c201c7115fb9d90a26d8dffae55ea99d144af6a65edf30fe90f3c55fe7c3d1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:48.387294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.403551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1bdef-cdc4-4154-82d7-15b46c295c47 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.417162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.418981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.419527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.419818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.420742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.423186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.480118 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3686/7457] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Apr 2 21:18:48 2022] POST /identity/v3/credentials => generated 431 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:48.483765 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3772/7458] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Apr 2 21:18:48 2022] DELETE /identity/v3/groups/356a10aa5d83408981dd4c3a6d678865 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:48.486251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.493607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.532798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a26cfd-e7bb-49d6-9198-1311cb28e09c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.700221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89770f03-e651-41b0-be3c-210010b57180 tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.725054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.726782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.727587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.728721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.729226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.729766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.730231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.731147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.731614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/users/e5da81be1a084279b7d10ef9fa0cba9f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.734378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.744112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e5da81be1a084279b7d10ef9fa0cba9f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.746839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.800547 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3687/7459] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Apr 2 21:18:48 2022] POST /identity/v3/credentials => generated 429 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:48.809944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.831303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5da81be1a084279b7d10ef9fa0cba9f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:48.837672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc95ea1-ce08-45b5-bf6c-d05c76c19a7c tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:48.846702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5da81be1a084279b7d10ef9fa0cba9f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:48.847703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5da81be1a084279b7d10ef9fa0cba9f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:48.848736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5da81be1a084279b7d10ef9fa0cba9f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:48.858056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:48.859197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:48.859588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:48.861848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:48.862633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5da81be1a084279b7d10ef9fa0cba9f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:48.863724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.869747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.892655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.896754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.899417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:48.904727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:48.913664 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3688/7460] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 21:18:48 2022] GET /identity/v3/credentials => generated 945 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:48.918105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.922006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:48.944087 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3773/7461] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:48 2022] DELETE /identity/v3/users/e5da81be1a084279b7d10ef9fa0cba9f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:48.950505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:48.953697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:48.973911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04db9ee-1eae-4cd4-932b-f13a7cd85d83 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.093973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c9789-4eee-4eb1-9dd3-0c597a3e935b tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.106906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.107618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.109237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.109714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.110065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.110471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.110816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/domains/e4261c17a2d04a949cddd3fe86ab211e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.111535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials/265ddafd277c5f0313af487d437a73ed4165a922ef49175dc124da2e25b8480c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.114384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=265ddafd277c5f0313af487d437a73ed4165a922ef49175dc124da2e25b8480c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.115411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e4261c17a2d04a949cddd3fe86ab211e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.118561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.121809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.151287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3689/7462] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Apr 2 21:18:48 2022] DELETE /identity/v3/credentials/265ddafd277c5f0313af487d437a73ed4165a922ef49175dc124da2e25b8480c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:49.152446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:49.157290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:49.167769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.174048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.247277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.249642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.255263 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3774/7463] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Apr 2 21:18:48 2022] PATCH /identity/v3/domains/e4261c17a2d04a949cddd3fe86ab211e => generated 278 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:49.256978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:49.260246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:49.346516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d4a18-97e6-471e-b472-befa5368e310 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.422588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0220e-7195-4a76-9e35-53e01b16119e tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.436276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.437479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.437622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.437889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/credentials/85eb3b153a4774c88ab847b304ffd64f6cafd456923a82790361e2178918fc5f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.446821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=85eb3b153a4774c88ab847b304ffd64f6cafd456923a82790361e2178918fc5f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.447411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.448479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.448711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.449064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.449443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] PATH_INFO: `/v3/users/367fbc336ceb487d967b92dc50a4310d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.451853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=367fbc336ceb487d967b92dc50a4310d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.454767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.480776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3775/7464] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Apr 2 21:18:49 2022] DELETE /identity/v3/credentials/85eb3b153a4774c88ab847b304ffd64f6cafd456923a82790361e2178918fc5f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:49.482935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:49.488590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:49.543339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367fbc336ceb487d967b92dc50a4310d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.562051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367fbc336ceb487d967b92dc50a4310d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.563453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367fbc336ceb487d967b92dc50a4310d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.577652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367fbc336ceb487d967b92dc50a4310d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.592851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367fbc336ceb487d967b92dc50a4310d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.605762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3690/7465] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:49 2022] DELETE /identity/v3/users/367fbc336ceb487d967b92dc50a4310d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:49.607783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:49.610067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:49.628633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17435-ef73-43aa-96f2-b8b6d8cb1bf5 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.753271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e157a9d4d14c441d867a95c24b6c1356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecb024cb918d4132a3a077a7dd2a7b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.754780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.755057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.755340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] PATH_INFO: `/v3/domains/e4261c17a2d04a949cddd3fe86ab211e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.761991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8259-c643-43c2-a4ee-078da875cf6b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:49.768166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:49.769241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.769533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.769816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/projects/d5c5b7932c864061ae2006542db0bda7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.771081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5c5b7932c864061ae2006542db0bda7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.773976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.785076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e4261c17a2d04a949cddd3fe86ab211e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:49.786735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:49.835732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.849740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.871077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c5b7932c864061ae2006542db0bda7', 'request_id': 'req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.887878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c5b7932c864061ae2006542db0bda7', 'request_id': 'req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.907045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c5b7932c864061ae2006542db0bda7', 'request_id': 'req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.936694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] The token cache is being invalidate because project d5c5b7932c864061ae2006542db0bda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:49.936890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.937008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.938933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-38551c74-df3f-4fed-9ca3-23d7dd9d29d9 tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.942065 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3691/7466] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:49 2022] DELETE /identity/v3/projects/d5c5b7932c864061ae2006542db0bda7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:49.945170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:49.945170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:49.945170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:49.945441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.955477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.982133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] The token cache is being invalidate because project e4261c17a2d04a949cddd3fe86ab211e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:49.982133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.983586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:49.998736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.002457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.003080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:50.003339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e4261c17a2d04a949cddd3fe86ab211e', 'request_id': 'req-284df900-17c7-42f5-9dd4-c887bdabbd7d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.004373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.012602 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3776/7467] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:18:49 2022] DELETE /identity/v3/domains/e4261c17a2d04a949cddd3fe86ab211e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:50.012602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:50.012907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.105606 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3692/7468] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:50.106619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:50.107972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.121487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284df900-17c7-42f5-9dd4-c887bdabbd7d tempest-GroupsV3TestJSON-685878374 tempest-GroupsV3TestJSON-685878374-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:50.125076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1b365-0b0f-497b-9538-904ff699d601 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:50.130831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:50.131722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.132165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.132441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] PATH_INFO: `/v3/users/36aef13c0c474add876ed211ac5c064b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.134080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36aef13c0c474add876ed211ac5c064b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:50.136091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c346fc0df15b40b0ad7735ff003d2d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '154ae568d9654af3bad36466938a57ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:50.136672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:50.138456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.139964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.140248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] PATH_INFO: `/v3/projects/88776bb334554bb490df0772566217aa` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.149220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorizing `identity:delete_project(project_id=88776bb334554bb490df0772566217aa)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:50.157387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:50.213978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36aef13c0c474add876ed211ac5c064b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.241738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36aef13c0c474add876ed211ac5c064b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.242639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36aef13c0c474add876ed211ac5c064b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.267493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36aef13c0c474add876ed211ac5c064b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.268764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88776bb334554bb490df0772566217aa', 'request_id': 'req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.284117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88776bb334554bb490df0772566217aa', 'request_id': 'req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.292417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36aef13c0c474add876ed211ac5c064b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.304215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88776bb334554bb490df0772566217aa', 'request_id': 'req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.310116 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3693/7469] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:50 2022] DELETE /identity/v3/users/36aef13c0c474add876ed211ac5c064b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:50.311304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:50.316624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.323752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] The token cache is being invalidate because project 88776bb334554bb490df0772566217aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:50.324059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.324794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cc6ceffa-b8cc-4a40-b36c-988826cd0a7f tempest-CredentialsTestJSON-173440679 tempest-CredentialsTestJSON-173440679-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.326593 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3777/7470] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:50 2022] DELETE /identity/v3/projects/88776bb334554bb490df0772566217aa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:50.330781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.331079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.331366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.394346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:50.395614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.505543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f4ded-b83e-4b2d-8fff-a0b8a5b652b9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:50.510036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:50.511620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.511926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.512307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.518311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.580297 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3778/7471] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:50.581166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:50.585879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.619546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdd4b2-0bd3-4362-aa8e-41150a9c541c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:50.632647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:50.633825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.634110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.634528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] PATH_INFO: `/v3/users/15b02fbc671c4a80abaf5e414d668e35` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.636047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b02fbc671c4a80abaf5e414d668e35)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:50.638039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:50.679843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:50.681921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:50.711835 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3694/7472] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:50.714237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:50.722242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.737727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b02fbc671c4a80abaf5e414d668e35'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.756996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14107b28-02b7-4b47-a564-775ab979a501 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:50.759346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b02fbc671c4a80abaf5e414d668e35'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.760189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b02fbc671c4a80abaf5e414d668e35'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.761489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b02fbc671c4a80abaf5e414d668e35'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.769278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:50.769957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.770237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.770512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.772343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:50.778662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-194ce41a-4f76-4505-8629-6f8424db0762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b02fbc671c4a80abaf5e414d668e35'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:50.798576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:50.801018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:50.821869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3779/7473] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:50 2022] DELETE /identity/v3/users/15b02fbc671c4a80abaf5e414d668e35 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:50.823299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3695/7474] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:50.826535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:50.826839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:50.827123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:50.879257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:50.880748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:51.048087 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3780/7475] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:51.087062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:51.092126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:51.112601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9e51-c450-4b3c-a471-ba5f8bff1b12 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:51.275416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:51.276137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:51.276429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:51.276738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:51.304300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:51.306324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:51.342156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3696/7476] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:52.190102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.192173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.199821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.202083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.217576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92399a-0dc7-42d4-952d-9de8e4c72836 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:52.239517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ecbd-afeb-4985-a4af-fac202b7c16a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:52.261043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:52.262225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.262616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.263124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] PATH_INFO: `/v3/projects/e800c1df9c74462ea992a2316cf1eb25` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.265529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:52.265928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e800c1df9c74462ea992a2316cf1eb25)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:52.268746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.270704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.270969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:52.271347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] PATH_INFO: `/v3/projects/473b58b2a2bc43919bf1a157a2bdf3df` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.273585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473b58b2a2bc43919bf1a157a2bdf3df)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:52.277049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:52.409546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e800c1df9c74462ea992a2316cf1eb25', 'request_id': 'req-9441bf3b-0855-4b8f-bbc5-d57750d77974'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.420699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e800c1df9c74462ea992a2316cf1eb25', 'request_id': 'req-9441bf3b-0855-4b8f-bbc5-d57750d77974'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.422352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473b58b2a2bc43919bf1a157a2bdf3df', 'request_id': 'req-46eb63c7-215f-4330-b12a-eea11c99da36'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.436925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e800c1df9c74462ea992a2316cf1eb25', 'request_id': 'req-9441bf3b-0855-4b8f-bbc5-d57750d77974'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.458293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473b58b2a2bc43919bf1a157a2bdf3df', 'request_id': 'req-46eb63c7-215f-4330-b12a-eea11c99da36'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.465214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] The token cache is being invalidate because project e800c1df9c74462ea992a2316cf1eb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:52.466500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.467693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9441bf3b-0855-4b8f-bbc5-d57750d77974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.474897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473b58b2a2bc43919bf1a157a2bdf3df', 'request_id': 'req-46eb63c7-215f-4330-b12a-eea11c99da36'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.480773 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3697/7477] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:52 2022] DELETE /identity/v3/projects/e800c1df9c74462ea992a2316cf1eb25 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:52.483106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.483443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.483720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.503660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] The token cache is being invalidate because project 473b58b2a2bc43919bf1a157a2bdf3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:52.504142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.505091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.507411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3781/7478] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:52 2022] DELETE /identity/v3/projects/473b58b2a2bc43919bf1a157a2bdf3df => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:52.511874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.521407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.530831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:52.532994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.599412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb63c7-215f-4330-b12a-eea11c99da36 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:52.605875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:52.606980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.607511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.607971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] PATH_INFO: `/v3/users/c346fc0df15b40b0ad7735ff003d2d19` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.609465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c346fc0df15b40b0ad7735ff003d2d19)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:52.611638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:52.675821 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3698/7479] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:52.678899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.681612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.683621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c346fc0df15b40b0ad7735ff003d2d19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.698784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c346fc0df15b40b0ad7735ff003d2d19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.699804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c346fc0df15b40b0ad7735ff003d2d19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.700694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c346fc0df15b40b0ad7735ff003d2d19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.711808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a9ab0-dc23-4fbc-bdc6-d7d23bf1f8f7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:52.713261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ab8b093b-09a5-4735-8928-64a2abe06653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c346fc0df15b40b0ad7735ff003d2d19'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.724296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:52.726228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.726765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.727549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] PATH_INFO: `/v3/projects/499b2c73c21e412d805643148d308089` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.731716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499b2c73c21e412d805643148d308089)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:52.734828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:52.743013 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3782/7480] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:52 2022] DELETE /identity/v3/users/c346fc0df15b40b0ad7735ff003d2d19 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:52.744624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:52.745202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:52.745601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:52.781696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:52.783368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.828261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499b2c73c21e412d805643148d308089', 'request_id': 'req-b1756118-3780-47e2-bf44-68629f8f97c2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.837578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499b2c73c21e412d805643148d308089', 'request_id': 'req-b1756118-3780-47e2-bf44-68629f8f97c2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.846013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499b2c73c21e412d805643148d308089', 'request_id': 'req-b1756118-3780-47e2-bf44-68629f8f97c2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.874222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] The token cache is being invalidate because project 499b2c73c21e412d805643148d308089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:52.874521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.875310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:52.878986 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3699/7481] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:52 2022] DELETE /identity/v3/projects/499b2c73c21e412d805643148d308089 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:52.884814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.888275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:52.926159 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3783/7482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:52.927231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:52.951914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9256-af51-4669-86cc-4b8dbb997165 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.011959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1756118-3780-47e2-bf44-68629f8f97c2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.021339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.023169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.023665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.024556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] PATH_INFO: `/v3/users/e157a9d4d14c441d867a95c24b6c1356` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.030095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e157a9d4d14c441d867a95c24b6c1356)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.032550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.076193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.077082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.077377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.078582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.079393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:53.079713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.081434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.103038 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3784/7483] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:53.103937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.107780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e157a9d4d14c441d867a95c24b6c1356'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.115935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903243e-189d-4cf0-afc4-7f717ae1e7ad admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.123889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.124606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.124897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.125180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.126122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e157a9d4d14c441d867a95c24b6c1356'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.126261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.126859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e157a9d4d14c441d867a95c24b6c1356'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.139063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e157a9d4d14c441d867a95c24b6c1356'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.143303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.150291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e157a9d4d14c441d867a95c24b6c1356'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.163894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3700/7484] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:52 2022] DELETE /identity/v3/users/e157a9d4d14c441d867a95c24b6c1356 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:53.204370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.205263 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3785/7485] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:53.205964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:53.273760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.276861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:53.315348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca08b-e499-45f4-afbc-6905c14c3f76 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.383378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9971a-257b-4c6c-9049-71c47a201020 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.394038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.398815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.398815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.398815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] PATH_INFO: `/v3/projects/154ae568d9654af3bad36466938a57ff` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.399332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=154ae568d9654af3bad36466938a57ff)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.402047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.438942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.440246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.440574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.451306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.452157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.455378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.503463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154ae568d9654af3bad36466938a57ff', 'request_id': 'req-d0a21fd6-3f10-4237-972e-da0fd48ec55c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.519414 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3701/7486] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/users => generated 291 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:53.520777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.523075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154ae568d9654af3bad36466938a57ff', 'request_id': 'req-d0a21fd6-3f10-4237-972e-da0fd48ec55c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.540318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154ae568d9654af3bad36466938a57ff', 'request_id': 'req-d0a21fd6-3f10-4237-972e-da0fd48ec55c'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.545254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea943d6-273e-4fa0-962d-752bc7e3f61d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.565285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] The token cache is being invalidate because project 154ae568d9654af3bad36466938a57ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:53.566092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.567000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d0a21fd6-3f10-4237-972e-da0fd48ec55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:53.571814 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3786/7487] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:53 2022] DELETE /identity/v3/projects/154ae568d9654af3bad36466938a57ff => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:53.577635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746121-a8b7-44c2-8848-9720672ca868 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.577952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746121-a8b7-44c2-8848-9720672ca868 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.578240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc746121-a8b7-44c2-8848-9720672ca868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.601537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dc746121-a8b7-44c2-8848-9720672ca868 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:53.602775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dc746121-a8b7-44c2-8848-9720672ca868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:53.685131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.685821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.686106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.686384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.693213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.699286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.724070 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3702/7488] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:53.729837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.746520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:53.761596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3787/7489] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:53.765923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.768537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.771456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.778761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2650-33ca-4f5a-9e8f-075ee283b07b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.791400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.792803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.793239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.793585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.794534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.796262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.815893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:53.817551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:53.821384 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3703/7490] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:53.822511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.831568 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3788/7491] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:53.836024 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.846239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0a35c-9c9b-415f-bf89-92d3c7759015 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.857381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191e86-c4e6-4563-8af3-0b1dfbdc7ad4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.858426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.859904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.860017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.860278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] PATH_INFO: `/v3/projects/6dcd60b7072543dc834451d5898d67e3/users/ece3f0bfe8294cdba77f8fe0e429f06d/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.871380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:53.873474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.873762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.875117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.880085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:53.880409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.882085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.903872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dcd60b7072543dc834451d5898d67e3, user_id=ece3f0bfe8294cdba77f8fe0e429f06d, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:53.908445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf28203-57cd-4e24-97cd-20c07ecf4b31 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:53.915240 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3789/7492] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:53.918422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:53.943181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3704/7493] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:53 2022] PUT /identity/v3/projects/6dcd60b7072543dc834451d5898d67e3/users/ece3f0bfe8294cdba77f8fe0e429f06d/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:53.945068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:53.945834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929e86-7d22-4a20-9ae1-12decf822ea3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:53.946576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:53.946693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:53.970897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:53.972610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:54.058021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.059470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.060169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.060765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.062276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.065336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.078313 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3705/7494] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:54.093727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.095242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:54.111753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3790/7495] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:53 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:54.116358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.273424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935154e-28e0-44b9-a9fb-9eff9eeb8d0e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.286017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d08abc-5cbf-4b72-a168-1378ccf80e18 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.303256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.306334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.309591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.310304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.311395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.319744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.375735 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3791/7496] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:54 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:54.378738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.407713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c121-93da-4a4b-bb93-84864c2d67c6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.414764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.415490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.415773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.416053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.418209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.422377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.433274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.434068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.437231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.437558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.454594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3792/7497] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:54.462307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.467650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.469167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.488494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00735-8992-4bf4-bac6-2a59c1d5e7bc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.490581 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3706/7498] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:54.506554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.507938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.509691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.510233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.512002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.514266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.534710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3793/7499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:54.538528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.552281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5f31a-ae66-4054-a419-a06a53cee89e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.563938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.564854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.565314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.565823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] PATH_INFO: `/v3/projects/94b17ca773b54f418e6609cca4d3cd79/users/3e425d5e05004a84b4a5c5ac64193bf8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.598388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.600615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:54.601799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b17ca773b54f418e6609cca4d3cd79, user_id=3e425d5e05004a84b4a5c5ac64193bf8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.605862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084498-e42a-4f33-85d5-d790a338520d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.626968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822de076-ce3d-4732-b4d3-e6a5eb46e24d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.635034 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3707/7500] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:54 2022] PUT /identity/v3/projects/94b17ca773b54f418e6609cca4d3cd79/users/3e425d5e05004a84b4a5c5ac64193bf8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:54.637209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.637502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.638160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.672880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] MFA Rules not processed for user `3e425d5e05004a84b4a5c5ac64193bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:54.674402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:54.782628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.784359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.785864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.786225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] PATH_INFO: `/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.791217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb024cb918d4132a3a077a7dd2a7b78)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.793837 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3708/7501] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:54.797317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.799462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.826933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204731-c540-41a6-9666-d3c92e97bdfd None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:54.837920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:54.838614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.841390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.842429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:54.843228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:54.847083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:54.895072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb024cb918d4132a3a077a7dd2a7b78', 'request_id': 'req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:54.904470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb024cb918d4132a3a077a7dd2a7b78', 'request_id': 'req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:54.908942 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3709/7502] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:54 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:54.910500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:54.933070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb024cb918d4132a3a077a7dd2a7b78', 'request_id': 'req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:54.962096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] The token cache is being invalidate because project ecb024cb918d4132a3a077a7dd2a7b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:54.963643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:54.966951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60ac4a8b-f378-4bd6-82c5-4856e987b3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:54.972413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3794/7503] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:54 2022] DELETE /identity/v3/projects/ecb024cb918d4132a3a077a7dd2a7b78 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:54.976121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2192-62be-432d-8a90-dcd9de22ab7a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:54.976732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2192-62be-432d-8a90-dcd9de22ab7a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:54.980062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2192-62be-432d-8a90-dcd9de22ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.014225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-87ff2192-62be-432d-8a90-dcd9de22ab7a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:55.015781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-87ff2192-62be-432d-8a90-dcd9de22ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:55.089296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ce810-ca98-42d4-89b4-c3c47892b054 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.095726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.096481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.096804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.097114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.097865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.100746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.103760 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3795/7504] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:55.118488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.119476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.120692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.134246 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3710/7505] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:54 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:55.137940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.139818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:55.150350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:55.153879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:55.155370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83aabf-c429-4f5e-8346-b77375ee6d9c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.161097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.161911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.162306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.162812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.164238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.166216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.167756 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3796/7506] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:55.171630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.181922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3711/7507] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:55.186212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.189524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9a3e8-47fa-4f20-88eb-c6974c2d9a76 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.198561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.199681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a605-0bd1-40e1-95dd-fdf4572d9e94 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.202327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.202993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.204386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.205557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.206767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:55.207175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.207523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.207652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.208172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] PATH_INFO: `/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305/users/669e5fc6e892458d8d3df1c0a4795da4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.212689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.229686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3c247e26fd4e559ee9416a6bfb0305, user_id=669e5fc6e892458d8d3df1c0a4795da4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.233512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.249181 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3797/7508] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:18:55.250913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.265028 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3712/7509] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:55 2022] PUT /identity/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305/users/669e5fc6e892458d8d3df1c0a4795da4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:55.270033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.274363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1143d6-dc99-4c4c-8004-c7d07481b69e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.383050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0658-4252-495c-8f1d-0e36eef786a5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.398602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.400803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.403129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.403419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.405561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.411433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.413063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.413924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.414509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.414983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.416384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.418514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.447380 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3713/7510] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:55.451102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.487648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8224e-a5d9-4e3d-be54-6ce0788d5a97 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.491093 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3798/7511] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/projects => generated 359 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:55.495771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.590732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.593018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.593321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.593730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] PATH_INFO: `/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305/users/669e5fc6e892458d8d3df1c0a4795da4/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.596490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3c247e26fd4e559ee9416a6bfb0305, user_id=669e5fc6e892458d8d3df1c0a4795da4, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.599458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173700e0-09a1-4724-819b-b9cf6955355f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.612029 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3714/7512] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:55 2022] PUT /identity/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305/users/669e5fc6e892458d8d3df1c0a4795da4/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:55.623421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.623806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.624156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.641333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9be1-1ab2-4a37-bcfb-01afb2480bec admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.688424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] MFA Rules not processed for user `669e5fc6e892458d8d3df1c0a4795da4`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:55.689724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:55.798798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.799498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.799786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.800071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.801138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.802732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.832630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3715/7513] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:18:55.840567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.852838 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3799/7514] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/users => generated 280 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:55.854753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.874815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c2c4f-4cf9-4f02-b807-c6463e873e1b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.877128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94f18-f107-42b1-b428-0e4fdfe67b8c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.892109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.892874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.893167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.893492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.894233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.894452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.896158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.897828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.900626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.901557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.902737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.904703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.917537 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3800/7515] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:55.920947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.934141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221c15-7235-48cb-951f-adb9528f0db8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:55.939685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:55.940425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:55.940739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:55.941023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:55.942073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:55.943742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:55.955391 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3716/7516] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/projects => generated 333 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:55.956076 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3801/7517] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:18:55.959936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.961750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:55.977199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6a727-7949-408b-90e7-defaa9175fd8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.109194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.112858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.113023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.113206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.116838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.119202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.134090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b452f6-488a-4564-9d81-bf2c1ebcdcdd tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.151029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.152388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.154525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.155158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] PATH_INFO: `/v3/projects/036dda3dcd1d44ffb73957da298e0302/users/ee4f3617c41643e1a4da8ceab6536b23/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.192251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=036dda3dcd1d44ffb73957da298e0302, user_id=ee4f3617c41643e1a4da8ceab6536b23, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.195561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41794e-b254-40a2-aed8-ada1e9d0d425 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.203154 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3802/7518] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:18:55 2022] POST /identity/v3/projects => generated 333 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:18:56.207081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:56.247862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3717/7519] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:18:55 2022] PUT /identity/v3/projects/036dda3dcd1d44ffb73957da298e0302/users/ee4f3617c41643e1a4da8ceab6536b23/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:56.258533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5260f-f4b8-40e3-976a-d60d6f7dad55 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.258892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5260f-f4b8-40e3-976a-d60d6f7dad55 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.259102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5260f-f4b8-40e3-976a-d60d6f7dad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.363941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bce5260f-f4b8-40e3-976a-d60d6f7dad55 None None] MFA Rules not processed for user `ee4f3617c41643e1a4da8ceab6536b23`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:56.365274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bce5260f-f4b8-40e3-976a-d60d6f7dad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:56.450825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf8ee-df43-4618-9fcc-b9b8e60f6508 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.600341 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3718/7520] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:56.615192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3d39-a650-459f-94b9-c0b736cf9e1a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.615564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3d39-a650-459f-94b9-c0b736cf9e1a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.615844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3d39-a650-459f-94b9-c0b736cf9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.645616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.646301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.646588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.646873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.647557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.649652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.660904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b12c3d39-a650-459f-94b9-c0b736cf9e1a None None] MFA Rules not processed for user `ee4f3617c41643e1a4da8ceab6536b23`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:56.665348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b12c3d39-a650-459f-94b9-c0b736cf9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:56.676835 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3719/7521] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:56 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:18:56.680044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.680350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.680642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.717493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] MFA Rules not processed for user `ee4f3617c41643e1a4da8ceab6536b23`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:56.719629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:56.745517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3720/7522] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:56 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 02 21:18:56.747045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:56.757208 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3803/7523] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:18:56 2022] POST /identity/v3/projects => generated 358 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:18:56.758895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:56.861281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e71f04-b878-4d3f-a9d4-95859823e55e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.868709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.869388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.870270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.870536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.886319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorizing `identity:check_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.889152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.899417 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3721/7524] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Apr 2 21:18:56 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Apr 02 21:18:56.900544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:56.915256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e98e-c8f1-4ecf-b703-3828b73abc0e tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.921480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.922222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.922513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.922834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.923907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.926305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.944058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541a6eb-bed3-4b2f-b76a-5b08aa965a99 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:56.948881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:56.949554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:56.949837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:56.950116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:56.964720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:56.966515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:56.980702 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3804/7525] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:18:56 2022] GET /identity/v3/projects => generated 6439 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:18:56.982150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:56.985996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3722/7526] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Apr 2 21:18:56 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:56.987246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.011653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9802c7-7b7f-4bf1-b432-dc0079b73f26 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.012849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf500c-fb29-4a81-9212-46f181083899 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.019360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.020291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.021135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.021650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.021807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.022649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.022783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:57.023171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.025659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.026789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.027399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.048884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.055379 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3805/7527] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:18:56 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:57.057220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.059839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.076253 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3723/7528] 10.222.0.18 () {56 vars in 1265 bytes} [Sat Apr 2 21:18:56 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:57.081423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.083399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc72ef-a9d0-4125-b2d0-e6ac8419851d tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.099591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.100981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.102614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.103285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.105403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Adding query filter params (parent_id=47e23d88ea544177b548d2dd95be1e7b) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:18:57.106401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.108040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d436b2b-d877-4830-9adb-23ee0b95ba39 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.110235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.123131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.124117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `HEAD` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.124672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.125199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.127663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.156936 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3806/7529] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Apr 2 21:18:57 2022] GET /identity/v3/projects?parent_id=47e23d88ea544177b548d2dd95be1e7b => generated 498 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:18:57.158297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.159586 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-11102015-17e4-4ca7-a22a-ca53cf2ee28e tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 02 21:18:57.163396 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3724/7530] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Apr 2 21:18:57 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Apr 02 21:18:57.169465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.170112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.170611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.184235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922161-bb90-43e6-8dce-af3b8a7fc6dc tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.190311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.191600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.192289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.192839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects/918cd5f1dcdf4e4f8ab9fc12956bb67e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.194426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:delete_project(project_id=918cd5f1dcdf4e4f8ab9fc12956bb67e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.196669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.207825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] MFA Rules not processed for user `ee4f3617c41643e1a4da8ceab6536b23`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:57.215067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.219474 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3725/7531] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:57 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 02 21:18:57.223440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.255492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c77bc1-51da-4f81-98b0-243f95f49e3b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.256182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918cd5f1dcdf4e4f8ab9fc12956bb67e', 'request_id': 'req-b859b8e5-a49a-472b-9005-99979d466ea0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.263935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918cd5f1dcdf4e4f8ab9fc12956bb67e', 'request_id': 'req-b859b8e5-a49a-472b-9005-99979d466ea0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.282004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918cd5f1dcdf4e4f8ab9fc12956bb67e', 'request_id': 'req-b859b8e5-a49a-472b-9005-99979d466ea0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.311238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] The token cache is being invalidate because project 918cd5f1dcdf4e4f8ab9fc12956bb67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:57.311730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.314380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.318556 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3807/7532] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:57 2022] DELETE /identity/v3/projects/918cd5f1dcdf4e4f8ab9fc12956bb67e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:57.323193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.328362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.379572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.381001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.381385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.381759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.384320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.402866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.405786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.418284 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3726/7533] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Apr 2 21:18:57 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:57.421898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.425855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.445762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f0d14-af6e-4028-bd7f-447ac19740ae tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.459916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.461079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.461488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.461795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.471291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.472814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.475960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b8e5-a49a-472b-9005-99979d466ea0 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.490923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.491988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.492357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.492691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects/47e23d88ea544177b548d2dd95be1e7b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.497389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47e23d88ea544177b548d2dd95be1e7b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.499507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.499987 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3727/7534] 10.222.0.18 () {56 vars in 1265 bytes} [Sat Apr 2 21:18:57 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:57.504309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.521534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a6ad-b94a-40b8-b796-ad1853b22f18 tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.539156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4f3617c41643e1a4da8ceab6536b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '036dda3dcd1d44ffb73957da298e0302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.539964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.542382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.542788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.548899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.572406 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 02 21:18:57.580820 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3728/7535] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Apr 2 21:18:57 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:18:57.588145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.594537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.628852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e23d88ea544177b548d2dd95be1e7b', 'request_id': 'req-586c90b3-0981-4570-9fc9-e0655c7f9a3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.645707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e23d88ea544177b548d2dd95be1e7b', 'request_id': 'req-586c90b3-0981-4570-9fc9-e0655c7f9a3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.688735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e23d88ea544177b548d2dd95be1e7b', 'request_id': 'req-586c90b3-0981-4570-9fc9-e0655c7f9a3f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.709887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] The token cache is being invalidate because project 47e23d88ea544177b548d2dd95be1e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:57.710248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.719114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.723656 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3808/7536] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:57 2022] DELETE /identity/v3/projects/47e23d88ea544177b548d2dd95be1e7b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:57.724741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:57.726189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:57.730674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ca661-437b-4f03-b28e-7abbfef35edf tempest-TokensV3Test-656404320 tempest-TokensV3Test-656404320-project] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.844959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.847902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.848395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.848882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] PATH_INFO: `/v3/users/ee4f3617c41643e1a4da8ceab6536b23` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.851018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4f3617c41643e1a4da8ceab6536b23)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.855923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.883681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c90b3-0981-4570-9fc9-e0655c7f9a3f tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:57.898764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669e5fc6e892458d8d3df1c0a4795da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e3c247e26fd4e559ee9416a6bfb0305', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:57.900348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:57.900348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:57.900651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] PATH_INFO: `/v3/projects/a2a59c0b56c24b35b53ab62be784013d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:57.904867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2a59c0b56c24b35b53ab62be784013d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:57.906908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:57.945808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4f3617c41643e1a4da8ceab6536b23'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.969528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4f3617c41643e1a4da8ceab6536b23'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.971762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4f3617c41643e1a4da8ceab6536b23'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:57.991677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4f3617c41643e1a4da8ceab6536b23'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.003822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6a2ef94-6ed8-440d-a73e-4288c92346b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4f3617c41643e1a4da8ceab6536b23'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.005448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a59c0b56c24b35b53ab62be784013d', 'request_id': 'req-fe48da1c-fdc2-439a-a844-47e47d6ad515'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.012080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a59c0b56c24b35b53ab62be784013d', 'request_id': 'req-fe48da1c-fdc2-439a-a844-47e47d6ad515'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.015905 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3729/7537] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:57 2022] DELETE /identity/v3/users/ee4f3617c41643e1a4da8ceab6536b23 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:58.018269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:58.018564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:58.018844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:58.032357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a59c0b56c24b35b53ab62be784013d', 'request_id': 'req-fe48da1c-fdc2-439a-a844-47e47d6ad515'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.049113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:58.050345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.053363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] The token cache is being invalidate because project a2a59c0b56c24b35b53ab62be784013d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:58.053661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.054361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.056290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3809/7538] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:57 2022] DELETE /identity/v3/projects/a2a59c0b56c24b35b53ab62be784013d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:58.060170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:58.063773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.187511 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3730/7539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:58.221398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48da1c-fdc2-439a-a844-47e47d6ad515 tempest-ListProjectsTestJSON-567624520 tempest-ListProjectsTestJSON-567624520-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:58.227036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:58.227958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:58.228247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:58.228565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] PATH_INFO: `/v3/users/3e425d5e05004a84b4a5c5ac64193bf8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:58.229932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e425d5e05004a84b4a5c5ac64193bf8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:58.231905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:58.245495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:58.247356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.314219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e425d5e05004a84b4a5c5ac64193bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.331502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e425d5e05004a84b4a5c5ac64193bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.333825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e425d5e05004a84b4a5c5ac64193bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.334893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e425d5e05004a84b4a5c5ac64193bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.358561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e4eaf6a9-dd6d-49da-aa0c-082a3b0e68d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e425d5e05004a84b4a5c5ac64193bf8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:58.393371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3128e-d626-4cd0-b070-26fd3f5460b5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:58.398668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:58.399442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:58.399834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:58.400423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:58.412164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.416875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3810/7540] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:18:58 2022] DELETE /identity/v3/users/3e425d5e05004a84b4a5c5ac64193bf8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:18:58.425308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9770-4d9f-41df-a520-7b77b52e31e0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:58.425606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9770-4d9f-41df-a520-7b77b52e31e0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:58.425898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9770-4d9f-41df-a520-7b77b52e31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:58.446975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:58.449850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:58.499762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3731/7541] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:58.500565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8cfb9770-4d9f-41df-a520-7b77b52e31e0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:58.504788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8cfb9770-4d9f-41df-a520-7b77b52e31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.631977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3811/7542] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:58.646691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:58.648220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:58.678956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8c11e-250e-428a-bb9c-b9bdc195e683 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:58.796521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:58.799425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:58.801499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:58.802010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:58.824024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:58.829403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:58.851044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3732/7543] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:18:59.083346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3cf3-cb13-44b9-9a98-2c4319b7059b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:59.083652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3cf3-cb13-44b9-9a98-2c4319b7059b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:59.083935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3cf3-cb13-44b9-9a98-2c4319b7059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:59.131435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a19e3cf3-cb13-44b9-9a98-2c4319b7059b None None] MFA Rules not processed for user `f21abe9d0e7647b08690bc957f3960b1`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:59.134314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a19e3cf3-cb13-44b9-9a98-2c4319b7059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:59.274870 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3812/7544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:59.283379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:59.284863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:59.493587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db19ca-10e1-4164-af1f-945e227f8b85 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:59.509558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:59.510580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:59.511660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:59.513222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:59.536281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:59.541192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:59.561528 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3733/7545] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:18:59.679099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780858a9-8298-468c-ad8d-1749884b2394 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:59.679928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780858a9-8298-468c-ad8d-1749884b2394 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:59.680375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780858a9-8298-468c-ad8d-1749884b2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:59.726567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-780858a9-8298-468c-ad8d-1749884b2394 None None] MFA Rules not processed for user `46d0c6b2806a46ce9621af36b828e17e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:59.729114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-780858a9-8298-468c-ad8d-1749884b2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:59.785614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:18:59.786981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:18:59.810342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0f0e0-90be-421b-af81-9b90fadf2a87 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:18:59.825389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:18:59.828793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:59.829309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:59.829752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] PATH_INFO: `/v3/projects/036dda3dcd1d44ffb73957da298e0302` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:59.833244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036dda3dcd1d44ffb73957da298e0302)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:18:59.839132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:18:59.870634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3813/7546] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:18:59.909417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036dda3dcd1d44ffb73957da298e0302', 'request_id': 'req-06c4513c-2574-4ce5-bb50-30bba17376d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:59.918942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036dda3dcd1d44ffb73957da298e0302', 'request_id': 'req-06c4513c-2574-4ce5-bb50-30bba17376d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:59.926786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036dda3dcd1d44ffb73957da298e0302', 'request_id': 'req-06c4513c-2574-4ce5-bb50-30bba17376d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:59.950580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] The token cache is being invalidate because project 036dda3dcd1d44ffb73957da298e0302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:18:59.950580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:59.951171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-06c4513c-2574-4ce5-bb50-30bba17376d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:18:59.953108 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3734/7547] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:18:59 2022] DELETE /identity/v3/projects/036dda3dcd1d44ffb73957da298e0302 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:18:59.959134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:18:59.959585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:18:59.959964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:18:59.996272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:18:59.997793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:00.112563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3814/7548] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:00.120806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.121974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.122319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.163376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:00.165149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:00.197586 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3735/7549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:00.202693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.238731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5522-86df-4752-9a37-27cf5e0b55c4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.247629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.249101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.250828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.251318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.253591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:00.254150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.258502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.279583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3815/7550] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:00.284036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.295414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a974e7-651c-42ce-9894-200fdc632aef None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.309203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.309895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.310175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.311109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.311246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.313270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.339817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.342089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:00.365634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34ec7-70e9-46f5-9bf5-ec618436301e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.374345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3736/7551] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:00.378526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.542773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.543681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.544162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.545851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] PATH_INFO: `/v3/projects/94b17ca773b54f418e6609cca4d3cd79` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.552168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b17ca773b54f418e6609cca4d3cd79)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.555078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.590785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24519b-38ee-43bf-8fc7-d04edb486798 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.610127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.610828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.611587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.611587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.612093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.614567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.653042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b17ca773b54f418e6609cca4d3cd79', 'request_id': 'req-90a1a816-a673-44a5-b1be-03453a4b074b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.661012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b17ca773b54f418e6609cca4d3cd79', 'request_id': 'req-90a1a816-a673-44a5-b1be-03453a4b074b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.670711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b17ca773b54f418e6609cca4d3cd79', 'request_id': 'req-90a1a816-a673-44a5-b1be-03453a4b074b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.684996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] The token cache is being invalidate because project 94b17ca773b54f418e6609cca4d3cd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:00.685827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.686493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.691809 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3816/7552] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:00 2022] DELETE /identity/v3/projects/94b17ca773b54f418e6609cca4d3cd79 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:00.692911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.697032 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3737/7553] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:00 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:00.697203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:00.698688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.702393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:00.741410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146451-da40-4546-ad6b-37b4eb0be9aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.770881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1a816-a673-44a5-b1be-03453a4b074b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:00.776140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.777148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.777729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.777982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] PATH_INFO: `/v3/users/669e5fc6e892458d8d3df1c0a4795da4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.779297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=669e5fc6e892458d8d3df1c0a4795da4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.781593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.876354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669e5fc6e892458d8d3df1c0a4795da4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.895608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669e5fc6e892458d8d3df1c0a4795da4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.896743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669e5fc6e892458d8d3df1c0a4795da4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.897551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669e5fc6e892458d8d3df1c0a4795da4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.900055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:00.904568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:00.905066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:00.905680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:00.909977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:00.914063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:00.919073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669e5fc6e892458d8d3df1c0a4795da4'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:00.950221 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3817/7554] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:00 2022] DELETE /identity/v3/users/669e5fc6e892458d8d3df1c0a4795da4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:00.957290 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3738/7555] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:00.958969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:00.962042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:01.091095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9638323-b672-41c9-bd1a-5aafba91d32b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:01.098023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:01.099066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:01.099559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:01.100839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:01.102789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:01.105509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8d0c1-a7b7-4acb-845e-4f5785f9c568 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:01.118669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3818/7556] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:01.125636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:01.154638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ddca2-95cd-4a99-84a9-3ae30b7e236b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:01.170601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:01.172817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:01.175545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:01.175545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] PATH_INFO: `/v3/projects/5f612ff93e474bef87157bc80c793c37/users/46c08f5bae2f4633abf64953e0f119b8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:01.276680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f612ff93e474bef87157bc80c793c37, user_id=46c08f5bae2f4633abf64953e0f119b8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:01.279485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:01.343486 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3739/7557] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:01 2022] PUT /identity/v3/projects/5f612ff93e474bef87157bc80c793c37/users/46c08f5bae2f4633abf64953e0f119b8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:01.354286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ce14-c26e-4778-8a81-5fcebe295116 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:01.355216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ce14-c26e-4778-8a81-5fcebe295116 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:01.355562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205ce14-c26e-4778-8a81-5fcebe295116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:01.452374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c205ce14-c26e-4778-8a81-5fcebe295116 None None] MFA Rules not processed for user `46c08f5bae2f4633abf64953e0f119b8`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:01.455613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c205ce14-c26e-4778-8a81-5fcebe295116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:01.585706 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3819/7558] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:01.607493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:01.610943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:01.729906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e165-e997-4b9b-a836-b25afc93957b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:01.756426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:01.758002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:01.775752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:01.776258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:01.831744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:01.843767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:01.896610 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3740/7559] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:02.116240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:02.117053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:02.117053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:02.158704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:02.161131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:02.309177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3820/7560] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:02.358030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:02.359681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:02.396576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:02.398054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:02.544213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4bba6-bec9-4732-ba84-173b49360158 service glance] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:02.553836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990b23-1829-41f6-8b88-c6e17d0a76b7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:02.560347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:02.561261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:02.561553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:02.561839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] PATH_INFO: `/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:02.562984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:02.563165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3c247e26fd4e559ee9416a6bfb0305)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:02.564112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:02.564633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:02.565059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:02.565291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:02.576543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:02.579257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c091e16-17db-4e83-9952-12f061903c6a service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:02.619083 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3821/7561] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:02.690728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3c247e26fd4e559ee9416a6bfb0305', 'request_id': 'req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:02.705616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3c247e26fd4e559ee9416a6bfb0305', 'request_id': 'req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:02.727731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3c247e26fd4e559ee9416a6bfb0305', 'request_id': 'req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:02.748999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] The token cache is being invalidate because project 8e3c247e26fd4e559ee9416a6bfb0305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:02.749740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:02.756960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca0eed6b-7da1-469a-87f2-8c2d1ed4c601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:02.759374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3741/7562] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:02 2022] DELETE /identity/v3/projects/8e3c247e26fd4e559ee9416a6bfb0305 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:02.764712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:02.765005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:02.765288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:02.814837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:02.819770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:03.033635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3822/7563] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:03.041400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346a5b-8fd8-417e-b1d0-c434500c69b9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.041689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346a5b-8fd8-417e-b1d0-c434500c69b9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.042188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4346a5b-8fd8-417e-b1d0-c434500c69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.071795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b4346a5b-8fd8-417e-b1d0-c434500c69b9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:03.075688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4346a5b-8fd8-417e-b1d0-c434500c69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:03.102466 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3742/7564] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:03.106587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.124953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.125256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.125540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.147039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb0f47-1bd7-4886-9f74-234cedf38b2b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.168243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.168974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.169272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.169557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.170295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:03.170608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:03.186229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:03.194827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:03.199698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:03.220339 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3823/7565] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:03.233582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.270521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0440-356e-4c90-81b1-099babea0a14 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.300846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.301532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.301825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.302106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.302809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:03.307658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:03.410115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3824/7566] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:03 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:03.413494 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3743/7567] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:03.415968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.436330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.441776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:03.665996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49fb7-2044-4508-96cc-3a6ee33ceeb4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.681567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.684249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.684753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.686246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.688301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:03.697255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:03.748303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385840-e481-4a62-a593-12cab444b8a4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.765974 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3825/7568] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:03 2022] POST /identity/v3/users => generated 284 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:03.767862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.795108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaf442-417a-45fb-ac6d-9a13e083484d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.815123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.816202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.816550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.817313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.818275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:03.821720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:03.852434 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3826/7569] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:03.858552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.880879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161242e-5d20-4174-8b91-d4c3421deb85 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.893790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.899298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.899601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.899892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.901226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:03.908190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:03.925554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.926529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.926977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.927424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:03.933254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3827/7570] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:03.939008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:03.963755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2a9df-5dbe-46b4-b643-088075bbe96e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:03.977341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:03.978258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:03.979995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:03.979995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] PATH_INFO: `/v3/projects/2cfeb4b5717e48718134f30462f2e05f/users/18fadc96c5234b32a7b81ace4d749a80/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.005453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.007369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145328ff-0bbe-4855-8401-dd6c084528d9 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:04.019691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfeb4b5717e48718134f30462f2e05f, user_id=18fadc96c5234b32a7b81ace4d749a80, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.021042 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3744/7571] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:04.028699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:04.056935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3828/7572] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:03 2022] PUT /identity/v3/projects/2cfeb4b5717e48718134f30462f2e05f/users/18fadc96c5234b32a7b81ace4d749a80/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:04.069267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092269-a609-4c55-91ca-e9ecb1d89ba0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.069972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092269-a609-4c55-91ca-e9ecb1d89ba0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.070441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13092269-a609-4c55-91ca-e9ecb1d89ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.133987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-13092269-a609-4c55-91ca-e9ecb1d89ba0 None None] MFA Rules not processed for user `18fadc96c5234b32a7b81ace4d749a80`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:04.136776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13092269-a609-4c55-91ca-e9ecb1d89ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:04.310491 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3745/7573] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:04.315301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:04.440426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0f7d-bedf-48ce-9711-308e0f175b5b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:04.456981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.457907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.458353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.474105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:04.477475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.477770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.478056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.479325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.483684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:04.499083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:04.500697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:04.559950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3829/7574] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:04 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:04.561332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:04.646314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3746/7575] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:04.660070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:04.719330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf486e5-6d8a-49e8-8226-f5c9462f2217 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:04.729740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:04.730723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.731181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.731656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.732699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.735691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:04.784703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3830/7576] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:04 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:04.789378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:04.789703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2fe0-a6ea-4ef4-85ed-a0d13f79499f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:04.813585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413473-c9cc-4dbf-a6eb-4a0f2de44483 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:04.821343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:04.822208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.824392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.824821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.825795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.835750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:04.849640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3831/7577] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:04.857344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:04.916939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdd24c-f598-4051-9995-b658f16db3d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:04.928535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:04.929579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.930069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.930515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.934431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:04.935507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:04.935905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:04.937855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] PATH_INFO: `/v3/projects/203f7fa57f68484693988b77ed796b5c/users/52c829ad47d2459fb9dd80cf801db357/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:04.978144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=203f7fa57f68484693988b77ed796b5c, user_id=52c829ad47d2459fb9dd80cf801db357, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:04.985387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.009124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3832/7578] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:04 2022] PUT /identity/v3/projects/203f7fa57f68484693988b77ed796b5c/users/52c829ad47d2459fb9dd80cf801db357/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:05.016656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.113430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.117284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.166779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3747/7579] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:05.211078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cead5-5f6f-41f9-ac5e-1c264921c82c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:05.217551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:05.220755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.221170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.221545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.223780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.234599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d6a17-5686-43dd-8fe1-335da82e46c2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.247985 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3833/7580] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:05.252716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.304219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc310c6-561e-4446-8fdd-a2d93135a795 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:05.320846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:05.321772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.322088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.322934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] PATH_INFO: `/v3/projects/203f7fa57f68484693988b77ed796b5c/users/52c829ad47d2459fb9dd80cf801db357/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.335143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203f7fa57f68484693988b77ed796b5c, user_id=52c829ad47d2459fb9dd80cf801db357, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.338216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.374495 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3748/7581] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:05 2022] PUT /identity/v3/projects/203f7fa57f68484693988b77ed796b5c/users/52c829ad47d2459fb9dd80cf801db357/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:05.471731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4bdf-79a1-4696-8485-433b6827b767 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.472820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4bdf-79a1-4696-8485-433b6827b767 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.473372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff4bdf-79a1-4696-8485-433b6827b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.516536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fdff4bdf-79a1-4696-8485-433b6827b767 None None] MFA Rules not processed for user `52c829ad47d2459fb9dd80cf801db357`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:05.518292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fdff4bdf-79a1-4696-8485-433b6827b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:05.642547 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3834/7582] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:05.643214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.656792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.657149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.658408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.659463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e598c-3967-4a92-85d8-cd1548283834 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:05.665321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:05.667185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.667644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.668088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.669096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.671063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.696572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3749/7583] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Apr 2 21:19:05 2022] POST /identity/v3/services => generated 241 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:05.700326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.704334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:05.705596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:05.732295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671eef-9c24-4ef1-8e1c-2986d4712a85 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:05.740580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:05.741654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.741941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.742304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/7e53eb3a553b473fa7f39e8f963a0c57` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.742972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e53eb3a553b473fa7f39e8f963a0c57)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.745645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.775074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3750/7584] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:05 2022] DELETE /identity/v3/services/7e53eb3a553b473fa7f39e8f963a0c57 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:05.779748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.849914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92195db8-d75e-44b1-94b3-651e758a4dc8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:05.852790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3835/7585] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:05.876561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.887811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:05.888551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:05.889033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:05.889501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:05.891428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:05.894310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:05.931499 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3751/7586] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:05 2022] POST /identity/v3/services => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:05.933281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:05.997256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846caa4-d1c0-471c-87ae-8be920cbc151 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.011669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.013073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.013534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.015197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/11a5e21bcbdb4d2099631cf171b24428` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.015197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:update_service(service_id=11a5e21bcbdb4d2099631cf171b24428)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.017460 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:06.017460 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:19:06.017460 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:19:06.019942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a27548-5970-41f9-ba65-2497eeb943be tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.055859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5568-1654-4005-8a0c-8bd01d6899c3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.064812 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3752/7587] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Apr 2 21:19:05 2022] PATCH /identity/v3/services/11a5e21bcbdb4d2099631cf171b24428 => generated 283 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:06.066265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.066562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.066848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.082229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.083379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.083864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.084363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.096542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.099430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.116196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3836/7588] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:06.120151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.122978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] MFA Rules not processed for user `ece3f0bfe8294cdba77f8fe0e429f06d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:06.124221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:06.149014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82421d34-7368-4b03-9884-64191f7d3570 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.155621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.157113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.158164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.158408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/11a5e21bcbdb4d2099631cf171b24428` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.159314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:get_service(service_id=11a5e21bcbdb4d2099631cf171b24428)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.161234 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:06.161234 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:19:06.161234 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:19:06.162932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.172025 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3837/7589] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:19:06 2022] GET /identity/v3/services/11a5e21bcbdb4d2099631cf171b24428 => generated 283 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:06.177738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.202278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c01ad-4716-48e6-a37d-ff01348046a5 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.223798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.228709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.229240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.230820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/11a5e21bcbdb4d2099631cf171b24428` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.231990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:delete_service(service_id=11a5e21bcbdb4d2099631cf171b24428)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.236245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.318246 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3838/7590] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:06 2022] DELETE /identity/v3/services/11a5e21bcbdb4d2099631cf171b24428 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:06.324927 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3753/7591] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:06.325922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.326109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.328053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:06.373637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e20c5-5752-4a45-82cc-dd63b8647747 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.379136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.380056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.380482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.380801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/11a5e21bcbdb4d2099631cf171b24428` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.381463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:get_service(service_id=11a5e21bcbdb4d2099631cf171b24428)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.384042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.408534 ncdv-master-1 devstack@keystone.service[97317]: WARNING keystone.server.flask.application [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Could not find service: 11a5e21bcbdb4d2099631cf171b24428.: keystone.exception.ServiceNotFound: Could not find service: 11a5e21bcbdb4d2099631cf171b24428. Apr 02 21:19:06.410917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3839/7592] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 21:19:06 2022] GET /identity/v3/services/11a5e21bcbdb4d2099631cf171b24428 => generated 113 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:19:06.419364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.442531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa68f-b6d9-49b0-9f1d-e77281695093 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.468484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.469336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.470367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.470867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.472308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.474320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.522995 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3840/7593] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/services => generated 273 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:06.525058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.527791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b1ff-4659-45ba-bd21-b8c375477d78 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.570247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b078-7220-496b-8b98-22da6bdd15e8 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.576888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.578209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.578209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.578450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.579433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.584563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.597219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.598034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.598509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.598793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.600389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.602644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715fd2a-58f0-4acc-8505-1d36fe9f8288 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.611878 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3841/7594] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/services => generated 274 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:06.616896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.650780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3754/7595] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:06.653369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.653892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.654334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.662373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830748a-190b-4ea2-ac28-9bbb88cfa860 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.678907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:06.680898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:06.747717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.749098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.749581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.750750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.752501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.755198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.784585 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3842/7596] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/services => generated 274 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:06.785841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.823306 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3755/7597] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/auth/tokens => generated 3685 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:06.824621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.858239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc397a26-f634-4577-a564-0a43ef299f97 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.864088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.865817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.866506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.866979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.867886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.869165 ncdv-master-1 devstack@keystone.service[97316]: WARNING py.warnings [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:06.869165 ncdv-master-1 devstack@keystone.service[97316]: warnings.warn(msg) Apr 02 21:19:06.869165 ncdv-master-1 devstack@keystone.service[97316]: Apr 02 21:19:06.870418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.879377 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3756/7598] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Apr 2 21:19:06 2022] GET /identity/v3/services => generated 2976 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:06.880576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:06.914240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107d1f-86d8-4377-ab5e-45c84574e002 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:06.920737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:06.921553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:06.921875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:06.922215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:06.923173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:06.925300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:06.980845 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3843/7599] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:06 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:06.984330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.010641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff020b6f-075e-4226-88b8-b49f98b74d55 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.024683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.026233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.027059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.027577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.030151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-819746083) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:07.030666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.031911 ncdv-master-1 devstack@keystone.service[97317]: WARNING py.warnings [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:07.031911 ncdv-master-1 devstack@keystone.service[97317]: warnings.warn(msg) Apr 02 21:19:07.031911 ncdv-master-1 devstack@keystone.service[97317]: Apr 02 21:19:07.039133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.053949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3844/7600] 10.222.0.18 () {58 vars in 1219 bytes} [Sat Apr 2 21:19:06 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-819746083 => generated 415 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:07.055437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.085999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21977-5d8f-4b55-b8d6-d1167b8da32f tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.086990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcebd0-10e5-4d2d-b476-8d961d28c865 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.095869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.096916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.098159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.098646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.099575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.101969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.105384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.106905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.110311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.110311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.145337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.147801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.155029 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3845/7601] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:07.156427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.174573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd81fb-5afb-4ccc-a741-1021cf3115bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.175541 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3757/7602] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:07.176488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.196431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.197811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.200206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.200526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.202384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-612959653) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:07.202702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.207446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.207928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6f9b-6e16-4616-80a4-651a128f6748 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.220080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.225330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.225631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.226087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] PATH_INFO: `/v3/projects/13d8cf54919443c4b6a9643a9a5cde04/users/6115d2391b38410da48cf3df74776b6b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.226223 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3846/7603] 10.222.0.18 () {58 vars in 1219 bytes} [Sat Apr 2 21:19:07 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-612959653 => generated 416 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:07.227110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.253775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f443eb-52c8-4c64-9dba-a9de25286956 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.268946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d8cf54919443c4b6a9643a9a5cde04, user_id=6115d2391b38410da48cf3df74776b6b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.273498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.274214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.274654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.275099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.275387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.276779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-341621987) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:07.277095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.278703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.293948 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3847/7604] 10.222.0.18 () {58 vars in 1219 bytes} [Sat Apr 2 21:19:07 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-341621987 => generated 416 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:07.295554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.305516 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3758/7605] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:07 2022] PUT /identity/v3/projects/13d8cf54919443c4b6a9643a9a5cde04/users/6115d2391b38410da48cf3df74776b6b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:07.309872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.335887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8afd0-d509-41ec-b07e-f7a8f8478b25 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.450504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0673cbd-667b-48b4-8c9b-fff92586bf5b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.465052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.465806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.466097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.466377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.467114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.473108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.502730 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3759/7606] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:07.508046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.526703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b076c4-12d8-4e95-87df-4128e071cb77 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.534403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.535579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.536020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.536528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/b55b3d2072da44fd9dbb904c722e35ef` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.537579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b55b3d2072da44fd9dbb904c722e35ef)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.538935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.539766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1521602-4519-4c7c-9486-45f2c0379886 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.542485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.543759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.544222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] PATH_INFO: `/v3/projects/13d8cf54919443c4b6a9643a9a5cde04/users/6115d2391b38410da48cf3df74776b6b/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.556344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d8cf54919443c4b6a9643a9a5cde04, user_id=6115d2391b38410da48cf3df74776b6b, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.565134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.596885 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3760/7607] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:07 2022] PUT /identity/v3/projects/13d8cf54919443c4b6a9643a9a5cde04/users/6115d2391b38410da48cf3df74776b6b/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:07.622581 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3848/7608] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:07 2022] DELETE /identity/v3/services/b55b3d2072da44fd9dbb904c722e35ef => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:07.627334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.657536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.658114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.658516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.723645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:07.731052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:07.833392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d68cb-e85b-4dd4-81d8-e8ac524f8ce5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.870978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.871947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.872515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.873028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/1e532f6f7c6a451ca0dd67df7b5b44c3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.873853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1e532f6f7c6a451ca0dd67df7b5b44c3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.875678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.880140 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3849/7609] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3518 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:07.895808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.926638 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3761/7610] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:07 2022] DELETE /identity/v3/services/1e532f6f7c6a451ca0dd67df7b5b44c3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:07.930444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:07.971470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5073534-96fb-4f72-b835-9a09408b6dbe tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:07.985552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52c829ad47d2459fb9dd80cf801db357', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '203f7fa57f68484693988b77ed796b5c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:07.986435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:07.986725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:07.987007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] PATH_INFO: `/v3/services/6177489d37cd4b8caed0ec84e2555416` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:07.987668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6177489d37cd4b8caed0ec84e2555416)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:07.993745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:07.998993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84951381-c8a8-4140-a984-3803fe486c84 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:08.019029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:08.019831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:08.020289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:08.020652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:08.036653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:08.038646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e96c7-7f51-47ab-ac87-3e921e17ce46 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:08.044221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3762/7611] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:07 2022] DELETE /identity/v3/services/6177489d37cd4b8caed0ec84e2555416 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:08.049893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:08.058276 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3850/7612] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:19:08.320589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2e4e-e0fc-4406-ae82-d3e869968052 tempest-ServicesTestJSON-102328417 tempest-ServicesTestJSON-102328417-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:08.337368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:08.338254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:08.338541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:08.338819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] PATH_INFO: `/v3/users/18fadc96c5234b32a7b81ace4d749a80` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:08.342629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fadc96c5234b32a7b81ace4d749a80)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:08.346819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:08.483374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fadc96c5234b32a7b81ace4d749a80'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:08.530139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fadc96c5234b32a7b81ace4d749a80'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:08.530961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fadc96c5234b32a7b81ace4d749a80'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:08.558840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fadc96c5234b32a7b81ace4d749a80'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:08.596722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fadc96c5234b32a7b81ace4d749a80'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:08.630472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3763/7613] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:08 2022] DELETE /identity/v3/users/18fadc96c5234b32a7b81ace4d749a80 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:08.635663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaa26-0b01-40d2-81b1-5fbf7ac0b0e9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:08.636398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaa26-0b01-40d2-81b1-5fbf7ac0b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:08.636398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaa26-0b01-40d2-81b1-5fbf7ac0b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:08.677687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e8aaaa26-0b01-40d2-81b1-5fbf7ac0b0e9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:08.679245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8aaaa26-0b01-40d2-81b1-5fbf7ac0b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:08.882296 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3851/7614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:08.891999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:08.895380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:09.095859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dcc62-2082-4a4d-bb54-fe915263184e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:09.101338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:09.103025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:09.104185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:09.104722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:09.127196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:09.128950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:09.175763 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3764/7615] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:09.788590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:09.789095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:09.789239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:09.844975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:09.846693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:10.013119 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3852/7616] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:10.023200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:10.027495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:10.032749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:10.036069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:10.085933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7763-2f32-4945-b207-f4ea5d3e1e51 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:10.099473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:10.102262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:10.103221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:10.107466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] PATH_INFO: `/v3/projects/2cfeb4b5717e48718134f30462f2e05f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:10.109699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfeb4b5717e48718134f30462f2e05f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:10.115710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:10.280566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9f223-99b7-4d2c-9cdd-8262388450bd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:10.311539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfeb4b5717e48718134f30462f2e05f', 'request_id': 'req-80a471fb-dd39-4a1c-af54-282f687bc097'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.318400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfeb4b5717e48718134f30462f2e05f', 'request_id': 'req-80a471fb-dd39-4a1c-af54-282f687bc097'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.332923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfeb4b5717e48718134f30462f2e05f', 'request_id': 'req-80a471fb-dd39-4a1c-af54-282f687bc097'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.352236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] The token cache is being invalidate because project 2cfeb4b5717e48718134f30462f2e05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:10.352948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.354447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.363295 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3853/7617] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:10 2022] DELETE /identity/v3/projects/2cfeb4b5717e48718134f30462f2e05f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:10.365135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:10.367090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:10.429516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:10.434599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:10.435650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:10.436221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:10.444894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:10.532578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a471fb-dd39-4a1c-af54-282f687bc097 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:10.540312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:10.551758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:10.552310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:10.552782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] PATH_INFO: `/v3/users/52c829ad47d2459fb9dd80cf801db357` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:10.554349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c829ad47d2459fb9dd80cf801db357)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:10.563970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:10.564417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:10.566078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b477a-b5cd-489d-9f37-ed3df319d8c5 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:10.585684 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3765/7618] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:10.658600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c829ad47d2459fb9dd80cf801db357'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.694982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c829ad47d2459fb9dd80cf801db357'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.695873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c829ad47d2459fb9dd80cf801db357'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.697363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c829ad47d2459fb9dd80cf801db357'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.716071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c829ad47d2459fb9dd80cf801db357'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:10.743396 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3854/7619] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:10 2022] DELETE /identity/v3/users/52c829ad47d2459fb9dd80cf801db357 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:10.844635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39252-b2c5-437e-a0cc-9e96a0b1a947 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:10.845258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39252-b2c5-437e-a0cc-9e96a0b1a947 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:10.845258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39252-b2c5-437e-a0cc-9e96a0b1a947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:10.894507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a7e39252-b2c5-437e-a0cc-9e96a0b1a947 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:10.895771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a7e39252-b2c5-437e-a0cc-9e96a0b1a947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:11.015339 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3766/7620] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:11.029892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:11.031403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:11.199587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327f34-8e85-44ee-baee-df0e4eb40432 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:11.208294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:11.209358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:11.209835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:11.210452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:11.220131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:11.221950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:11.235877 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3855/7621] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:19:11.473144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:11.475403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:11.475953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:11.518225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:11.519781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:11.537923 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3767/7622] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:11.558852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:11.581750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da536cd-0b5e-4b93-9c3c-6c78e439f986 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:11.602784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:11.603726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:11.604308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:11.604637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:11.650898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:11.652878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe407d9-7ebc-437c-9ef3-0506ea1c9029 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:11.681420 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3856/7623] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:11.877441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:11.879387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.027044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.027342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.028353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.040394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2925d11-7f9e-4b79-9394-ebeb764fa2e4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:12.047990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:12.049212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.049886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.050369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] PATH_INFO: `/v3/projects/203f7fa57f68484693988b77ed796b5c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.051892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203f7fa57f68484693988b77ed796b5c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:12.054098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:12.065694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:12.067523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.084271 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3857/7624] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:12.100866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:12.128135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098495f3-418f-45ea-a40c-a23b8c63a95d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:12.153696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203f7fa57f68484693988b77ed796b5c', 'request_id': 'req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:12.175511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203f7fa57f68484693988b77ed796b5c', 'request_id': 'req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:12.191722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203f7fa57f68484693988b77ed796b5c', 'request_id': 'req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:12.213661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] The token cache is being invalidate because project 203f7fa57f68484693988b77ed796b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:12.214338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:12.215685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bbe4c6ca-2aba-41bd-9ca7-0fddbcd52646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:12.225833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3768/7625] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:11 2022] DELETE /identity/v3/projects/203f7fa57f68484693988b77ed796b5c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:12.227473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.227777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.228062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.252034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:12.252759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.253244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.253525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.265627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.267166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:12.269043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.388639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:12.390268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ded9d0-f639-4656-8849-951a4a27a3b9 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:12.415800 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3858/7626] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:12.426612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3769/7627] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:12.434306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.434848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.435328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.488403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:12.490019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.528290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3859/7628] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:12.533233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:12.557132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c223a9d-6c66-4418-ae5b-489ca6a98af1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:12.569299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:12.574298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.574970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.575418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.578028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:12.578582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:12.582880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf919-9a55-4d8d-95b3-c9db60003e35 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:12.617335 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3770/7629] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:12.618322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:12.647643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c79db-0745-476c-9b5c-984cade483c6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:12.682626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:12.683441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.684724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.685116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.692590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:12.695876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:12.724761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.725157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.725533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.766434 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3860/7630] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:12.767976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:12.769538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:12.772422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.919487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62f70-f719-4dcb-8a22-273345625e20 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:12.932259 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3771/7631] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:12.935349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:12.936438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:12.936924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:12.937403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:12.938539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:12.940739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:12.943385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:12.944892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:12.989469 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3861/7632] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:12 2022] POST /identity/v3/users => generated 306 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:12.995469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.025413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f355a1-47da-44a6-aa6b-b7cecc307dba admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:13.040494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421cf6-3394-4313-85db-14042402421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:13.042238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421cf6-3394-4313-85db-14042402421e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.042538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421cf6-3394-4313-85db-14042402421e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.042823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04421cf6-3394-4313-85db-14042402421e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.048251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04421cf6-3394-4313-85db-14042402421e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:13.050170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04421cf6-3394-4313-85db-14042402421e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:13.084757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3862/7633] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:13.105810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421cf6-3394-4313-85db-14042402421e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.127055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04421cf6-3394-4313-85db-14042402421e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:13.142036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:13.145143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.145468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.145769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] PATH_INFO: `/v3/projects/4a5d94f887b84fdbac980a698d19c1bd/users/043f4ae03d4e4c9eb4fed84fc0de66ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.180858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1659bc-00a1-4476-97de-35a2821a2167 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:13.190545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5d94f887b84fdbac980a698d19c1bd, user_id=043f4ae03d4e4c9eb4fed84fc0de66ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:13.199079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:13.209207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:13.209941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.210271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.210511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.229782 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3863/7634] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:13 2022] PUT /identity/v3/projects/4a5d94f887b84fdbac980a698d19c1bd/users/043f4ae03d4e4c9eb4fed84fc0de66ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:13.231324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:13.235351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.235694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:13.257214 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3772/7635] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:13.506873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640105aa-0e53-4732-bdbc-bd780f16b9e0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:13.524446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:13.525703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.526258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.526803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.528067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:13.530326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76eba4-95d7-48ac-bef6-06c6411f862e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:13.550335 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3864/7636] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:13.554627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.563116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.566626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.567663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.575927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d966ea-5363-455a-921c-1b0d7ca92d8e service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:13.596727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:13.598704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.599000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.603393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] PATH_INFO: `/v3/projects/4a5d94f887b84fdbac980a698d19c1bd/users/043f4ae03d4e4c9eb4fed84fc0de66ac/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.608220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5d94f887b84fdbac980a698d19c1bd, user_id=043f4ae03d4e4c9eb4fed84fc0de66ac, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:13.611631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473699a4-09d5-4530-9b6f-677bdb78c84c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:13.619413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:13.629589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:13.629972 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3773/7637] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:13 2022] PUT /identity/v3/projects/4a5d94f887b84fdbac980a698d19c1bd/users/043f4ae03d4e4c9eb4fed84fc0de66ac/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:13.642720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:13.643885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:13.644592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:13.685771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] MFA Rules not processed for user `043f4ae03d4e4c9eb4fed84fc0de66ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:13.690378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:13.808837 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3865/7638] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:13.824344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.884252 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3774/7639] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:13.885760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:13.996714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9c9e-3734-4d4d-82cb-fd5a4bd11c4d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.002045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.002726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.003277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.003708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.015167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.015806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.035611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3866/7640] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:19:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 02 21:19:14.041457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443a72a-8235-452e-92ad-1df604a5fbaf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.048153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.048938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.049306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.049658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.050538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.053210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.093311 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3775/7641] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:13 2022] POST /identity/v3/projects => generated 395 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:14.097039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.134043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfef4b-7a9b-4061-a67e-bed313284feb service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.235207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.237207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:14.280587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.281280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.281562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.281839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.282532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.284501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.331446 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3867/7642] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:14 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:14.336148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.358405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb7e0-c365-4e7d-af03-a0cb4fce9e68 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.372639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.373911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.374215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.375844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.377302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.378935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.383412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b96c8e-94e0-4083-8eea-b0cc54708be7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.397547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.398448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.398726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.399000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] PATH_INFO: `/v3/users/46c08f5bae2f4633abf64953e0f119b8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.401264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c08f5bae2f4633abf64953e0f119b8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.406335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.408669 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3868/7643] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:14.410473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.435624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc320-b19f-419d-b60f-40024c677a0b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.450719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.451413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.451696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.451970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.452720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.454795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.490778 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3869/7644] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:14.495001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.506430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c08f5bae2f4633abf64953e0f119b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:14.517418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc655d-3931-45bc-b35b-51837ea9b6c1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:14.530386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:14.531300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.531580 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.532644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c08f5bae2f4633abf64953e0f119b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:14.533134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] PATH_INFO: `/v3/projects/23e650135a134e8497fdd54df93de424/users/ef2e52d2dbd14e91868fbf4591a0ef27/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.534578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c08f5bae2f4633abf64953e0f119b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:14.550174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c08f5bae2f4633abf64953e0f119b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:14.561687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d5bfa0b3-880c-4167-83fe-35fb79fc99ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c08f5bae2f4633abf64953e0f119b8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:14.569867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e650135a134e8497fdd54df93de424, user_id=ef2e52d2dbd14e91868fbf4591a0ef27, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:14.576255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750b57f-7d41-4b21-85b3-01b42979f64c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:14.577887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3776/7645] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:14 2022] DELETE /identity/v3/users/46c08f5bae2f4633abf64953e0f119b8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:14.582235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.582752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.583216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.612680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3870/7646] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:14 2022] PUT /identity/v3/projects/23e650135a134e8497fdd54df93de424/users/ef2e52d2dbd14e91868fbf4591a0ef27/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:14.625063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:14.625213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:14.626667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:14.647666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:14.652091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:14.696654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] MFA Rules not processed for user `ef2e52d2dbd14e91868fbf4591a0ef27`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:14.700712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:14.822424 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3777/7647] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:14.838390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.839930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:14.901855 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3871/7648] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:14.910353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:14.913123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:15.002052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2999b5-9c14-45c3-8b40-5ce513a71e78 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:15.006589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023f6d5-e6f7-4e17-be02-4a58edab0782 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:15.007715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:15.008432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:15.008751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:15.009030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:15.010879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:15.028565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:15.029408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:15.029802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:15.030191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:15.052889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:15.052889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:15.082705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3778/7649] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:15.168704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:15.171408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa678-9031-4bed-8ea8-2ec379a27115 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:15.214378 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3872/7650] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:15.819200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:15.824383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:15.852048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bd72a-5ca3-477a-9f6b-2154c6981f74 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:15.866150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:15.867819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:15.872385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:15.873448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] PATH_INFO: `/v3/users/043f4ae03d4e4c9eb4fed84fc0de66ac` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:15.875058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] RBAC: Authorizing `identity:delete_user(user_id=043f4ae03d4e4c9eb4fed84fc0de66ac)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:15.877574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:15.996736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043f4ae03d4e4c9eb4fed84fc0de66ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.020850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043f4ae03d4e4c9eb4fed84fc0de66ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.022275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043f4ae03d4e4c9eb4fed84fc0de66ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.036100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043f4ae03d4e4c9eb4fed84fc0de66ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.047849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043f4ae03d4e4c9eb4fed84fc0de66ac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.061217 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3779/7651] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:15 2022] DELETE /identity/v3/users/043f4ae03d4e4c9eb4fed84fc0de66ac => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:16.065484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.065770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.066053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.090569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:16.093188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:16.181080 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3873/7652] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:16.200510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:16.202259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:16.250884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:16.253017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:16.273132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699bcd2-ff99-4ad6-92fa-cabbd2394900 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:16.287183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:16.288794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.289379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.290043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] PATH_INFO: `/v3/projects/5f612ff93e474bef87157bc80c793c37` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.294452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f612ff93e474bef87157bc80c793c37)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:16.298678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:16.312961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ad6ca-7e86-4488-acfe-8ffaffc9721d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:16.317383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:16.318171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.318559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.318935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.331624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:16.334304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024d896-dd9c-42b2-a7cc-3a647fc5f1e9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:16.357876 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3780/7653] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:16.391791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f612ff93e474bef87157bc80c793c37', 'request_id': 'req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.403654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f612ff93e474bef87157bc80c793c37', 'request_id': 'req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.415176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f612ff93e474bef87157bc80c793c37', 'request_id': 'req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.477964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] The token cache is being invalidate because project 5f612ff93e474bef87157bc80c793c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:16.479186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.482207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ca6f5df1-cc3c-4898-9f4b-4f72ab5cec61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:16.489243 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3874/7654] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:16 2022] DELETE /identity/v3/projects/5f612ff93e474bef87157bc80c793c37 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:16.490490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.490852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.491201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.526292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:16.527975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:16.725430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.725898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.726399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.730740 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3781/7655] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:16.768375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:16.772191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:16.799672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3875/7656] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:16.807317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:16.825690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f750a5-5d69-43d0-997b-2a2dcb5b5407 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:16.843805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:16.845066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.845599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.846223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.847758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:16.848548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:16.855607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:16.918012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:16.932582 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3782/7657] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:16.935855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03fd30-7ff8-4b14-9dbf-9ccdd98ff7cf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:16.948813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:16.950264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:16.951488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:16.952012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:16.954100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:16.956857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:16.998570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.006406 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3876/7658] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:16 2022] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:17.011688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0c64-f08b-43f5-b4f0-68e8692d36ab admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.166440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.167748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.168236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.168997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.170980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.173861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.210205 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3783/7659] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:16 2022] POST /identity/v3/users => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:17.215175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.229875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ca91-8d76-4038-b17f-02da2085e8f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.244083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.244844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.245180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.246430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.247317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.249452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.264940 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3877/7660] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:17.266047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.277718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313f71-77b3-4653-bc75-1e3afb5c442c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.283454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.284534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.285043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.285646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.286735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.289313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cc42-53ec-4656-8c9c-407aea13fccb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.320061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.333146 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3784/7661] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:17.334076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13559dba-5681-4cc2-8bd0-69d3d0c15093 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.341700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.342955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.343711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.344201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] PATH_INFO: `/v3/projects/fa3d6858e8c34b5ea53c2243bb16c3f2/users/5a861fd9f4ea4e2d8a16589a8cc96f15/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.376255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3d6858e8c34b5ea53c2243bb16c3f2, user_id=5a861fd9f4ea4e2d8a16589a8cc96f15, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.381593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.423321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.423712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.424005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.426387 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3878/7662] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:17 2022] PUT /identity/v3/projects/fa3d6858e8c34b5ea53c2243bb16c3f2/users/5a861fd9f4ea4e2d8a16589a8cc96f15/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:17.472391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] MFA Rules not processed for user `5a861fd9f4ea4e2d8a16589a8cc96f15`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:17.473663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:17.570987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.575333 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3785/7663] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:17.670379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c0dd-fbe2-443b-9931-e6ec4bbc4587 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.685475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.686986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.687279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.687704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.688313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.690347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.750991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.752441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:17.753147 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3879/7664] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:17 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:17.756830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.778660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85331677-5fdd-4896-9839-18d8639fa69e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.875362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02527-4f04-471d-a71f-7fe26d3cad97 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.885666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.887305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.887985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.888380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.889218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.891481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.908507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.909461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.909741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.909930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] PATH_INFO: `/v3/projects/4a5d94f887b84fdbac980a698d19c1bd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.913287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5d94f887b84fdbac980a698d19c1bd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.915043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.924220 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3880/7665] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:17 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:17.928835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:17.944172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bd21-55bb-40a6-bc38-00f3cfe80037 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:17.953602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:17.954432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:17.954836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:17.955234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:17.957387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:17.959792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:17.982960 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3881/7666] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:17.990330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:18.017573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95c712-d2a5-43fd-8fd7-f43cdbdfe8ef admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:18.021429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5d94f887b84fdbac980a698d19c1bd', 'request_id': 'req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.048263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5d94f887b84fdbac980a698d19c1bd', 'request_id': 'req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.073494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5d94f887b84fdbac980a698d19c1bd', 'request_id': 'req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.097696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] The token cache is being invalidate because project 4a5d94f887b84fdbac980a698d19c1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:18.098047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.098723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.103905 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3786/7667] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:17 2022] DELETE /identity/v3/projects/4a5d94f887b84fdbac980a698d19c1bd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:18.106250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:18.107616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:18.173390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:18.174311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:18.174619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:18.175102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] PATH_INFO: `/v3/projects/c5d4708b7bf544d286f54893273c6c55/users/d636fc91c4c042139001e5accba7fff7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:18.214857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d4708b7bf544d286f54893273c6c55, user_id=d636fc91c4c042139001e5accba7fff7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:18.218634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:18.269576 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3882/7668] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:17 2022] PUT /identity/v3/projects/c5d4708b7bf544d286f54893273c6c55/users/d636fc91c4c042139001e5accba7fff7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:18.270597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:18.275812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:18.281784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea916-50d0-45c5-9cb9-3f95c26b05c3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:18.436732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e63146-7479-45d1-8e8c-640757fe721a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:18.440334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:18.442336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:18.442494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:18.442696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:18.442986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] PATH_INFO: `/v3/users/ef2e52d2dbd14e91868fbf4591a0ef27` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:18.443557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:18.443948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:18.444335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:18.445308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:18.449314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:18.469818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3883/7669] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:18.473769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:18.476821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2e52d2dbd14e91868fbf4591a0ef27)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:18.493340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:18.509724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc34c61-bfce-411b-9a23-3982024bd424 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:18.529279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:18.530695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:18.531809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:18.532197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] PATH_INFO: `/v3/projects/c5d4708b7bf544d286f54893273c6c55/users/d636fc91c4c042139001e5accba7fff7/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:18.539530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d4708b7bf544d286f54893273c6c55, user_id=d636fc91c4c042139001e5accba7fff7, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:18.543183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c482-2e30-4761-aaaa-bf92888976bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:18.565473 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3884/7670] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:18 2022] PUT /identity/v3/projects/c5d4708b7bf544d286f54893273c6c55/users/d636fc91c4c042139001e5accba7fff7/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:18.578227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:18.578756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:18.583835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:18.650934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] MFA Rules not processed for user `d636fc91c4c042139001e5accba7fff7`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:18.655497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:18.686702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2e52d2dbd14e91868fbf4591a0ef27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.733276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2e52d2dbd14e91868fbf4591a0ef27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.735431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2e52d2dbd14e91868fbf4591a0ef27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.757214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2e52d2dbd14e91868fbf4591a0ef27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.778754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2e52d2dbd14e91868fbf4591a0ef27'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:18.800725 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3787/7671] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:18 2022] DELETE /identity/v3/users/ef2e52d2dbd14e91868fbf4591a0ef27 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:18.895679 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3885/7672] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:18.899578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:19.113078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027a552-9a1f-4172-8aba-0894cb857f24 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:19.130775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd636fc91c4c042139001e5accba7fff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d4708b7bf544d286f54893273c6c55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:19.131605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.131950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.132237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.134759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:19.135078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:19.140537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:19.168612 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3788/7673] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:19.170366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:19.183237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604055d-5e0e-474e-99c0-5a120eb25eaf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:19.200735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd636fc91c4c042139001e5accba7fff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d4708b7bf544d286f54893273c6c55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:19.201646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.202018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.202410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.203288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:19.205291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:19.273236 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3886/7674] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:19 2022] POST /identity/v3/projects => generated 350 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:19.274753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:19.293428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca568d34-840d-4065-a5f9-d7a3ede5feb4 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:19.403739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd636fc91c4c042139001e5accba7fff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d4708b7bf544d286f54893273c6c55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:19.405100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.405590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.406178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.407842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:19.408340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:19.410530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:19.430498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3789/7675] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:19.461956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:19.464559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:19.601733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d156bd-fefe-41f1-88b5-36ac338274f7 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:19.607046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:19.607919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.608216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.608794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.625434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:19.628050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76d08c-e6a5-4eab-9a90-4987108b1cf5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:19.652071 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3887/7676] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:19 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:19.903677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:19.918698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d2f50-942e-4b54-8f62-5ea245cb72f6 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:19.924398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.925028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.925570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.945783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd636fc91c4c042139001e5accba7fff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5d4708b7bf544d286f54893273c6c55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:19.949386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:19.951953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:19.954258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] PATH_INFO: `/v3/projects/0b6dde9dfd6c4bb0b16588bbf68f2826` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:19.955969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b6dde9dfd6c4bb0b16588bbf68f2826)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:19.958142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:19.973404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] MFA Rules not processed for user `6115d2391b38410da48cf3df74776b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:19.975147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.053629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6dde9dfd6c4bb0b16588bbf68f2826', 'request_id': 'req-d98b15cc-3524-4875-a840-07daeeb6ec85'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.067527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6dde9dfd6c4bb0b16588bbf68f2826', 'request_id': 'req-d98b15cc-3524-4875-a840-07daeeb6ec85'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.077954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6dde9dfd6c4bb0b16588bbf68f2826', 'request_id': 'req-d98b15cc-3524-4875-a840-07daeeb6ec85'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.087446 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3888/7677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:20.088554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.090276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.110418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] The token cache is being invalidate because project 0b6dde9dfd6c4bb0b16588bbf68f2826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:20.111435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.112381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.114278 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3790/7678] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:19 2022] DELETE /identity/v3/projects/0b6dde9dfd6c4bb0b16588bbf68f2826 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:20.117034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.119245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.206664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371e3e-cc5f-406c-95c3-1b53246e550f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:20.249871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b15cc-3524-4875-a840-07daeeb6ec85 tempest-QuotasTest-1319567674 tempest-QuotasTest-1319567674-project-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:20.263424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:20.268159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.268792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.269484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.274251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.279403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:20.280678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.281079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.281472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] PATH_INFO: `/v3/projects/23e650135a134e8497fdd54df93de424` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.283138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e650135a134e8497fdd54df93de424)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:20.286167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:20.361604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e650135a134e8497fdd54df93de424', 'request_id': 'req-a9f8ead3-5573-43de-ad73-d469aca6ca9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.373114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e650135a134e8497fdd54df93de424', 'request_id': 'req-a9f8ead3-5573-43de-ad73-d469aca6ca9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.375517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:20.378084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45817350-8465-4dc9-ad9a-6d464806aed3 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:20.387300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e650135a134e8497fdd54df93de424', 'request_id': 'req-a9f8ead3-5573-43de-ad73-d469aca6ca9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.389835 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3791/7679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:20.405850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] The token cache is being invalidate because project 23e650135a134e8497fdd54df93de424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:20.406339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.407170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-a9f8ead3-5573-43de-ad73-d469aca6ca9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:20.408932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3889/7680] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:20 2022] DELETE /identity/v3/projects/23e650135a134e8497fdd54df93de424 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:20.414078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.419315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.419964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.499359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:20.505924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.614877 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3792/7681] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:20.623163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.623459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.623746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.666983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:20.669602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.694692 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3890/7682] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:20.695544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.707983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d09a6-8c7a-453a-bdd8-39936defa505 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:20.717154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:20.717960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.718313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.718826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.720259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:20.720672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:20.723493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:20.759448 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3793/7683] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:20.766699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.778164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.787435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14800035-8f19-4702-a9a2-01da7fd9ce05 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:20.789685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:20.804222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:20.815679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:20.815966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:20.816260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:20.825794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:20.826412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:20.883747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3891/7684] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:20 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:20.894241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:20.900507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:21.051456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394de4-3cd5-4a70-a61f-541fbdf9ec2c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.125709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738ca2-6943-4774-b9bc-6b8476f453ed admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.137251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.143240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.143240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.143624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] PATH_INFO: `/v3/users/5a861fd9f4ea4e2d8a16589a8cc96f15` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.145463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a861fd9f4ea4e2d8a16589a8cc96f15)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.159530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.193817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.195277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.195719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.197747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.206028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:21.236203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a861fd9f4ea4e2d8a16589a8cc96f15'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:21.254189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a861fd9f4ea4e2d8a16589a8cc96f15'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:21.255175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a861fd9f4ea4e2d8a16589a8cc96f15'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:21.255894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a861fd9f4ea4e2d8a16589a8cc96f15'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:21.256916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.258707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.265108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bfe68c54-496c-42a4-91b5-cd67b21a1b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a861fd9f4ea4e2d8a16589a8cc96f15'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:21.276750 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3794/7685] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:21.277965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:21.294410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de857-dcc9-4a7f-9674-070a1c7747d4 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.325115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3892/7686] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:20 2022] DELETE /identity/v3/users/5a861fd9f4ea4e2d8a16589a8cc96f15 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:21.330468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.330913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.331363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.333287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.340887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.341251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.341601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.343945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.346119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.385130 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3795/7687] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:21 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:21.386648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:21.388781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:21.405002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:21.408250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:21.426506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917eab-0611-49fc-b115-c7e74dff2a75 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.614213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3893/7688] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:21.631239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.632159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.632478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.632933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.633780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.637383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.646909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:21.648770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:21.682431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3796/7689] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:21.688419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:21.712857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371c25-8543-48f6-9a85-989c49bb0d00 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.732030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.733032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.733352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.733730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.734567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.746642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.766799 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3797/7690] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:21.771048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:21.788705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f176-71ae-4cec-bd7b-ca9f070ec668 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.822266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.823955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.823955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.823955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] PATH_INFO: `/v3/projects/0b2cb9e157e24c08896196b08efc69af/users/e3a0fa0689964ce0b0298ca3592d5cca/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.829952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b5c5-7e51-4e63-b2af-6c36bf93287a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:21.852772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:21.854252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.854645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.855026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.871329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2cb9e157e24c08896196b08efc69af, user_id=e3a0fa0689964ce0b0298ca3592d5cca, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.878169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d4cc2-e07c-4bf7-9d65-4388061674e4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.879579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:21.884419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:21.919430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3798/7691] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:21 2022] PUT /identity/v3/projects/0b2cb9e157e24c08896196b08efc69af/users/e3a0fa0689964ce0b0298ca3592d5cca/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:21.922288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3894/7692] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:21.926649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:21.927494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:21.928629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:21.999260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] MFA Rules not processed for user `e3a0fa0689964ce0b0298ca3592d5cca`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:22.001092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:22.129152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:22.138986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:22.246122 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3799/7693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:22.247725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:22.408294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa685a-7d06-4649-93eb-b0e1cc767fd6 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:22.481887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3af0a-d50f-43da-8743-d49534402b7d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:22.501302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:22.502111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:22.502276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:22.502550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:22.504745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:22.507831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:22.593043 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3800/7694] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:22 2022] POST /identity/v3/projects => generated 367 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:22.594196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:22.624250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:22.632961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:22.634990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:22.635300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:22.642184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:22.686078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:22.689074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:22.716470 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3895/7695] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:22.717808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:22.719646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:22.742297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0179eb-3f7e-4bf8-9bbe-23430a604439 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:22.799075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867631d7-67d8-4851-88e3-61986c21425f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:22.827230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:22.827840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:22.827977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:22.828253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:22.828979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:22.830938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:22.906034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:22.907101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:22.907487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:22.907863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] PATH_INFO: `/v3/projects/fa3d6858e8c34b5ea53c2243bb16c3f2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:22.909429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3d6858e8c34b5ea53c2243bb16c3f2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:22.916985 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3801/7696] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:22 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:22.921575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:22.944094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:22.957145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9e6f6-1c61-439a-ba6a-df8659f7ab22 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:22.974290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:22.975146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:22.976558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:22.976824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:22.979090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:22.984297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:23.046753 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3802/7697] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:23.051179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:23.082790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf6dd-38cc-4f3a-a60d-4afca3421209 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:23.101700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3d6858e8c34b5ea53c2243bb16c3f2', 'request_id': 'req-335e919b-5c3b-4e32-881d-784ee832a792'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.130172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3d6858e8c34b5ea53c2243bb16c3f2', 'request_id': 'req-335e919b-5c3b-4e32-881d-784ee832a792'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.154999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3d6858e8c34b5ea53c2243bb16c3f2', 'request_id': 'req-335e919b-5c3b-4e32-881d-784ee832a792'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.182444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] The token cache is being invalidate because project fa3d6858e8c34b5ea53c2243bb16c3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:23.183587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.184663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.204628 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3896/7698] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:22 2022] DELETE /identity/v3/projects/fa3d6858e8c34b5ea53c2243bb16c3f2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:23.206862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:23.209251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:23.286128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:23.289169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:23.289681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:23.291982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:23.293191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:23.296377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:23.321977 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3803/7699] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:23.331659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:23.342043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:23.375139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6e68f-458f-43fa-86c2-62cab113a1a9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:23.386738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e919b-5c3b-4e32-881d-784ee832a792 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:23.390933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:23.392098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:23.392609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:23.393056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] PATH_INFO: `/v3/projects/0da746eebc2e4f859eb6cad4dcd89e22/users/b9a60d4f3f834ebb87257a4f72983185/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:23.414253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:23.417117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:23.418736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:23.419031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] PATH_INFO: `/v3/users/d636fc91c4c042139001e5accba7fff7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:23.424691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d636fc91c4c042139001e5accba7fff7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:23.428556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:23.428955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da746eebc2e4f859eb6cad4dcd89e22, user_id=b9a60d4f3f834ebb87257a4f72983185, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:23.432003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fee68-f906-4989-af91-312ebf9cc213 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:23.484974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3804/7700] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:23 2022] PUT /identity/v3/projects/0da746eebc2e4f859eb6cad4dcd89e22/users/b9a60d4f3f834ebb87257a4f72983185/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:23.496727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:23.498009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:23.498282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:23.556798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd636fc91c4c042139001e5accba7fff7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.561979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] MFA Rules not processed for user `b9a60d4f3f834ebb87257a4f72983185`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:23.567563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:23.577792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd636fc91c4c042139001e5accba7fff7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.579132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd636fc91c4c042139001e5accba7fff7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.580144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd636fc91c4c042139001e5accba7fff7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.595742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd636fc91c4c042139001e5accba7fff7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:23.629846 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3897/7701] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:23 2022] DELETE /identity/v3/users/d636fc91c4c042139001e5accba7fff7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:23.717304 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3805/7702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:23.731546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:23.733514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:23.852205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79619baa-0abe-4c7d-bc54-a068094fa820 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:23.871232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:23.872235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:23.873757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:23.874244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:23.880739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:23.980656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:23.982938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:23.995065 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3898/7703] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:24.036680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:24.039482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:24.136117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:24.150761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41924a07-7938-4838-89fc-f03586610b9a service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:24.157489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:24.158412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:24.159060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:24.159515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:24.168557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570a8d4-742a-4c32-894c-3081dca9dd60 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:24.227344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:24.228154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:24.228604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:24.228957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:24.231074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:24.264194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:24.276890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:24.293360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3899/7704] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:24.341237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:24.344239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0532d-ac3d-4a9b-859d-a77aa4cebc02 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:24.402162 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3806/7705] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:24.489594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:24.495593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:24.682998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345133ff-43fe-4e32-8432-4f159c9ec61e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:24.683542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345133ff-43fe-4e32-8432-4f159c9ec61e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:24.684153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345133ff-43fe-4e32-8432-4f159c9ec61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:24.711964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-345133ff-43fe-4e32-8432-4f159c9ec61e None None] MFA Rules not processed for user `46d0c6b2806a46ce9621af36b828e17e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:24.715778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-345133ff-43fe-4e32-8432-4f159c9ec61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:24.752624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c310da-1964-4822-b8c8-d8a7f3260f1f service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:24.763056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:24.764977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:24.767936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:24.768229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] PATH_INFO: `/v3/projects/c5d4708b7bf544d286f54893273c6c55` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:24.771591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d4708b7bf544d286f54893273c6c55)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:24.786128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:24.908990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d4708b7bf544d286f54893273c6c55', 'request_id': 'req-8f068858-75ac-4b76-a39b-5707aea1729f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:24.928042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d4708b7bf544d286f54893273c6c55', 'request_id': 'req-8f068858-75ac-4b76-a39b-5707aea1729f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:24.936332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3807/7706] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:24.951812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d4708b7bf544d286f54893273c6c55', 'request_id': 'req-8f068858-75ac-4b76-a39b-5707aea1729f'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:24.971674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] The token cache is being invalidate because project c5d4708b7bf544d286f54893273c6c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:24.972248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:24.974775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8f068858-75ac-4b76-a39b-5707aea1729f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:24.982921 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3900/7707] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:24 2022] DELETE /identity/v3/projects/c5d4708b7bf544d286f54893273c6c55 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:24.984867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:24.985181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:24.985703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.026983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:25.028248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:25.169354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.169745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.169962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3808/7708] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:25.170195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.197017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:25.198767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:25.217424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.233264 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3901/7709] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:25.240087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7009f-d90d-42c5-bd2d-62d8ac95386e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.247572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.250491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.251371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.251741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.254854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:25.256817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.260443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.305633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3809/7710] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:25.310263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.320262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543b10-5d1f-418b-b820-50ec86f60d35 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.338127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.338821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.339108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.339388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.340084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.342042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.403781 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3902/7711] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:25 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:25.405464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.427337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a3285-6422-43fa-a30f-47c926534582 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.569083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.569853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.570152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.572356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.577436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.584310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.647770 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3810/7712] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:25 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:25.652120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.684510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c12a7-c1ad-4695-9434-6e2999094e88 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.694914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.695730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.696166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.698601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.699525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.707030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.724916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3903/7713] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:25.729185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.749609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286034b-5d1a-4d03-95a3-813d226de997 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.757097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.758440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.759498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.760161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.761391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.769533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.771944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:25.772868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.843231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3811/7714] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:25.850925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:25.904777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dec8d-74f9-4a72-86ac-a3e914d5e71f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:25.926052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:25.927083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:25.927370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:25.932542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] PATH_INFO: `/v3/projects/79c75ffe30794479aadda562c9e11974/users/d3f049a8805a454d818122a8743f6065/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:25.976202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c75ffe30794479aadda562c9e11974, user_id=d3f049a8805a454d818122a8743f6065, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:25.980483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46206cd-81c1-46b3-9b30-44a898b4659d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:25.999409 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3812/7715] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:25 2022] PUT /identity/v3/projects/79c75ffe30794479aadda562c9e11974/users/d3f049a8805a454d818122a8743f6065/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:26.012099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.012510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.012722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.071017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea211bf-cc92-4831-8638-21160a96c61c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:26.079171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] MFA Rules not processed for user `d3f049a8805a454d818122a8743f6065`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:26.082621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:26.203826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:26.206163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.206722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.208865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.214886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:26.248162 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3813/7716] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:26.252662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:26.253982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:26.258084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:26.285715 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3904/7717] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:26.435253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaceee-b7bd-4bde-8e8f-a862f8305482 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:26.453807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:26.454559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.454833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.455111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.465798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:26.467982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:26.529111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:26.530867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:26.573085 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3814/7718] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:26 2022] POST /identity/v3/projects => generated 369 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:26.575012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:26.576743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b99f0-81e9-42e8-adf6-13d37f304bf4 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:26.753132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:26.753963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.754240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.754523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] PATH_INFO: `/v3/users/e3a0fa0689964ce0b0298ca3592d5cca` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.755771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a0fa0689964ce0b0298ca3592d5cca)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:26.764623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:26.803660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0c97-77f5-496e-93fb-a00180ac0a0d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:26.827751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:26.828480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.828760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.829028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.829727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:26.831663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:26.870642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a0fa0689964ce0b0298ca3592d5cca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:26.892749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a0fa0689964ce0b0298ca3592d5cca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:26.896078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a0fa0689964ce0b0298ca3592d5cca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:26.897452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a0fa0689964ce0b0298ca3592d5cca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:26.912778 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3815/7719] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:26 2022] POST /identity/v3/users => generated 291 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:26.919011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:26.927362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:26.939002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f25c8e90-9e1a-4c17-84ad-b071954190aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a0fa0689964ce0b0298ca3592d5cca'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:26.963277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b0603-dbd8-4691-9a17-ff08072020a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:26.981288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:26.982246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:26.982720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:26.983164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:26.984069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:26.990961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:27.013542 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3905/7720] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:26 2022] DELETE /identity/v3/users/e3a0fa0689964ce0b0298ca3592d5cca => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:27.018088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.018625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.019080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.039485 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3816/7721] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:27.041435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:27.062320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431b41-403c-449d-9eaa-df77e3f6fa24 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:27.063916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:27.065807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:27.194453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:27.198226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.199996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.200796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] PATH_INFO: `/v3/projects/a51f428187b3496b897ace71da0754e2/users/0a88204c242b4ea8921be80a1bdfdf7c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.247532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51f428187b3496b897ace71da0754e2, user_id=0a88204c242b4ea8921be80a1bdfdf7c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:27.250242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:27.267265 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3906/7722] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:27.287034 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3817/7723] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:27 2022] PUT /identity/v3/projects/a51f428187b3496b897ace71da0754e2/users/0a88204c242b4ea8921be80a1bdfdf7c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:27.287945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:27.310830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021d0e-9f64-414f-8c04-7804ad18bddc None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:27.320872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:27.324713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:27.479900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9968b-9680-4f91-967b-003ebd82c550 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:27.488720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:27.489648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.490128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.490665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.499085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:27.499796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.500085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.500369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.501237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:27.507112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:27.509003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:27.510692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d693b0-37b4-442c-96c6-4036300dd4c3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:27.532064 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3907/7724] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:27.537814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:27.543855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3818/7725] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:27.566900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7de0c-4e98-46de-a1ae-33f18b90edbc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:27.583092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:27.583992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.584429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.584757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] PATH_INFO: `/v3/projects/a51f428187b3496b897ace71da0754e2/users/0a88204c242b4ea8921be80a1bdfdf7c/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.588686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51f428187b3496b897ace71da0754e2, user_id=0a88204c242b4ea8921be80a1bdfdf7c, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:27.593882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:27.626443 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3908/7726] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:27 2022] PUT /identity/v3/projects/a51f428187b3496b897ace71da0754e2/users/0a88204c242b4ea8921be80a1bdfdf7c/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:27.734186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:27.734515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:27.734858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:27.818479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] MFA Rules not processed for user `0a88204c242b4ea8921be80a1bdfdf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:27.819144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:27.872476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:27.875068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.081731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86336e2-f129-45fe-a69e-7eaf8a7b5a06 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:28.101019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:28.101959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.102205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.103091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] PATH_INFO: `/v3/users/6bae848c15354448ba13348d3a77e853` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.105174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bae848c15354448ba13348d3a77e853)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:28.109536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:28.109991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3819/7727] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:28.121417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:28.123743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.216142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bae848c15354448ba13348d3a77e853'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.230388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bae848c15354448ba13348d3a77e853'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.231466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bae848c15354448ba13348d3a77e853'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.232520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bae848c15354448ba13348d3a77e853'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.252568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f8c81320-d9e3-428a-a6bd-3e676b94b057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bae848c15354448ba13348d3a77e853'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.290279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0179459-6e2e-4504-8a6f-979f36c10b9b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:28.296276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:28.297784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.298314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.298876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.303556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.328240 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3909/7728] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:27 2022] DELETE /identity/v3/users/6bae848c15354448ba13348d3a77e853 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:28.332489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.332841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.333178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.334704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:28.339826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:28.367142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3820/7729] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:28.377054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:28.380826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.538091 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3910/7730] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:28.553768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:28.556646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.601793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1af44-ee72-4fa1-bfb8-9b24262e2fcd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:28.642270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:28.643773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:28.665774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8d63-a64c-4b51-b833-89ff2983ba24 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:28.686998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:28.688406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.688856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.689345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] PATH_INFO: `/v3/projects/0b2cb9e157e24c08896196b08efc69af` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.691794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2cb9e157e24c08896196b08efc69af)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:28.697316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:28.698117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.698280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.698554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.699394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:28.711030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:28.712990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:28.736594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3821/7731] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:28.791810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2cb9e157e24c08896196b08efc69af', 'request_id': 'req-60a73fab-e301-41ef-8ad9-0338b35626ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.806750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2cb9e157e24c08896196b08efc69af', 'request_id': 'req-60a73fab-e301-41ef-8ad9-0338b35626ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.818968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2cb9e157e24c08896196b08efc69af', 'request_id': 'req-60a73fab-e301-41ef-8ad9-0338b35626ce'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.844952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] The token cache is being invalidate because project 0b2cb9e157e24c08896196b08efc69af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:28.845261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.847255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:28.852150 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3911/7732] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:28 2022] DELETE /identity/v3/projects/0b2cb9e157e24c08896196b08efc69af => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:28.861933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:28.875958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0624-1c37-45eb-a627-bb3854e03edd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:28.985535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:28.986522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:28.988799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:28.989220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] PATH_INFO: `/v3/users/b9a60d4f3f834ebb87257a4f72983185` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:28.997623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a60d4f3f834ebb87257a4f72983185)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:28.999601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:29.109453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a60d4f3f834ebb87257a4f72983185'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.140363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a60d4f3f834ebb87257a4f72983185'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.144261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a60d4f3f834ebb87257a4f72983185'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.163244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a60d4f3f834ebb87257a4f72983185'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.176290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1e932655-c6af-4c5a-a164-5687c0deff73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a60d4f3f834ebb87257a4f72983185'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.198923 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3822/7733] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:28 2022] DELETE /identity/v3/users/b9a60d4f3f834ebb87257a4f72983185 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:29.614803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:29.616937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:29.639615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73fab-e301-41ef-8ad9-0338b35626ce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:29.781215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:29.782474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:29.782924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:29.783541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] PATH_INFO: `/v3/projects/552778e1fdfe4759ac6f731e4a7038c5` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:29.785250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552778e1fdfe4759ac6f731e4a7038c5)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:29.787375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:29.975985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552778e1fdfe4759ac6f731e4a7038c5', 'request_id': 'req-786bc128-80d6-4843-a2e5-859dc770c9e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.989161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552778e1fdfe4759ac6f731e4a7038c5', 'request_id': 'req-786bc128-80d6-4843-a2e5-859dc770c9e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:29.999901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552778e1fdfe4759ac6f731e4a7038c5', 'request_id': 'req-786bc128-80d6-4843-a2e5-859dc770c9e5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.012871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] The token cache is being invalidate because project 552778e1fdfe4759ac6f731e4a7038c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:30.013433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.014298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-786bc128-80d6-4843-a2e5-859dc770c9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.016926 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3912/7734] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:29 2022] DELETE /identity/v3/projects/552778e1fdfe4759ac6f731e4a7038c5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:30.021632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.022149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.022256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.054322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:30.056366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:30.149249 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3823/7735] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:30.157881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.158182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.158492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.182880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:30.184278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:30.192747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3913/7736] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:30.197296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.207464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0c05b-fe50-42c7-a43a-454b8e6f9321 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.212929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.213709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.214093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.214466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.215326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:30.215755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.217481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.230187 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3824/7737] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:30.235279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.247900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b315016-ea0c-4f74-81fc-6dded52c4336 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.254597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.255286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.255572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.256022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.256776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.261272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.319500 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3914/7738] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:30.322827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.342091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5ec0f-c9e9-418c-913b-9d40f381ac8e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.466411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.468347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:30.519179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.519872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.520155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.520433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.525176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.527704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.573953 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3825/7739] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:30.576183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.611485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a733ed5-632a-4db2-8590-a98c78a0994f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.633541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.634345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.634742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.635125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.636090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.637917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.657999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00664a1f-4f38-4883-b758-e4f88d0b349d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.667803 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3826/7740] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:30.669321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.681975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.684654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.686702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.688712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] PATH_INFO: `/v3/projects/0da746eebc2e4f859eb6cad4dcd89e22` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.690978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ae93a-5b50-4a64-aec0-775476f7a798 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.694586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da746eebc2e4f859eb6cad4dcd89e22)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.698851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.708334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.709329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.709720 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.710100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.710944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.714174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.742956 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3827/7741] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:30.747239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:30.775188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848c80-629b-4d4a-90ec-c020a622a3aa admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:30.787274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:30.788707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.789328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.789865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] PATH_INFO: `/v3/projects/a43d874bd1c841d99c6f960ad21d904e/users/9cb83eb89cbc480c929c7c28b1d855de/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.826484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43d874bd1c841d99c6f960ad21d904e, user_id=9cb83eb89cbc480c929c7c28b1d855de, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:30.832707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae28d2-530e-4493-bb85-f7d7beb40570 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:30.859855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3828/7742] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:30 2022] PUT /identity/v3/projects/a43d874bd1c841d99c6f960ad21d904e/users/9cb83eb89cbc480c929c7c28b1d855de/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:30.872226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.872638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.873156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:30.887408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da746eebc2e4f859eb6cad4dcd89e22', 'request_id': 'req-faad5567-e1af-4bb7-886e-365c690b4353'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.906774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da746eebc2e4f859eb6cad4dcd89e22', 'request_id': 'req-faad5567-e1af-4bb7-886e-365c690b4353'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.930035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da746eebc2e4f859eb6cad4dcd89e22', 'request_id': 'req-faad5567-e1af-4bb7-886e-365c690b4353'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.949454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] MFA Rules not processed for user `9cb83eb89cbc480c929c7c28b1d855de`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:30.953765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] The token cache is being invalidate because project 0da746eebc2e4f859eb6cad4dcd89e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:30.954162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:30.956023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.958403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-faad5567-e1af-4bb7-886e-365c690b4353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:30.968949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3915/7743] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:30 2022] DELETE /identity/v3/projects/0da746eebc2e4f859eb6cad4dcd89e22 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:30.973682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85df1-4706-4347-acc8-8d148473e5a4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:30.974717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85df1-4706-4347-acc8-8d148473e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:30.975209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85df1-4706-4347-acc8-8d148473e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.025565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f0e85df1-4706-4347-acc8-8d148473e5a4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:31.029503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0e85df1-4706-4347-acc8-8d148473e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:31.136270 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3829/7744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:31.137930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.142388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:31.166127 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3916/7745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:31.168044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606e81-df65-4d10-bd8f-afbe80a18390 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.175997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.175997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.176316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.176529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.177412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.177913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.178355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.179255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.185891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.204266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:31.206259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:31.219887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3917/7746] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:31.221014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.228862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3830/7747] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:31.230826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.235607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635f7a5-f52d-411b-9cf9-a2ff2b815995 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.351847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389dae7-2600-47d0-85eb-dc5cd5ff046d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.358045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.358986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.359275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.359556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.360241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.362421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.377417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.377876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.378280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.378637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.381807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:31.382198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.385851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.412995 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3918/7748] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:31.420883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.428423 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3831/7749] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:31.432672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.447665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f33b40-be48-4c24-814e-4c0d0ce80ae2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.462711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5896b-fa3d-4801-bdb0-e8684580e61b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.469249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.470356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.470888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.471411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.472592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.474639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.476350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.482359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.483423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.486215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.494665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.497245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.535617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3832/7750] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:31.557906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.577718 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3919/7751] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:31.581387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.588526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b4490-9e1a-4548-af07-5b9cf8dcfcd9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.689601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21639f8-8196-40b5-b996-4ed6f6920680 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.698646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.700244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.700776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.701470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.702484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.705012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.730331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.731248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.731477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.731762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] PATH_INFO: `/v3/projects/e5c329c05bbf488fad5292a6449e9e36/users/585761130c3d447184c2dafde2a68ed0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.738253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3920/7752] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:31.742301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.750807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c329c05bbf488fad5292a6449e9e36, user_id=585761130c3d447184c2dafde2a68ed0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.754625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.756967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc12afe-309b-47d5-9774-74d69e361d07 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.763324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.764298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.765896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.766387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.767410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.770080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.773205 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3833/7753] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:31 2022] PUT /identity/v3/projects/e5c329c05bbf488fad5292a6449e9e36/users/585761130c3d447184c2dafde2a68ed0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:31.778484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.787146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3921/7754] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:31.789148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.802000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34075c-0530-4ac8-9448-b5e885e951f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.887846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a96d6-383f-4320-83c6-8c99e83e862a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.893344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.895227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.895523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.895868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.897242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.899136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.916507 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3834/7755] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:31.917713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.918159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.920282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.920582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.920958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.923238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.928073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.940600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c75e5-8446-4cd7-93b4-c618ddd685e2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.943519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3922/7756] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:31.947483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.949200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.949723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.949981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:31.950755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] PATH_INFO: `/v3/projects/e5c329c05bbf488fad5292a6449e9e36/users/585761130c3d447184c2dafde2a68ed0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.953789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c329c05bbf488fad5292a6449e9e36, user_id=585761130c3d447184c2dafde2a68ed0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.957741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb6d2f-140c-4a1b-a584-2a1d5c53edd6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:31.962763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94217-686d-4e5f-a8d2-9be854754e9f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:31.970487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:31.972261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.972659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.972964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] PATH_INFO: `/v3/projects/bc2a968d44914bf198115edd6b45a336/users/8d14db7279824ddeb42ccd36ae757f98/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.983346 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3835/7757] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:31 2022] PUT /identity/v3/projects/e5c329c05bbf488fad5292a6449e9e36/users/585761130c3d447184c2dafde2a68ed0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:31.986905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:31.988439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:31.988979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:31.994644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2a968d44914bf198115edd6b45a336, user_id=8d14db7279824ddeb42ccd36ae757f98, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:31.998130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9faf6-aaef-46ad-8ddd-86d64a1b2766 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.034121 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3923/7758] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:31 2022] PUT /identity/v3/projects/bc2a968d44914bf198115edd6b45a336/users/8d14db7279824ddeb42ccd36ae757f98/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:32.044615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] MFA Rules not processed for user `585761130c3d447184c2dafde2a68ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:32.044615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:32.050883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.051640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.052131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.091257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] MFA Rules not processed for user `8d14db7279824ddeb42ccd36ae757f98`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:32.094291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:32.150506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3836/7759] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:32.170141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.173665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:32.196579 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3924/7760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:32.202498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.279709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcb8c8-bc77-4bec-844e-11dafef02845 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.284154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.286321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.286321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.286321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.303714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.306863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d5b6-f589-42f3-a6f3-5f288b24cfa3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.308469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.315416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.316097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.316613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.316813 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.317479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.319539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.331359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3837/7761] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:32.373514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3925/7762] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:32 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:32.377382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.391957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407b57b-0011-4cac-a2b4-f4d790ef83cf service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.427670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.525916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.526630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.527352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.527643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.528337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.534963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.586223 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3838/7763] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:32 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:32.590482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.608623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e5f0-99a3-407f-a8e4-3773132ffa0a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.621243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e8e0-55f5-4923-976a-a3b1297c6638 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.629255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.629961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.630246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.630527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.634151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.638142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.650900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.652525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.652977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.653435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] PATH_INFO: `/v3/users/9cb83eb89cbc480c929c7c28b1d855de` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.655386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb83eb89cbc480c929c7c28b1d855de)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.657979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.671319 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3839/7764] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:32.676565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.715496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3868f-9f15-473f-b4f2-4344c7a9ca93 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:32.739176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:32.740086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.740367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.741663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] PATH_INFO: `/v3/projects/115541332cfa419a96e6846a9d989bf1/users/c3e4be76550942478459cd632b8b5263/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.764713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb83eb89cbc480c929c7c28b1d855de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:32.783752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb83eb89cbc480c929c7c28b1d855de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:32.784862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb83eb89cbc480c929c7c28b1d855de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:32.785629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb83eb89cbc480c929c7c28b1d855de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:32.799931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115541332cfa419a96e6846a9d989bf1, user_id=c3e4be76550942478459cd632b8b5263, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:32.806307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:32.806550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-60c7001a-490d-4bf4-9e63-d3c0cb25810b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb83eb89cbc480c929c7c28b1d855de'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:32.835238 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3926/7765] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:32 2022] DELETE /identity/v3/users/9cb83eb89cbc480c929c7c28b1d855de => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:32.837803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:32.838105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:32.838440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:32.843903 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3840/7766] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:32 2022] PUT /identity/v3/projects/115541332cfa419a96e6846a9d989bf1/users/c3e4be76550942478459cd632b8b5263/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:32.848887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:32.853027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:32.870895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:32.872338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:32.974757 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3927/7767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:33.010858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:33.013276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:33.043810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e2d2-cc4d-4766-922d-66f81facf553 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:33.058030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:33.058676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:33.058804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:33.059031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:33.059902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:33.070295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:33.089262 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3841/7768] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:33.093796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:33.114584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20656959-1c43-4414-96cd-669c83c709b5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:33.131007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:33.131441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4946f-90a6-4055-b8e8-81e87ee81dcb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:33.133253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:33.134859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:33.136156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] PATH_INFO: `/v3/projects/115541332cfa419a96e6846a9d989bf1/users/c3e4be76550942478459cd632b8b5263/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:33.144963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:33.145241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=115541332cfa419a96e6846a9d989bf1, user_id=c3e4be76550942478459cd632b8b5263, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:33.146409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:33.146963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:33.147456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:33.154285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:33.163048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:33.165104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103a87f-a94b-45dd-8ca4-6baa258b5cb1 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:33.182541 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3928/7769] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:33.195916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3842/7770] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:33 2022] PUT /identity/v3/projects/115541332cfa419a96e6846a9d989bf1/users/c3e4be76550942478459cd632b8b5263/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:33.206978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:33.207833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:33.208786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:33.261313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] MFA Rules not processed for user `c3e4be76550942478459cd632b8b5263`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:33.263020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:33.373961 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3929/7771] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:33.396785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:33.484514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1ad-ec65-406b-8f3d-6697464bfd0f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:33.491890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:33.495284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:33.495799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:33.496251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:33.514161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:33.516386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:33.535145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3843/7772] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:34.029712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:34.031309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:34.129958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c054-ebe7-4092-9fa5-1bd697679c34 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:34.136688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:34.137630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:34.137924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:34.138323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] PATH_INFO: `/v3/projects/a43d874bd1c841d99c6f960ad21d904e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:34.140620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43d874bd1c841d99c6f960ad21d904e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:34.143105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:34.210863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43d874bd1c841d99c6f960ad21d904e', 'request_id': 'req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.220486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43d874bd1c841d99c6f960ad21d904e', 'request_id': 'req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.233413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43d874bd1c841d99c6f960ad21d904e', 'request_id': 'req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.251647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] The token cache is being invalidate because project a43d874bd1c841d99c6f960ad21d904e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:34.251647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.252585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.261723 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3930/7773] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:34 2022] DELETE /identity/v3/projects/a43d874bd1c841d99c6f960ad21d904e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:34.262822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:34.281009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b8e5-da54-4589-b5d5-a5dc253971ec service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:34.393998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:34.395191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:34.395622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:34.395997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] PATH_INFO: `/v3/users/585761130c3d447184c2dafde2a68ed0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:34.397831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=585761130c3d447184c2dafde2a68ed0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:34.401418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:34.479799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585761130c3d447184c2dafde2a68ed0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.496794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585761130c3d447184c2dafde2a68ed0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.497679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585761130c3d447184c2dafde2a68ed0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.507670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585761130c3d447184c2dafde2a68ed0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.516863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d976b7f4-d74f-4a86-b1c7-8d8f11985e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585761130c3d447184c2dafde2a68ed0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:34.529044 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3844/7774] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:34 2022] DELETE /identity/v3/users/585761130c3d447184c2dafde2a68ed0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:35.401884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:35.404838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:35.421664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe5b1-203f-44c6-8d9e-5299dc13e9be admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:35.552328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:35.554343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:35.554879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:35.555382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] PATH_INFO: `/v3/projects/e5c329c05bbf488fad5292a6449e9e36` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:35.557016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c329c05bbf488fad5292a6449e9e36)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:35.559317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:35.648327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c329c05bbf488fad5292a6449e9e36', 'request_id': 'req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:35.659083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c329c05bbf488fad5292a6449e9e36', 'request_id': 'req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:35.675726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c329c05bbf488fad5292a6449e9e36', 'request_id': 'req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:35.695314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] The token cache is being invalidate because project e5c329c05bbf488fad5292a6449e9e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:35.696905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:35.697924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cf1d7f71-833f-41a5-9317-e4d3c9fbc8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:35.700015 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3931/7775] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:35 2022] DELETE /identity/v3/projects/e5c329c05bbf488fad5292a6449e9e36 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:35.704765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:35.705621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:35.705621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:35.729203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:35.730741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:35.814607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3845/7776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:35.822996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:35.824729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:35.825598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:35.847570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:35.848876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:35.873240 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3932/7777] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:35.873465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:35.886577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e09769-789e-4bfe-8c38-a5bea6650f1c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:35.893223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:35.894168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:35.894521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:35.894721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:35.896146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:35.896440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:35.898072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:35.913672 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3846/7778] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:19:35.917836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:35.932674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c4322-4cb9-4264-a890-f12d2e90570d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:35.937897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:35.939280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:35.939280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:35.940008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:35.940533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:35.942891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:35.972299 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3933/7779] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:35 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:35.976105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:35.987292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6609-35f9-4b86-b4fe-78212e97188a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.058290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.058878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.059958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.060240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.061313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.063945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.089711 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3847/7780] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:35 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:36.093905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.104328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e113-f7b9-4989-adb2-c869ab401725 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.110498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.111359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.111647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.111923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.112681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.114292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.128403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3934/7781] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:36.132444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.146136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa20ef-23ae-4fb4-8a2d-19f4633a5dd8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.175983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.178736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.179051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.179330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.184416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.186216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b168a98-2d7a-469f-8833-9baa9d57b392 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.203124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3848/7782] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:36.204362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.223286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4acfa-7ee1-4c9f-8b93-ed91c66829c7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.228731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.229819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.230261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.230784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] PATH_INFO: `/v3/projects/65522f00c7b643fd849d71d36811c75c/users/fb59fadcc1574a1396fe57c717087461/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.249237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65522f00c7b643fd849d71d36811c75c, user_id=fb59fadcc1574a1396fe57c717087461, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.252650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.285372 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3935/7783] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:36 2022] PUT /identity/v3/projects/65522f00c7b643fd849d71d36811c75c/users/fb59fadcc1574a1396fe57c717087461/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:36.288173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.288788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.289310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.346762 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] MFA Rules not processed for user `fb59fadcc1574a1396fe57c717087461`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:36.348199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:36.433463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.445862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3849/7784] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:36.546326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c67ad7-f36c-4265-89f0-1c9ecb65d88f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.554837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.556959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.557367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.557751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.558569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.561267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.607512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3936/7785] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:36 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:36.608827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.622304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af29a9-d4c4-42e9-837a-6cc76cc13a7a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.706403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.707418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.707859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.708265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.710002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.714335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.754825 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3850/7786] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:36 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:36.756443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.775204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787bf6a-8643-4a0a-92ea-2406d8ce3edf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.783345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.784094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.784449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.784781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.786465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.790626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.811998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3937/7787] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:36.813730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.826349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d457732-f3f2-47ce-9544-c706e651bd73 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:36.832477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:36.833696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:36.833837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:36.834191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] PATH_INFO: `/v3/projects/2ab6c820518f4e7591742edd357e230d/users/9f5cd01b28c94b5da77c583621e23064/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:36.850501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6c820518f4e7591742edd357e230d, user_id=9f5cd01b28c94b5da77c583621e23064, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:36.853927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:36.879027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3851/7788] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:36 2022] PUT /identity/v3/projects/2ab6c820518f4e7591742edd357e230d/users/9f5cd01b28c94b5da77c583621e23064/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:36.883162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:36.896135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043677a-5582-4b78-9412-e9dc9176fa26 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:37.031209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:37.033614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:37.034271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:37.036173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:37.037660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:37.041110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4dd3-2d9a-4b85-9665-5bbc3023abc5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:37.064361 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3938/7789] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:37.069094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:37.088239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67071ba-8777-45ae-80fe-62c5a3ddf205 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:37.094745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:37.095960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:37.096427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:37.097140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] PATH_INFO: `/v3/projects/2ab6c820518f4e7591742edd357e230d/users/9f5cd01b28c94b5da77c583621e23064/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:37.100135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab6c820518f4e7591742edd357e230d, user_id=9f5cd01b28c94b5da77c583621e23064, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:37.103356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:37.121560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3852/7790] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:37 2022] PUT /identity/v3/projects/2ab6c820518f4e7591742edd357e230d/users/9f5cd01b28c94b5da77c583621e23064/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:37.133277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:37.134533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:37.138634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:37.179130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] MFA Rules not processed for user `9f5cd01b28c94b5da77c583621e23064`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:37.181205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:37.345563 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3939/7791] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:37.360286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:37.362340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:37.504056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ab30b-279c-4995-8190-13a80bd87449 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:37.514933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:37.515564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:37.515853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:37.516135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:37.538297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:37.540320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:37.571055 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3853/7792] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:37.809381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:37.815675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:37.850470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598d117-3783-46ac-b7d3-3a232f777154 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:37.860282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:37.861179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:37.861418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:37.861786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:37.917686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:37.919295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:37.997401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:38.003688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849816a-edd6-4684-a3a8-1b5e195a4b07 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:38.017436 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3940/7793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:38.094766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae189d02-b3f3-438d-9ba5-cd5557788154 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:38.101380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:38.102738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:38.103200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:38.103663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] PATH_INFO: `/v3/users/8d14db7279824ddeb42ccd36ae757f98` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:38.105719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d14db7279824ddeb42ccd36ae757f98)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:38.108160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:38.179961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d14db7279824ddeb42ccd36ae757f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:38.234374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d14db7279824ddeb42ccd36ae757f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:38.235189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d14db7279824ddeb42ccd36ae757f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:38.245567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d14db7279824ddeb42ccd36ae757f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:38.257306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d14db7279824ddeb42ccd36ae757f98'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:38.264892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3854/7794] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:37 2022] DELETE /identity/v3/users/8d14db7279824ddeb42ccd36ae757f98 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:38.269912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:38.270279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:38.270592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:38.290249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:38.291737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:38.366776 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3941/7795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:38.381875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:38.383964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:38.505893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc11e2-ce9f-46a8-82b0-292e40ad369d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:38.511099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:38.512472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:38.512472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:38.512725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:38.523080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:38.524808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:38.536472 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3855/7796] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:39.354541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:39.356299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:39.357990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:39.358791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:39.397210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec5d0f-f102-4c90-aea9-9691fd455708 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:39.417426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:39.418963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:39.419366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:39.419758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] PATH_INFO: `/v3/projects/bc2a968d44914bf198115edd6b45a336` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:39.425363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2a968d44914bf198115edd6b45a336)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:39.433594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:39.527347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778429e-d6bf-4d1c-a6d1-69a74389ff2f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:39.558880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2a968d44914bf198115edd6b45a336', 'request_id': 'req-d9788666-79b6-44d7-b2f3-1f32ed6f321f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:39.581837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2a968d44914bf198115edd6b45a336', 'request_id': 'req-d9788666-79b6-44d7-b2f3-1f32ed6f321f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:39.594774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2a968d44914bf198115edd6b45a336', 'request_id': 'req-d9788666-79b6-44d7-b2f3-1f32ed6f321f'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:39.620576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] The token cache is being invalidate because project bc2a968d44914bf198115edd6b45a336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:39.620878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:39.623317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:39.627713 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3856/7797] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:39 2022] DELETE /identity/v3/projects/bc2a968d44914bf198115edd6b45a336 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:39.628730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:39.631747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:39.664010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a88204c242b4ea8921be80a1bdfdf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a51f428187b3496b897ace71da0754e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:39.665243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:39.665530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:39.665807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:39.666526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:39.668424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:39.669937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:39.700512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3942/7798] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:39.707250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:39.709267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:39.762095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ba6e-4945-4eb8-9775-d5413be5a315 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:39.776098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9788666-79b6-44d7-b2f3-1f32ed6f321f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:39.779173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a88204c242b4ea8921be80a1bdfdf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a51f428187b3496b897ace71da0754e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:39.779704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:39.779993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:39.780272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:39.781004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:39.787000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:39.792621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:39.793990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:39.794465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:39.795286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] PATH_INFO: `/v3/users/c3e4be76550942478459cd632b8b5263` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:39.797638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e4be76550942478459cd632b8b5263)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:39.799988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:39.854246 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3943/7799] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:39 2022] POST /identity/v3/projects => generated 347 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:39.861641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:39.966772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e4be76550942478459cd632b8b5263'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:40.010403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e4be76550942478459cd632b8b5263'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:40.012354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e4be76550942478459cd632b8b5263'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:40.041703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e4be76550942478459cd632b8b5263'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:40.061118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e932ff-b341-4525-97f4-3313806a6c88 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:40.061471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e4be76550942478459cd632b8b5263'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:40.072306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a88204c242b4ea8921be80a1bdfdf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a51f428187b3496b897ace71da0754e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:40.073692 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3857/7800] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:39 2022] DELETE /identity/v3/users/c3e4be76550942478459cd632b8b5263 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:40.073832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:40.073832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:40.073832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:40.074294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:40.074609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:40.083768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:40.112899 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3944/7801] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:40.919001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:40.922267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:40.994817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.002368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.021678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33a4f-75d0-477a-96ed-21dc12c7bfbc tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.095981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181667-c75b-4893-823b-b3ae372a175e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.103870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.105295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.105750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.106587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] PATH_INFO: `/v3/projects/115541332cfa419a96e6846a9d989bf1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.109382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115541332cfa419a96e6846a9d989bf1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.111913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.132319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a88204c242b4ea8921be80a1bdfdf7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a51f428187b3496b897ace71da0754e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.138472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.139375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.139885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] PATH_INFO: `/v3/projects/abc824af43994f5fb0acc5504b93a833` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.141864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abc824af43994f5fb0acc5504b93a833)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.144074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.182194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115541332cfa419a96e6846a9d989bf1', 'request_id': 'req-c995c75e-4b41-438a-b502-c4e32d89c3f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.189619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115541332cfa419a96e6846a9d989bf1', 'request_id': 'req-c995c75e-4b41-438a-b502-c4e32d89c3f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.196401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115541332cfa419a96e6846a9d989bf1', 'request_id': 'req-c995c75e-4b41-438a-b502-c4e32d89c3f6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.213585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] The token cache is being invalidate because project 115541332cfa419a96e6846a9d989bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:41.213790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.214442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.215999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3858/7802] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:40 2022] DELETE /identity/v3/projects/115541332cfa419a96e6846a9d989bf1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:41.221554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.223215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.226217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc824af43994f5fb0acc5504b93a833', 'request_id': 'req-c4f359b0-3558-4f41-8d6c-d23ace72d040'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.236996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc824af43994f5fb0acc5504b93a833', 'request_id': 'req-c4f359b0-3558-4f41-8d6c-d23ace72d040'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.246890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc824af43994f5fb0acc5504b93a833', 'request_id': 'req-c4f359b0-3558-4f41-8d6c-d23ace72d040'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.259269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] The token cache is being invalidate because project abc824af43994f5fb0acc5504b93a833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:41.259652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.260238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c4f359b0-3558-4f41-8d6c-d23ace72d040 tempest-RoutersAdminTest-1977301943 tempest-RoutersAdminTest-1977301943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:41.263529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3945/7803] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:40 2022] DELETE /identity/v3/projects/abc824af43994f5fb0acc5504b93a833 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:41.267281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.267589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.267908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.289333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:41.293690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.317309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c75e-4b41-438a-b502-c4e32d89c3f6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.372712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3946/7804] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:41.373792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.375145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.387178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.388717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.389404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.389860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.393257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.421006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.428636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e138-8cd6-4652-bc9d-1d3f886fe3d1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.458359 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3859/7805] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:41.472988 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.473224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.473500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.499029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12f15b-8a69-48f7-aecd-b194f67f582c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.503839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.505056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.505772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.506430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.507428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:41.509733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.518975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:41.556049 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3860/7806] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:41.574149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.584421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3c9a6-b1c0-4f5e-a25a-d308c963ec0a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.589838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.590511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.590792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.591066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.591796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:41.592093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.594154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.608506 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3861/7807] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:41.612514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.626200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885fcb-4599-406f-8723-f8b9bf61b45d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.632350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.633187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.719500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.719500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.719500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.719500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.720915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.721078 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3862/7808] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:41 2022] POST /identity/v3/projects => generated 395 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:41.721147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.721294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.721353 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3947/7809] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:41.794266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429fe8d-17f0-43de-a66b-11f145c72a02 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.809873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.810751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.811047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.811330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.812023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.815234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.840091 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3863/7810] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:41 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:41.843914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.860546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e126a-62e6-4e43-b3dc-983fc1ceb72c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.872899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.874661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.875081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.875270 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.875937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.879508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.927672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3948/7811] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:41.928946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:41.947655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a52e4-22f2-4d19-ae61-7a3a827c829e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:41.959847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:41.962928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:41.963398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:41.963821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:41.964778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:41.967911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34800e78-65d0-410f-9073-90d2371d8938 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:41.996819 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3864/7812] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:41.999737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.015261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef844c8-4c82-41f4-b6f5-d81c88d2a247 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.033414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.040706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.041131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.041508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] PATH_INFO: `/v3/projects/2a3b73559cb047b186990f7963b0415b/users/d04da91927174ca9bb39fab767fd7614/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.084222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a3b73559cb047b186990f7963b0415b, user_id=d04da91927174ca9bb39fab767fd7614, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.090758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.146714 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3949/7813] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:41 2022] PUT /identity/v3/projects/2a3b73559cb047b186990f7963b0415b/users/d04da91927174ca9bb39fab767fd7614/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:42.159200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.159813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.160363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.168082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.175876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.222258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] MFA Rules not processed for user `d04da91927174ca9bb39fab767fd7614`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:42.223481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.260222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7bb4e-5f64-4aea-8901-f19b13ce927d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.269346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.271313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.272231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.272678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] PATH_INFO: `/v3/users/fb59fadcc1574a1396fe57c717087461` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.274624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb59fadcc1574a1396fe57c717087461)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.279030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.312510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3865/7814] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:42.326412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.350719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb59fadcc1574a1396fe57c717087461'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.360247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb59fadcc1574a1396fe57c717087461'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.361162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb59fadcc1574a1396fe57c717087461'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.362064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb59fadcc1574a1396fe57c717087461'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.371271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bab998fa-8855-4a77-87a8-8f56784b1b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb59fadcc1574a1396fe57c717087461'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.392547 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3950/7815] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:42 2022] DELETE /identity/v3/users/fb59fadcc1574a1396fe57c717087461 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:42.397626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.397931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.398217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.420645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d54ac0-3901-42df-b2a5-bfdbfa3fa20b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.429850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:42.434389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.480294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.481346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.482243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.482699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.484904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.551383 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3951/7816] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:42.559725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.563276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.572197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.574556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.592921 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3866/7817] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:42.593390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b093ff-a1ef-460e-b483-71622703a66e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.593805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.595449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.598281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.599332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.599635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.599918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.612173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.612524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ffa15-87f3-4bf6-8c34-96bdbe470ce3 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.615439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.618192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.619237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.619623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.620001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] PATH_INFO: `/v3/users/ece3f0bfe8294cdba77f8fe0e429f06d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.621858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece3f0bfe8294cdba77f8fe0e429f06d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.624120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.637515 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3952/7818] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:42.675678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.677501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.684268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece3f0bfe8294cdba77f8fe0e429f06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.696632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37eee0e-d319-4224-a474-1e3ca5f7d29c service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.702512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece3f0bfe8294cdba77f8fe0e429f06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.703545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:42.703694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece3f0bfe8294cdba77f8fe0e429f06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.704680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:42.705051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:42.705483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] PATH_INFO: `/v3/users/08aca3700d594a349789d5f3847894dc` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:42.707101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08aca3700d594a349789d5f3847894dc)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:42.709284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:42.715076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece3f0bfe8294cdba77f8fe0e429f06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.723197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece3f0bfe8294cdba77f8fe0e429f06d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.735803 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3867/7819] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:42 2022] DELETE /identity/v3/users/ece3f0bfe8294cdba77f8fe0e429f06d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:42.763927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08aca3700d594a349789d5f3847894dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.785834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08aca3700d594a349789d5f3847894dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.786868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08aca3700d594a349789d5f3847894dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.787869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08aca3700d594a349789d5f3847894dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.812444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08aca3700d594a349789d5f3847894dc'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:42.820982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.822467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:42.853086 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3953/7820] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:42 2022] DELETE /identity/v3/users/08aca3700d594a349789d5f3847894dc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:42.911950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290c90-4b67-4016-9168-068e9a821e15 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:42.955952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:42.957607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.004832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.005617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.006006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.006397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.008984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.025763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.027648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.043926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3868/7821] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:43.045389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d32d0-f6bd-41c5-b2d1-5ecf1c0b1d9d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:43.050904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.051364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.051640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.051916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] PATH_INFO: `/v3/projects/6dcd60b7072543dc834451d5898d67e3` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.053254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dcd60b7072543dc834451d5898d67e3)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.055557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.115940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dcd60b7072543dc834451d5898d67e3', 'request_id': 'req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.124318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dcd60b7072543dc834451d5898d67e3', 'request_id': 'req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.138642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dcd60b7072543dc834451d5898d67e3', 'request_id': 'req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.153967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] The token cache is being invalidate because project 6dcd60b7072543dc834451d5898d67e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:43.154759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.158864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.163625 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3954/7822] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:42 2022] DELETE /identity/v3/projects/6dcd60b7072543dc834451d5898d67e3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:43.165783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:43.185972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8ed05-66b4-47b9-8b35-c02a25552328 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:43.270561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:43.272204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.288128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.289309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.289833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.290208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] PATH_INFO: `/v3/users/6115d2391b38410da48cf3df74776b6b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.292109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6115d2391b38410da48cf3df74776b6b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.294562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.358863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6115d2391b38410da48cf3df74776b6b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.368815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef86f2-1ef2-4b86-bbec-fc7a9626f6b9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:43.374504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.375529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.375834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6115d2391b38410da48cf3df74776b6b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.375932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.376371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] PATH_INFO: `/v3/projects/65522f00c7b643fd849d71d36811c75c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.376792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6115d2391b38410da48cf3df74776b6b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.377686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65522f00c7b643fd849d71d36811c75c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.379789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.385337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6115d2391b38410da48cf3df74776b6b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.393970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6115d2391b38410da48cf3df74776b6b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.402395 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3869/7823] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:43 2022] DELETE /identity/v3/users/6115d2391b38410da48cf3df74776b6b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:43.446812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65522f00c7b643fd849d71d36811c75c', 'request_id': 'req-f7f90799-92c9-4f51-af3a-0819fc273ad0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.457652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65522f00c7b643fd849d71d36811c75c', 'request_id': 'req-f7f90799-92c9-4f51-af3a-0819fc273ad0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.467967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65522f00c7b643fd849d71d36811c75c', 'request_id': 'req-f7f90799-92c9-4f51-af3a-0819fc273ad0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.480236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] The token cache is being invalidate because project 65522f00c7b643fd849d71d36811c75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:43.480701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.481365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.485890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3955/7824] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:43 2022] DELETE /identity/v3/projects/65522f00c7b643fd849d71d36811c75c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:43.486955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:43.488435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.572575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:43.574800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.632394 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e38d58-9164-43a4-a44f-d32a922b7bee admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:43.689574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90799-92c9-4f51-af3a-0819fc273ad0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:43.698318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.699422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.699853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.700273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] PATH_INFO: `/v3/projects/b5fe471f4a924fd98ef24aa24abb736c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.703812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fe471f4a924fd98ef24aa24abb736c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.706738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.755191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:43.756088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.756860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.757158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] PATH_INFO: `/v3/users/9f5cd01b28c94b5da77c583621e23064` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.759275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5cd01b28c94b5da77c583621e23064)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:43.761186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:43.803250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fe471f4a924fd98ef24aa24abb736c', 'request_id': 'req-8787fe25-599d-4537-87a8-6c86257382a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.815475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fe471f4a924fd98ef24aa24abb736c', 'request_id': 'req-8787fe25-599d-4537-87a8-6c86257382a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.828510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fe471f4a924fd98ef24aa24abb736c', 'request_id': 'req-8787fe25-599d-4537-87a8-6c86257382a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.833610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5cd01b28c94b5da77c583621e23064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.848642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] The token cache is being invalidate because project b5fe471f4a924fd98ef24aa24abb736c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:43.851341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.851539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5cd01b28c94b5da77c583621e23064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.853230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8787fe25-599d-4537-87a8-6c86257382a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.855036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5cd01b28c94b5da77c583621e23064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.863102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3956/7825] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:43 2022] DELETE /identity/v3/projects/b5fe471f4a924fd98ef24aa24abb736c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:43.867285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5cd01b28c94b5da77c583621e23064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.872278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791532-3fa7-446c-b10b-3b8b0c53a9fa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:43.872666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791532-3fa7-446c-b10b-3b8b0c53a9fa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:43.873951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791532-3fa7-446c-b10b-3b8b0c53a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:43.878863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5cd01b28c94b5da77c583621e23064'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:43.885849 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3870/7826] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:43 2022] DELETE /identity/v3/users/9f5cd01b28c94b5da77c583621e23064 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:43.901700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-31791532-3fa7-446c-b10b-3b8b0c53a9fa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:43.903014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-31791532-3fa7-446c-b10b-3b8b0c53a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:43.957192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:43.958923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.015910 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3957/7827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:44.017656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.017956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.018240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.052741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:44.054863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.072928 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3958/7828] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:44.076681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.088557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f590ab-9950-4ca6-a5b7-1db41f8a1bca None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.095627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.096523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.096733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f39e5-4b39-4858-9e7b-09526ca4b66d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.097206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.097708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.098220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:44.098655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.100681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.102509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.103399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.103685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.103966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] PATH_INFO: `/v3/projects/13d8cf54919443c4b6a9643a9a5cde04` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.105881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d8cf54919443c4b6a9643a9a5cde04)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.108237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.116508 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3959/7829] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:44.120128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.131012 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa83a5-239c-431c-904b-1d2a74647c7c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.136004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.136825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.137385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.137763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.138935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.140967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.168442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d8cf54919443c4b6a9643a9a5cde04', 'request_id': 'req-8b0adc10-6f6a-4f10-b248-9ada31d75f64'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:44.178657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d8cf54919443c4b6a9643a9a5cde04', 'request_id': 'req-8b0adc10-6f6a-4f10-b248-9ada31d75f64'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:44.188680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d8cf54919443c4b6a9643a9a5cde04', 'request_id': 'req-8b0adc10-6f6a-4f10-b248-9ada31d75f64'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:44.197713 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3960/7830] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:44.202407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.218046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] The token cache is being invalidate because project 13d8cf54919443c4b6a9643a9a5cde04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:44.218377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:44.219087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8b0adc10-6f6a-4f10-b248-9ada31d75f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:44.224868 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3871/7831] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:43 2022] DELETE /identity/v3/projects/13d8cf54919443c4b6a9643a9a5cde04 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:44.226518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3314-ba84-4771-8617-cd61bd4b73ce None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.226815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3314-ba84-4771-8617-cd61bd4b73ce None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.227670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3314-ba84-4771-8617-cd61bd4b73ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.259788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a99d3314-ba84-4771-8617-cd61bd4b73ce None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:44.261066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a99d3314-ba84-4771-8617-cd61bd4b73ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.378104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a8cfc-e958-46a0-af3c-820b9878d161 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.388629 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3872/7832] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:44.422159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.422883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.423180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.423470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.424181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.443942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.492891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.493194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.493449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.504326 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3961/7833] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:44.505490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.507364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.524939 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f8a5-5d8d-4f72-aba6-bef1c2194de3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.527775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:44.529058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.530606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.531418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.531812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.532196 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.533108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.535739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.549721 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3962/7834] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:44.550537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3873/7835] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:44.554326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.561899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.573550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a5f31-bae2-4094-828a-773ac75316bf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.581304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d6ed-bba8-41b6-a0c1-64c20fcf6904 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.588306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.589193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.595205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.596156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.597280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.598822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.598822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.598822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.600248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.600776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.602062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:44.602062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.606870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.622588 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3874/7836] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:44.627533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.630362 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3963/7837] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:44.634976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.641267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f84d-bab1-4363-b9a4-d94be34e6dfe admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.649495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686be72-ff82-4ba1-bcfe-6b14ea5d4f40 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.650574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.652422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.652912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.653329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] PATH_INFO: `/v3/projects/8c67d04af96d45f995da597f3f678014/users/c87f4a9a2f5a4c9d831ca26b8bc91f17/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.655559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.656955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.657360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.657748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.658561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.660692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.676928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c67d04af96d45f995da597f3f678014, user_id=c87f4a9a2f5a4c9d831ca26b8bc91f17, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.682303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b43f0-5e3c-4765-991f-a8bf59f75724 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.694943 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3964/7838] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:44.700973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.708746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3875/7839] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:44 2022] PUT /identity/v3/projects/8c67d04af96d45f995da597f3f678014/users/c87f4a9a2f5a4c9d831ca26b8bc91f17/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:44.719899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.720433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.720879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.756326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] MFA Rules not processed for user `c87f4a9a2f5a4c9d831ca26b8bc91f17`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:44.757979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:44.803551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3e9f7-da12-4bc4-aa0a-12a52a3e142c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.853443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3876/7840] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:44.858130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.880785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.881848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.882322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.882898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.884483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.886896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.936864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3965/7841] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:44.939334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:44.949512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d712a8-3dd1-4012-b6cd-d166488ce9f5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:44.958775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:44.959610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:44.959992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:44.960940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:44.964327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:44.965211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:44.976422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4db21d-6e9f-4235-88b9-a8b58e3c3484 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.004656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3877/7842] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:44 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:45.004858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.006865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.007502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.007793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.008720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.009860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.016424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.025030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.047456 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3966/7843] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:45.049178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.095186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d0814-1892-461e-8a49-b671b626edaa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.167301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.167988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.168307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.169590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.170726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.173554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.195241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b0f47-262b-429e-b6eb-4668b2c60d04 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.208824 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3967/7844] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:45.210135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.211044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.211271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.211389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.211701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] PATH_INFO: `/v3/projects/2ab6c820518f4e7591742edd357e230d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.213232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab6c820518f4e7591742edd357e230d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.219556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.223108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feae1f-997a-498b-a28a-0d7edccebcc4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.229904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.230998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.230998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.231158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.231878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.233590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.249882 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3968/7845] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:45.250814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.266379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b684195-bc90-4941-8b36-b70eaa6bf5e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.271537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.272227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.272560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.272847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.273607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.275483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.291400 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3969/7846] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:45.291400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.313421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c393c6-a6d3-4146-bf27-af87933cdd83 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.340648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab6c820518f4e7591742edd357e230d', 'request_id': 'req-2a206475-bce1-482e-8ab0-ea94f36470c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:45.350985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab6c820518f4e7591742edd357e230d', 'request_id': 'req-2a206475-bce1-482e-8ab0-ea94f36470c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:45.368489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab6c820518f4e7591742edd357e230d', 'request_id': 'req-2a206475-bce1-482e-8ab0-ea94f36470c6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:45.397490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] The token cache is being invalidate because project 2ab6c820518f4e7591742edd357e230d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:45.397857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:45.398771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:45.402581 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3878/7847] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:45 2022] DELETE /identity/v3/projects/2ab6c820518f4e7591742edd357e230d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:45.406576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.409637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.422660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.424523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.425197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.425685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] PATH_INFO: `/v3/projects/7c63afebe86f46e8b16647d8eda2cfb9/users/fb1ba274f1104befa1bd14c95525c3ab/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.446650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c63afebe86f46e8b16647d8eda2cfb9, user_id=fb1ba274f1104befa1bd14c95525c3ab, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.451276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ea008-ea61-4334-b890-95ac982f88c4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.459090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a206475-bce1-482e-8ab0-ea94f36470c6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.471421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.472445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.473942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.476082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] PATH_INFO: `/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a/users/2f4699b061734ae6b846fbb238a45b29/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.480485 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3970/7848] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:45 2022] PUT /identity/v3/projects/7c63afebe86f46e8b16647d8eda2cfb9/users/fb1ba274f1104befa1bd14c95525c3ab/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:45.489359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.489359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.489359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.514194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce69b144575d48ca9fdf5f7a55a2f43a, user_id=2f4699b061734ae6b846fbb238a45b29, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.517327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e298a09-0174-411c-9a7e-aa895a5b2b11 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.518510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:45.520129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.538812 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3879/7849] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:45 2022] PUT /identity/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a/users/2f4699b061734ae6b846fbb238a45b29/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:45.541342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e6a0f-8e7d-408c-ae0b-ef2a8f4d7a3a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.541859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e6a0f-8e7d-408c-ae0b-ef2a8f4d7a3a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.542788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e6a0f-8e7d-408c-ae0b-ef2a8f4d7a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.578711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9d6e6a0f-8e7d-408c-ae0b-ef2a8f4d7a3a None None] MFA Rules not processed for user `fb1ba274f1104befa1bd14c95525c3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:45.585864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9d6e6a0f-8e7d-408c-ae0b-ef2a8f4d7a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.613673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3971/7850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:45.621744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.638171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2fff4-1257-45fb-97f0-84db2a303f94 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.687393 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3880/7851] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:45.687393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.687393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.687393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.707346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:45.708625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.750855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.752074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.752255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.752549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.756425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.758126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.778613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3972/7852] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:45.778613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.783850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:45.810122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c98e1-00b8-4aae-b24b-4e9aa08323d5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.821409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.822344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.822574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.822790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.823529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.825508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.834124 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3881/7853] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:45.836925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.876256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5546b5-2783-4afc-8002-2bcef9c1cf23 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:45.878967 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3973/7854] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:45.882844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:45.896935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:45.897860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:45.898223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:45.898553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] PATH_INFO: `/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a/users/2f4699b061734ae6b846fbb238a45b29/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:45.907192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce69b144575d48ca9fdf5f7a55a2f43a, user_id=2f4699b061734ae6b846fbb238a45b29, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:45.914192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:45.934476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3882/7855] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:45 2022] PUT /identity/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a/users/2f4699b061734ae6b846fbb238a45b29/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:45.945737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.028192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef80a8-165c-458a-a7b0-e8b30e5530eb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.035541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.036379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.036799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.037237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.037992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:46.038307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.039018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974d52-2a46-420e-a20c-8437e496dbb9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.040820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be887fc-79cc-4485-be69-bc08fe517e48 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.046575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.048497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.048787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.049068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.050102 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.053068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.066881 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3974/7856] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:46.068412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.068796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.069249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.085256 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3883/7857] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:45 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:46.088837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.109225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] MFA Rules not processed for user `2f4699b061734ae6b846fbb238a45b29`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:46.110568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:46.122991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5faa9-8369-477d-9828-ee9963d6849a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.135474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.136818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.136818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.136818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.137405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.139589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.188500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3884/7858] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:46 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:46.188500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.254652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3975/7859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:46.255742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.277773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248c66-769c-4513-ba24-d8cf11c7315f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.326080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b0c7c-481d-467e-a22f-a69d771d0785 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.333492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.334712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.335276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.335551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.337346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.339283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.352736 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3885/7860] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:46.354281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.357289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:46.402360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.403343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.403633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.405110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.406157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.408936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.440635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3976/7861] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:46 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:46.441455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.464184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556ca1-66f2-4dcb-b791-46ee2f9d3939 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.481384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.482477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.482905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.483480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] PATH_INFO: `/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0/users/e6e90de75bb84dc1b57a68306c854fc9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.491730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54adb0-3609-4d12-98fc-305189c4079f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.500592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.501576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.502135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.502633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.503992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0ee664e09941108231c2b4c4a4f0e0, user_id=e6e90de75bb84dc1b57a68306c854fc9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.505054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:46.506876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.551590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3977/7862] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:46 2022] PUT /identity/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0/users/e6e90de75bb84dc1b57a68306c854fc9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:46.551590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.596900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.598531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.610354 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3886/7863] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:46.611258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.632575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a7849-b513-4d1a-bddc-08ddb7b69d91 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.679446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61aa19-74e0-4ce3-b0ee-dc044ec6567c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.692272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.693067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.693352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.693629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.694498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.696158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.712084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.713181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.713756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.714710 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.715624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.716898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3978/7864] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:46.718911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.721654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.734388 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3887/7865] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:46.739787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.742384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9a99-8e40-42aa-bd38-dc5d43823a1b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.757542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04995-604e-4d44-af3a-06eb9eb515d4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.763452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.765365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.766406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.766681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.767087 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.767425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.767694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.767898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] PATH_INFO: `/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0/users/e6e90de75bb84dc1b57a68306c854fc9/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.768928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.770985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0ee664e09941108231c2b4c4a4f0e0, user_id=e6e90de75bb84dc1b57a68306c854fc9, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:46.771758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.774402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a83a-6e04-457a-8758-daad49372aa1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:46.790465 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3888/7866] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:46 2022] PUT /identity/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0/users/e6e90de75bb84dc1b57a68306c854fc9/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:46.802040 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3979/7867] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:46.802559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.803006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.803434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:46.806134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:46.819107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7fe97-5bac-4a4c-9492-cb9b387c7415 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:46.880529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] MFA Rules not processed for user `e6e90de75bb84dc1b57a68306c854fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:46.882072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:46.964824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:46.968314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:46.968673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:46.972538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] PATH_INFO: `/v3/projects/56d6527a4afc4707b73eec6694d9abe0/users/6614a53d1e604a958018b23792ee4102/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.026807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d6527a4afc4707b73eec6694d9abe0, user_id=6614a53d1e604a958018b23792ee4102, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.030683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec4b95-8d1a-49ba-9242-cdb09b090acd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.050229 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3980/7868] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:46 2022] PUT /identity/v3/projects/56d6527a4afc4707b73eec6694d9abe0/users/6614a53d1e604a958018b23792ee4102/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:47.060638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.061093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.061440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.065524 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3889/7869] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:47.080378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.082669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:47.145643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] MFA Rules not processed for user `6614a53d1e604a958018b23792ee4102`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:47.147785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:47.211759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf76f24-f500-47b0-9bdb-4a15e39f597a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.304769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.306374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.306374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.306374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.310163 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3981/7870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:47.310523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.401925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.403506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.416402 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3890/7871] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:47.444076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d002b3-7564-4d9f-99ac-c384aab5127d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.451210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.452182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.452700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.453282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.454742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.460311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.507997 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3982/7872] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:47 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:47.514626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.556542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70844f9-6e1c-4a0d-842d-44c653266ff1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.662624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.663623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.664055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.664631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.665885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.671015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.732768 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3891/7873] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:47 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:47.736719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.751557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b2655-2e4e-4c9f-a6bb-6f15f52066ee admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.762330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.763969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.764278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.764612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.765521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.767347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.785234 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3983/7874] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:47.788987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.802516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123a221-7dc1-4aac-9ed3-857bbe981895 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.812250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.813325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.813759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.814179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.815116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.817258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110508b-0eef-4bbd-abc0-cd9c7dd1948d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.837231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3892/7875] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:47.841377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:47.854741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee68e2-aa35-4559-ac46-bdd44c8c002a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:47.860093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:47.861244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.861388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.861731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] PATH_INFO: `/v3/projects/c099aa871bf343f8b05c11c5415d9542/users/2994da01171e43d3a35aab6f32cfd856/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:47.906612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c099aa871bf343f8b05c11c5415d9542, user_id=2994da01171e43d3a35aab6f32cfd856, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:47.910795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:47.959794 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3984/7876] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:47 2022] PUT /identity/v3/projects/c099aa871bf343f8b05c11c5415d9542/users/2994da01171e43d3a35aab6f32cfd856/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:47.971040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:47.971040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:47.971040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.034261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] MFA Rules not processed for user `2994da01171e43d3a35aab6f32cfd856`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:48.035544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:48.224537 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3893/7877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:48.228866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:48.437516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981a5c-83a2-4653-ab19-c97f9852a745 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:48.467984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:48.470495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:48.470797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:48.471997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.473609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:48.476046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:48.486486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:48.491358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:48.536545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3985/7878] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:48 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:48.538859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:48.653445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9671c-07dc-4185-acb3-b2953dca0f18 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:48.703852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fe5b3-ae14-4911-ac31-e5df4e5e5669 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:48.717411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:48.720058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:48.721301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:48.722050 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.723870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:48.729310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:48.777937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3986/7879] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:48 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:48.779513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:48.798337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:48.799598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:48.800848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:48.801934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.804251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131440a-2ace-4917-b911-686e64952b1a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:48.807767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:48.815597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:48.817876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:48.819259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:48.819685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.822440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:48.825415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:48.838280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:48.842682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:48.854792 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3987/7880] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:48.859484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:48.890890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3894/7881] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:19:48.900574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd79d2-6528-4b47-ad8d-62c40adac613 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:48.910742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:48.911946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:48.912398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:48.912823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] PATH_INFO: `/v3/projects/fcd55c057d8549e99163994b8f3c36ed/users/dbb1afdc0e0042b98786c0e867bade63/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:48.938480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd55c057d8549e99163994b8f3c36ed, user_id=dbb1afdc0e0042b98786c0e867bade63, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:48.946251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:48.999108 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3988/7882] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:48 2022] PUT /identity/v3/projects/fcd55c057d8549e99163994b8f3c36ed/users/dbb1afdc0e0042b98786c0e867bade63/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:49.003309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:49.019387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2662f24-789d-4db7-b7ce-0bfcbc526c5b service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:49.087034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:49.087892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:49.088281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:49.088696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:49.089530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:49.091253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e0aa-de3f-4fc8-99f2-28f0a1eb1fec admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:49.114546 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3895/7883] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:19:49.119019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:49.130192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc5bf-f231-4d64-96c7-757c87f53940 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:49.147061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:49.147971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:49.148408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:49.149307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] PATH_INFO: `/v3/projects/fcd55c057d8549e99163994b8f3c36ed/users/dbb1afdc0e0042b98786c0e867bade63/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:49.156377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd55c057d8549e99163994b8f3c36ed, user_id=dbb1afdc0e0042b98786c0e867bade63, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:49.159161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:49.196253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3989/7884] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:49 2022] PUT /identity/v3/projects/fcd55c057d8549e99163994b8f3c36ed/users/dbb1afdc0e0042b98786c0e867bade63/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:49.208683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:49.213269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:49.213882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:49.247535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] MFA Rules not processed for user `dbb1afdc0e0042b98786c0e867bade63`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:49.249099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:49.387926 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3896/7885] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:49.395522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:49.399348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:49.545507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d58e0d-0613-4556-b9a7-b13b55c7e1a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:49.550126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:49.551068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:49.551353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:49.551710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:49.564272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:49.565918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:49.578461 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3990/7886] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:49.627415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:49.628258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:49.646275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e34d0e-d133-4a07-b4a2-e594d0126c4e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:49.651076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:49.651741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:49.652030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:49.652361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:49.730345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:49.732811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:49.745872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3897/7887] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:53.256695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:53.268560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:53.315228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:53.422162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d459b58-1cd8-4faa-ae07-7aa85d01256c service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:53.427095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:53.427882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:53.428261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:53.428592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:53.451966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18336d9-71da-4e15-b6ab-ee9a6432fe41 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:53.460947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:53.462696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:53.463156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:53.463603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] PATH_INFO: `/v3/users/6614a53d1e604a958018b23792ee4102` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:53.465903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6614a53d1e604a958018b23792ee4102)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:53.471072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:53.546722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:53.548343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cccd6-6d98-474b-91a2-356b11de7531 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:53.560903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3991/7888] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:53.586833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6614a53d1e604a958018b23792ee4102'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:53.613436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6614a53d1e604a958018b23792ee4102'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:53.621023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6614a53d1e604a958018b23792ee4102'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:53.644439 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6614a53d1e604a958018b23792ee4102'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:53.668418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6614a53d1e604a958018b23792ee4102'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:53.692176 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3898/7889] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:53 2022] DELETE /identity/v3/users/6614a53d1e604a958018b23792ee4102 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:53.694032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:53.694379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:53.694668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:53.734076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:53.736057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:53.882846 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3992/7890] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:53.906302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:53.908869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:54.085162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c60298-1d51-4870-b202-0c50223b4f3e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:54.100440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:54.101527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:54.102497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:54.102935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:54.122166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:54.127014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:54.159411 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3899/7891] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:55.053317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:55.055337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:55.077352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71099068-6e53-4a37-a9fb-fca8904a0db6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:55.095289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:55.096428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:55.096908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:55.097314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] PATH_INFO: `/v3/projects/56d6527a4afc4707b73eec6694d9abe0` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:55.106062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d6527a4afc4707b73eec6694d9abe0)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:55.108679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:55.258891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d6527a4afc4707b73eec6694d9abe0', 'request_id': 'req-6241e659-3e2f-46cc-9c58-ed73618dfd9b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.273755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d6527a4afc4707b73eec6694d9abe0', 'request_id': 'req-6241e659-3e2f-46cc-9c58-ed73618dfd9b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.287989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d6527a4afc4707b73eec6694d9abe0', 'request_id': 'req-6241e659-3e2f-46cc-9c58-ed73618dfd9b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.307743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] The token cache is being invalidate because project 56d6527a4afc4707b73eec6694d9abe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:55.308098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.309232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.312808 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3993/7892] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:55 2022] DELETE /identity/v3/projects/56d6527a4afc4707b73eec6694d9abe0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:55.316619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:55.328772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f0c8-c91c-4c80-a894-2318c23c557a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:55.370152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:55.371925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:55.443107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:55.444315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:55.448408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:55.448958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] PATH_INFO: `/v3/users/2994da01171e43d3a35aab6f32cfd856` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:55.456571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2994da01171e43d3a35aab6f32cfd856)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:55.459811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:55.509249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241e659-3e2f-46cc-9c58-ed73618dfd9b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:55.522317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:55.525485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:55.525802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:55.526090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:55.535693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:55.550743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2994da01171e43d3a35aab6f32cfd856'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.581804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2994da01171e43d3a35aab6f32cfd856'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.585393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2994da01171e43d3a35aab6f32cfd856'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.606056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2994da01171e43d3a35aab6f32cfd856'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.618913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2994da01171e43d3a35aab6f32cfd856'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:55.633989 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3900/7893] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:55 2022] DELETE /identity/v3/users/2994da01171e43d3a35aab6f32cfd856 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:55.691080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:55.692617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:55.720873 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3994/7894] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:19:56.190875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:56.192390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:56.283456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85782a73-5d51-432f-9347-4ea3fdce1fc9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:56.290587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:56.292160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:56.292469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:56.292773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] PATH_INFO: `/v3/projects/c099aa871bf343f8b05c11c5415d9542` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:56.294430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c099aa871bf343f8b05c11c5415d9542)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:56.297038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:56.391739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c099aa871bf343f8b05c11c5415d9542', 'request_id': 'req-1c956cc4-003a-4907-ab59-4e339b59f84c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.400282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c099aa871bf343f8b05c11c5415d9542', 'request_id': 'req-1c956cc4-003a-4907-ab59-4e339b59f84c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.406601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c099aa871bf343f8b05c11c5415d9542', 'request_id': 'req-1c956cc4-003a-4907-ab59-4e339b59f84c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.428024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] The token cache is being invalidate because project c099aa871bf343f8b05c11c5415d9542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:56.428320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.429169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.434673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3901/7895] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:56 2022] DELETE /identity/v3/projects/c099aa871bf343f8b05c11c5415d9542 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:56.435867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:56.437739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:56.456648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986941ff-455f-4e35-abcb-f28b7eb0425f service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:56.562962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:56.564023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:56.564364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:56.564742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] PATH_INFO: `/v3/users/dbb1afdc0e0042b98786c0e867bade63` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:56.566070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb1afdc0e0042b98786c0e867bade63)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:56.569500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:56.678383 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb1afdc0e0042b98786c0e867bade63'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.692136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb1afdc0e0042b98786c0e867bade63'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.692906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb1afdc0e0042b98786c0e867bade63'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.693591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb1afdc0e0042b98786c0e867bade63'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.704929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3297fb17-73c8-4f28-9137-a79b31ead833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb1afdc0e0042b98786c0e867bade63'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:56.744607 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3995/7896] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:19:56 2022] DELETE /identity/v3/users/dbb1afdc0e0042b98786c0e867bade63 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:57.555380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:57.557072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:57.574750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c956cc4-003a-4907-ab59-4e339b59f84c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:57.701205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:57.702367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:57.704690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:57.706085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] PATH_INFO: `/v3/projects/fcd55c057d8549e99163994b8f3c36ed` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:57.710337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd55c057d8549e99163994b8f3c36ed)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:57.722953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:57.834414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd55c057d8549e99163994b8f3c36ed', 'request_id': 'req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:57.846861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd55c057d8549e99163994b8f3c36ed', 'request_id': 'req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:57.855736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd55c057d8549e99163994b8f3c36ed', 'request_id': 'req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:57.887044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] The token cache is being invalidate because project fcd55c057d8549e99163994b8f3c36ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:19:57.889396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:57.891993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ed026e35-e0bd-4d54-a26d-5a0423c2ea58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:19:57.899225 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3902/7897] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:19:57 2022] DELETE /identity/v3/projects/fcd55c057d8549e99163994b8f3c36ed => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:19:57.906206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:57.907116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:57.907607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:57.934194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:57.935747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:58.059586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.060488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.060644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.069006 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3996/7898] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:58.098171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:58.099431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:58.123470 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3903/7899] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:19:58.132892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.146154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8f90-b8fa-4d4a-8617-eb7ff93d966f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.151620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.152353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.152918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.153213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.154659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:19:58.154986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.156724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.176763 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3997/7900] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:19:58.177447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.191786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742709ae-7c8b-48d4-afa5-5cde437a8f13 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.206083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.207036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.207526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.207979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.208919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.211836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.270083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3904/7901] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:19:58.274925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.292473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b3fb-0b63-4c37-b81b-fb8fd8f9ed33 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.392488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.393713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.394212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.394721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.395617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.398809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.434218 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3998/7902] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:19:58 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:19:58.438387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.458752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c97f-d1ac-4ca6-8a7d-89cd49904246 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.465709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.467206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.467580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.467939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.468989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.472169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.495591 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3905/7903] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:58.499142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.517936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9834f8-e808-4d22-9b1a-6cbaeb295b65 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.547108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.548132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.548677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.549147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.551469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.554925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c644d-1938-40d5-b615-90fa513b4ef4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.576206 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 3999/7904] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:19:58.579968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.591275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe6c6e-43ec-4259-8a42-2dd39b89290b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.596292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.597275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.597555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.597842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] PATH_INFO: `/v3/projects/9b9d8ddc7a19411fa1f94d56527093ac/users/1da0c37af68c4d3fbdec14ca1a86f56e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.616004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d8ddc7a19411fa1f94d56527093ac, user_id=1da0c37af68c4d3fbdec14ca1a86f56e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.619384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.638608 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3906/7905] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:19:58 2022] PUT /identity/v3/projects/9b9d8ddc7a19411fa1f94d56527093ac/users/1da0c37af68c4d3fbdec14ca1a86f56e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:19:58.650994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.651285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.652131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.678625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] MFA Rules not processed for user `1da0c37af68c4d3fbdec14ca1a86f56e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:19:58.680719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:58.754772 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4000/7906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:19:58.766928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:19:58.768848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:19:58.836442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd730530-6a2d-49fa-b4eb-7c7467239ef8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:19:58.841676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:19:58.842431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:19:58.843013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:19:58.843212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:19:58.855482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:19:58.857242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd6045-90ee-4778-a968-36740db36ae5 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:19:58.868894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3907/7907] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:19:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:03.120486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:03.309945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa7f07-44cd-43d4-a443-75eee098fe4b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:03.327212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:03.328390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:03.328882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:03.333381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] PATH_INFO: `/v3/users/1da0c37af68c4d3fbdec14ca1a86f56e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:03.334980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da0c37af68c4d3fbdec14ca1a86f56e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:03.338339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:03.456872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da0c37af68c4d3fbdec14ca1a86f56e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:03.511345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da0c37af68c4d3fbdec14ca1a86f56e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:03.512223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da0c37af68c4d3fbdec14ca1a86f56e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:03.513010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da0c37af68c4d3fbdec14ca1a86f56e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:03.524309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da0c37af68c4d3fbdec14ca1a86f56e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:03.569672 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4001/7908] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:03 2022] DELETE /identity/v3/users/1da0c37af68c4d3fbdec14ca1a86f56e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:03.574546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2069ef-9bb3-4732-a399-f3f833399027 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:03.575072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2069ef-9bb3-4732-a399-f3f833399027 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:03.575425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2069ef-9bb3-4732-a399-f3f833399027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:03.614805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7f2069ef-9bb3-4732-a399-f3f833399027 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:03.616071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f2069ef-9bb3-4732-a399-f3f833399027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:03.765466 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3908/7909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:03.818300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:03.820000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:03.927030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525007-7798-4b3c-b4d5-360e5157e1fb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:03.931544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:03.932289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:03.932608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:03.932986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:03.959111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:03.960700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:03.990184 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4002/7910] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:04.253497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5679e-6a99-4021-9fc5-88109807c362 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:04.253919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5679e-6a99-4021-9fc5-88109807c362 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:04.254315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5679e-6a99-4021-9fc5-88109807c362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:04.301411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3ee5679e-6a99-4021-9fc5-88109807c362 None None] MFA Rules not processed for user `c87f4a9a2f5a4c9d831ca26b8bc91f17`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:04.310451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3ee5679e-6a99-4021-9fc5-88109807c362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:04.467446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3909/7911] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:05.258315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:05.260565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:05.282090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2348d-7d2e-43fd-a2b2-bac65b1edf1e service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:05.296415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:05.297754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:05.298341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:05.299156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] PATH_INFO: `/v3/projects/9b9d8ddc7a19411fa1f94d56527093ac` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:05.302256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9d8ddc7a19411fa1f94d56527093ac)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:05.309799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:05.416737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9d8ddc7a19411fa1f94d56527093ac', 'request_id': 'req-24e6d982-f824-4522-9a4b-a6dcc87a7c78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:05.430303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9d8ddc7a19411fa1f94d56527093ac', 'request_id': 'req-24e6d982-f824-4522-9a4b-a6dcc87a7c78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:05.453148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9d8ddc7a19411fa1f94d56527093ac', 'request_id': 'req-24e6d982-f824-4522-9a4b-a6dcc87a7c78'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:05.469732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] The token cache is being invalidate because project 9b9d8ddc7a19411fa1f94d56527093ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:05.470227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:05.472311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24e6d982-f824-4522-9a4b-a6dcc87a7c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:05.480391 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4003/7912] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:05 2022] DELETE /identity/v3/projects/9b9d8ddc7a19411fa1f94d56527093ac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:05.482219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:05.484081 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:05.484378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:05.519167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:05.520548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:05.696837 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3910/7913] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:05.706937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:05.706937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:05.706937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:05.758954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:05.762690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:05.781935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4004/7914] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:05.786306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:05.807017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59145d6-76a8-4482-87c7-48db4c52d0f9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:05.828681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:05.829615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:05.830071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:05.830493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:05.831363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:05.831816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:05.837022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:05.865384 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3911/7915] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:20:05.870461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:05.883165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827ca3-5941-48b0-8670-3254a5429b63 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:05.901763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:05.902934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:05.903357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:05.903783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:05.904806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:05.906898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:05.964519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4005/7916] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:05 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:05.968587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:05.984618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e338-47cc-4f9a-8971-26c44388f193 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.152566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.153260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.153546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.153821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.154526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.156500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:06.197213 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3912/7917] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:05 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:06.201394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:06.216762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213670a-04a7-49ff-8d5f-00c19bf37125 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.243301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.244726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.245743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.248803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.249873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.252703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:06.285435 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4006/7918] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:06.287455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:06.308096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32956ba4-9523-46a5-b42e-12bde401ca1a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.316379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.317295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.317788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.318217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.319128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.323791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3f4c-9fc0-45d8-a8ae-88017e70d171 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:06.346756 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3913/7919] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:06.351752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:06.363934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234eb07-44c2-462e-973d-534afef33ca7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.370344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.371572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.372414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.373299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] PATH_INFO: `/v3/projects/9b20c59b847e4929ad209e911bd2f5e3/users/5a696d517e2c4a08ba14b31f50e452d8/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.393683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b20c59b847e4929ad209e911bd2f5e3, user_id=5a696d517e2c4a08ba14b31f50e452d8, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.398132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:06.433727 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4007/7920] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:06 2022] PUT /identity/v3/projects/9b20c59b847e4929ad209e911bd2f5e3/users/5a696d517e2c4a08ba14b31f50e452d8/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:06.434190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.434727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.435209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.513166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] MFA Rules not processed for user `5a696d517e2c4a08ba14b31f50e452d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:06.514699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:06.637712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:06.665033 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3914/7921] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:06.753000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc1ac2-c104-4c78-9b56-0e39c7f0f203 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.759936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.760922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.761417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.761846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.762862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.766084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:06.826392 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4008/7922] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:06 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:06.830933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:06.845614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce9999-f01a-4f31-bcc9-d2d608a45165 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:06.941023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:06.941722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:06.942246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:06.942535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:06.943241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:06.947937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.006945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3915/7923] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:06 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:07.010017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.034289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243129c9-2bcd-4593-9a36-9ceb0b356417 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.042737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.043941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.044503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.044931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.045901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.048089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.080406 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4009/7924] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:07.080953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.095454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5645f-281f-4d70-b158-b1ae19927f16 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.102798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.103444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.103696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.103971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.105255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.107085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378d15c-1d72-4cea-b956-0af8bc85778e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.124425 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3916/7925] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:07.127184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.146673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3abb-a409-404f-a70d-3f20a1fc5188 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.154620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.155541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.157324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.157628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] PATH_INFO: `/v3/projects/4c97a24024fb41969b99d5f99100385b/users/8affb677009b493ca32b292b89eb06f3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.188674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c97a24024fb41969b99d5f99100385b, user_id=8affb677009b493ca32b292b89eb06f3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.191650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.227918 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4010/7926] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:07 2022] PUT /identity/v3/projects/4c97a24024fb41969b99d5f99100385b/users/8affb677009b493ca32b292b89eb06f3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:07.240669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.240972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.241388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.315514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] MFA Rules not processed for user `8affb677009b493ca32b292b89eb06f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:07.316789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:07.438116 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3917/7927] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:07.442465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.534292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be784d5-767c-4883-9540-713030d4e3a4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.541429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.542311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.542607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.542983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.543971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.546650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.608825 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4011/7928] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:07 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:07.609150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.623638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ffd5-7cfd-4adf-90d6-9a8873aab1c1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.756061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.758405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.758852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.759460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.760386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.763008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.803177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.813483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3918/7929] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:07 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:07.833387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afcd34-a311-46c8-843e-a6b2cfb38190 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.847020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.849147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.849649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.850111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.852051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.855386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:07.878812 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4012/7930] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:07.879878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:07.898759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bb318-84a3-4882-b635-ee0c6f8ef712 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:07.930788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:07.931705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:07.931993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:07.932274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] PATH_INFO: `/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3/users/6746dee9cced4049a9f5c2f23be8150a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:07.966351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab56fb9d5a4115b230246c8faa2cf3, user_id=6746dee9cced4049a9f5c2f23be8150a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:07.969152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:08.004083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3919/7931] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:07 2022] PUT /identity/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3/users/6746dee9cced4049a9f5c2f23be8150a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:08.011458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:08.031552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c80dc0-d830-4f5a-a37c-a94d221cf635 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:08.196138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:08.197017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:08.197313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:08.197598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:08.198338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:08.200140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4589b9-2918-4d03-8ef0-7064bdaff2d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:08.231193 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4013/7932] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:08.231930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:08.254567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1913e-67ac-4883-aa6e-b4c02e827d92 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:08.273292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:08.274405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:08.274699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:08.276550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] PATH_INFO: `/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3/users/6746dee9cced4049a9f5c2f23be8150a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:08.281352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab56fb9d5a4115b230246c8faa2cf3, user_id=6746dee9cced4049a9f5c2f23be8150a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:08.284050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:08.343834 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3920/7933] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:08 2022] PUT /identity/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3/users/6746dee9cced4049a9f5c2f23be8150a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:08.473532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:08.473929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:08.474106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:08.505819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] MFA Rules not processed for user `6746dee9cced4049a9f5c2f23be8150a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:08.507658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:08.637169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4014/7934] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:08.645661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:08.647510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:08.807799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef461b3-cd15-4aad-8a27-a18b90b95a4a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:08.821989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:08.822585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:08.822871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:08.823311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:08.956501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:08.959280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:08.981891 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3921/7935] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:10.875219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:10.878163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:10.904326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea50b5-98eb-42e1-8922-aedeaf0bdf29 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:10.909186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06978592-a886-453b-9240-599f8375b536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:10.910110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978592-a886-453b-9240-599f8375b536 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:10.910594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978592-a886-453b-9240-599f8375b536 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:10.912497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06978592-a886-453b-9240-599f8375b536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:11.002390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06978592-a886-453b-9240-599f8375b536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:11.004496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06978592-a886-453b-9240-599f8375b536 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:11.020162 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4015/7936] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:12.181518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:12.199785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b50-e1f1-4125-9c63-991e369314cc service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:12.205502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:12.206204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:12.206453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:12.206736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:12.218545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:12.220436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:12.238295 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3922/7937] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:14.003888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e536-dabb-4e7e-b639-fdb496cbd20f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:14.004755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e536-dabb-4e7e-b639-fdb496cbd20f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:14.005195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e536-dabb-4e7e-b639-fdb496cbd20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:14.025428 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f661e536-dabb-4e7e-b639-fdb496cbd20f None None] MFA Rules not processed for user `fb1ba274f1104befa1bd14c95525c3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:14.026691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f661e536-dabb-4e7e-b639-fdb496cbd20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:14.137096 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4016/7938] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:16.096036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:16.099583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:16.214096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab87d51-9f26-4cfa-a619-c21d170b051e service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:16.221600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:16.224677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:16.225198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:16.225723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] PATH_INFO: `/v3/users/d04da91927174ca9bb39fab767fd7614` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:16.231657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04da91927174ca9bb39fab767fd7614)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:16.235176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:16.329072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04da91927174ca9bb39fab767fd7614'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.354170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04da91927174ca9bb39fab767fd7614'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.355132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04da91927174ca9bb39fab767fd7614'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.367630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04da91927174ca9bb39fab767fd7614'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.382656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04da91927174ca9bb39fab767fd7614'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.392535 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3923/7939] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:16 2022] DELETE /identity/v3/users/d04da91927174ca9bb39fab767fd7614 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:16.394570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:16.395033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:16.395373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:16.437505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:16.441956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:16.539949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:16.542598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:16.593258 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4017/7940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:16.613157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:16.617447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:16.680959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418466-8a8c-4668-a4e7-867101333404 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:16.688586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:16.690113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:16.690749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:16.691385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] PATH_INFO: `/v3/users/5a696d517e2c4a08ba14b31f50e452d8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:16.693796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a696d517e2c4a08ba14b31f50e452d8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:16.698323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:16.753035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36711a-df68-4e58-af57-a290b8a42c76 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:16.760485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:16.761940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:16.762168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:16.762426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:16.775994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a696d517e2c4a08ba14b31f50e452d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.786075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:16.789126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbc351-71d4-40f4-b1dc-a845999fe6cf service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:16.797119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a696d517e2c4a08ba14b31f50e452d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.798304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a696d517e2c4a08ba14b31f50e452d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.810297 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4018/7941] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:16.813943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a696d517e2c4a08ba14b31f50e452d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.823451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a696d517e2c4a08ba14b31f50e452d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:16.830765 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3924/7942] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:16 2022] DELETE /identity/v3/users/5a696d517e2c4a08ba14b31f50e452d8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:16.835608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:16.836079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:16.836691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:16.868049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:16.869803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:16.968611 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4019/7943] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:16.990596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:16.994289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:17.082090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3c62-e572-4efd-a731-bc92ad907c14 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:17.087164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:17.088396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:17.088966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:17.089628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:17.103768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:17.107260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:17.130763 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3925/7944] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:17.869575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:17.871322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:17.893181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4bf7-9ba9-430e-8a9d-692fda7a308e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:17.901520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:17.903221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:17.903595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:17.904000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] PATH_INFO: `/v3/projects/2a3b73559cb047b186990f7963b0415b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:17.906032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a3b73559cb047b186990f7963b0415b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:17.908501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:17.972290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a3b73559cb047b186990f7963b0415b', 'request_id': 'req-46472af6-6354-44a8-ba09-18f83db6c78d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:17.991909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a3b73559cb047b186990f7963b0415b', 'request_id': 'req-46472af6-6354-44a8-ba09-18f83db6c78d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:17.992085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:17.995728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:18.010067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a3b73559cb047b186990f7963b0415b', 'request_id': 'req-46472af6-6354-44a8-ba09-18f83db6c78d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.034310 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea2721-3120-4a26-83ba-fb740e42905d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.051398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] The token cache is being invalidate because project 2a3b73559cb047b186990f7963b0415b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:18.051967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.052845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-46472af6-6354-44a8-ba09-18f83db6c78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.055459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4020/7945] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:17 2022] DELETE /identity/v3/projects/2a3b73559cb047b186990f7963b0415b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:18.068981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014c05-2b2c-4fba-a8a9-909d6750997a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.070849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014c05-2b2c-4fba-a8a9-909d6750997a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.071310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5014c05-2b2c-4fba-a8a9-909d6750997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.093728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a5014c05-2b2c-4fba-a8a9-909d6750997a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:18.095201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5014c05-2b2c-4fba-a8a9-909d6750997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:18.144846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.146828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.147976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.148488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] PATH_INFO: `/v3/projects/9b20c59b847e4929ad209e911bd2f5e3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.150002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b20c59b847e4929ad209e911bd2f5e3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.153183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.185818 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4021/7946] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:18.195129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.196771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.197231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.232308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:18.234133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:18.244784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b20c59b847e4929ad209e911bd2f5e3', 'request_id': 'req-90b589c1-9323-49eb-bb98-8b8e588f70f0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.256561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b20c59b847e4929ad209e911bd2f5e3', 'request_id': 'req-90b589c1-9323-49eb-bb98-8b8e588f70f0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.272120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b20c59b847e4929ad209e911bd2f5e3', 'request_id': 'req-90b589c1-9323-49eb-bb98-8b8e588f70f0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.309478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] The token cache is being invalidate because project 9b20c59b847e4929ad209e911bd2f5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:18.309931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.311939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.317382 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3926/7947] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:17 2022] DELETE /identity/v3/projects/9b20c59b847e4929ad209e911bd2f5e3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:18.322606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.325303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:18.344583 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4022/7948] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:18.351352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.360552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b589c1-9323-49eb-bb98-8b8e588f70f0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.376753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.377742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.380712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.381019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab7ff0-c3f9-4497-ba38-c60ebad2ea33 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.381379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] PATH_INFO: `/v3/users/8affb677009b493ca32b292b89eb06f3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.384024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8affb677009b493ca32b292b89eb06f3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.385986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.394639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.395796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.395796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.396049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.397852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:18.398399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.400038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.432939 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4023/7949] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:20:18.434083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.475900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd350d-dfdb-4e64-aad9-d04f43dee1f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.495683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.496365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.496674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.496952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.497889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.500867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.506015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8affb677009b493ca32b292b89eb06f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.531530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8affb677009b493ca32b292b89eb06f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.532723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8affb677009b493ca32b292b89eb06f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.543699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8affb677009b493ca32b292b89eb06f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.555953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8affb677009b493ca32b292b89eb06f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:18.557600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4024/7950] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:18.562032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.564285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:18.566789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3927/7951] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:18 2022] DELETE /identity/v3/users/8affb677009b493ca32b292b89eb06f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:18.668772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8129a5-1117-478e-8bcd-8cf3aba980d1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.771405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.773150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.773443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.776005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.776846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.779849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.809431 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4025/7952] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:18 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:18.809918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.823163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ed3f-890a-4265-8d89-a023805f8525 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.828951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.830286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.830643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.831063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.832415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.834508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.857678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.869010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece8061-fed9-4fe9-92d7-5e8a87939b56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.870261 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3928/7953] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:18.875007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.875739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.876028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.876308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.877288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.880676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a538-4482-4b2a-92e9-925abfb94c33 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.892033 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4026/7954] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:18.897888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:18.907377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf11b3-4e4b-4091-9c67-5ccde7e1db39 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:18.912108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:18.913056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.913340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.913617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] PATH_INFO: `/v3/projects/f14823a3dc184dcd8758175ac610f823/users/d88676e4a4d8485fafa63fd5fa7ad084/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.930740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14823a3dc184dcd8758175ac610f823, user_id=d88676e4a4d8485fafa63fd5fa7ad084, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:18.933533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:18.950911 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3929/7955] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:18 2022] PUT /identity/v3/projects/f14823a3dc184dcd8758175ac610f823/users/d88676e4a4d8485fafa63fd5fa7ad084/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:18.962492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:18.963475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:18.963761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:18.994075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] MFA Rules not processed for user `d88676e4a4d8485fafa63fd5fa7ad084`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:18.995328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:19.077020 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4027/7956] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:19.144871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:19.147323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:19.229325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8cf8-5aac-41ca-999a-5aac2706b488 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:19.234674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:19.236137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:19.236695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:19.237211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:19.250431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:19.252258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:19.265733 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3930/7957] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:20.030753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:20.033147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:20.223584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226054f9-0e17-4ca0-906b-2131360ec594 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:20.236708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:20.237847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:20.238137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:20.238425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] PATH_INFO: `/v3/projects/4c97a24024fb41969b99d5f99100385b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:20.249421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c97a24024fb41969b99d5f99100385b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:20.251369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:20.354203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c97a24024fb41969b99d5f99100385b', 'request_id': 'req-32fc38cd-1423-47cd-bdb1-919b83ec06ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.362231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c97a24024fb41969b99d5f99100385b', 'request_id': 'req-32fc38cd-1423-47cd-bdb1-919b83ec06ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.374773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c97a24024fb41969b99d5f99100385b', 'request_id': 'req-32fc38cd-1423-47cd-bdb1-919b83ec06ff'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.390323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] The token cache is being invalidate because project 4c97a24024fb41969b99d5f99100385b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:20.390829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.391639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.393691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4028/7958] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:20 2022] DELETE /identity/v3/projects/4c97a24024fb41969b99d5f99100385b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:20.399186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:20.416285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38d71-f3c0-4055-94f7-e67a950efbdd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:20.574941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:20.578540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:20.578888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:20.579259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] PATH_INFO: `/v3/users/6746dee9cced4049a9f5c2f23be8150a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:20.582878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6746dee9cced4049a9f5c2f23be8150a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:20.586588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:20.689351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6746dee9cced4049a9f5c2f23be8150a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.718947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6746dee9cced4049a9f5c2f23be8150a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.720405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6746dee9cced4049a9f5c2f23be8150a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.731860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6746dee9cced4049a9f5c2f23be8150a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.744416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6746dee9cced4049a9f5c2f23be8150a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:20.757806 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3931/7959] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:20 2022] DELETE /identity/v3/users/6746dee9cced4049a9f5c2f23be8150a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:21.654955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:21.656561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:21.670605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc38cd-1423-47cd-bdb1-919b83ec06ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:21.742525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:21.743845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:21.744490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:21.745959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] PATH_INFO: `/v3/users/46d0c6b2806a46ce9621af36b828e17e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:21.747566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d0c6b2806a46ce9621af36b828e17e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:21.750304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:21.845684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d0c6b2806a46ce9621af36b828e17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:21.860088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d0c6b2806a46ce9621af36b828e17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:21.862478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d0c6b2806a46ce9621af36b828e17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:21.863716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d0c6b2806a46ce9621af36b828e17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:21.882687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c885cd0-502a-403b-a12b-752c3963fbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d0c6b2806a46ce9621af36b828e17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:21.951472 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4029/7960] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:21 2022] DELETE /identity/v3/users/46d0c6b2806a46ce9621af36b828e17e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:22.314767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:22.316387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:22.338122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccc088-e56d-4ee7-af01-a45c5fd366b8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:22.413453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:22.414675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.415127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.415544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] PATH_INFO: `/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.416980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ab56fb9d5a4115b230246c8faa2cf3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:22.419342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:22.547919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ab56fb9d5a4115b230246c8faa2cf3', 'request_id': 'req-528573c0-6398-4a64-bfd2-f9532103bd60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:22.558251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ab56fb9d5a4115b230246c8faa2cf3', 'request_id': 'req-528573c0-6398-4a64-bfd2-f9532103bd60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:22.568082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ab56fb9d5a4115b230246c8faa2cf3', 'request_id': 'req-528573c0-6398-4a64-bfd2-f9532103bd60'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:22.601226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] The token cache is being invalidate because project b6ab56fb9d5a4115b230246c8faa2cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:22.601589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:22.602400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:22.604744 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3932/7961] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:22 2022] DELETE /identity/v3/projects/b6ab56fb9d5a4115b230246c8faa2cf3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:22.613424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48a1-1e53-4cf4-afc4-ae9877db3aaa None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.613870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48a1-1e53-4cf4-afc4-ae9877db3aaa None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.614348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48a1-1e53-4cf4-afc4-ae9877db3aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.657718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e06d48a1-1e53-4cf4-afc4-ae9877db3aaa None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:22.659920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e06d48a1-1e53-4cf4-afc4-ae9877db3aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:22.712620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:22.714318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:22.760403 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4030/7962] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:22.768273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.770321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.770689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.817170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:22.820439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:22.845577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4031/7963] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:22.849513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:22.905807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528573c0-6398-4a64-bfd2-f9532103bd60 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:22.911023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747fc24-02ae-496d-a78e-3a35f22c314d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:22.914546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:22.915747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.916230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.916908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] PATH_INFO: `/v3/projects/be8b83e669854377af9bc768398a35af` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.917498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:22.918212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.918504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.918788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.919340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8b83e669854377af9bc768398a35af)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:22.919510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:22.919834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:22.922326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:22.927561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:22.955189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4032/7964] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:20:22.956987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:22.978314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3479a-8f08-4237-8d52-c730b21ef820 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:22.985867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:22.986560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:22.987874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:22.988168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:22.988966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:22.992792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.021744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8b83e669854377af9bc768398a35af', 'request_id': 'req-7f29d533-2ca4-4eaf-9042-ff9afe273320'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.033413 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4033/7965] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:22 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:23.034606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8b83e669854377af9bc768398a35af', 'request_id': 'req-7f29d533-2ca4-4eaf-9042-ff9afe273320'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.039491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.047566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8b83e669854377af9bc768398a35af', 'request_id': 'req-7f29d533-2ca4-4eaf-9042-ff9afe273320'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.066032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] The token cache is being invalidate because project be8b83e669854377af9bc768398a35af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:23.074223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.075470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.077488 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3933/7966] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:22 2022] DELETE /identity/v3/projects/be8b83e669854377af9bc768398a35af => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:23.081961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.083859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:23.145358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649679c-799d-4b22-a7cd-259ecd2294b6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.153671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.154782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.155412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.156766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.158010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.160723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.197384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4034/7967] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:23 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:23.198517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.199231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d533-2ca4-4eaf-9042-ff9afe273320 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.200381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:23.204974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.206004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.206368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.206726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] PATH_INFO: `/v3/users/f21abe9d0e7647b08690bc957f3960b1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.208481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21abe9d0e7647b08690bc957f3960b1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.211058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.213738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2b180-917a-4398-8d25-f96480771fc9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.218735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.219427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.219903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.220180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.220943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.222535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.235146 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4035/7968] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:23.238834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.249906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d078-8fb5-48b9-9e9f-a3ad66f70310 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.255066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.255721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.256045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.256618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.257344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.258935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.269321 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4036/7969] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:23.273912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.274789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21abe9d0e7647b08690bc957f3960b1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.283834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc405c45-fe91-45cf-b9c4-e6b8aa85d6d1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.290172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21abe9d0e7647b08690bc957f3960b1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.290696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.291718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.292067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.292414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] PATH_INFO: `/v3/projects/c4a348d94ff64eadaa5905dbb61b2932/users/c2ea308941ce4dc98b0f21b4225aa533/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.297774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21abe9d0e7647b08690bc957f3960b1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.310250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21abe9d0e7647b08690bc957f3960b1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.313210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a348d94ff64eadaa5905dbb61b2932, user_id=c2ea308941ce4dc98b0f21b4225aa533, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.316062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea575cc-44d4-47ea-94da-ea3f2b59f64e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.324198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21abe9d0e7647b08690bc957f3960b1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:23.335324 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4037/7970] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:23 2022] PUT /identity/v3/projects/c4a348d94ff64eadaa5905dbb61b2932/users/c2ea308941ce4dc98b0f21b4225aa533/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:23.349892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.351038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.351232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.352732 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3934/7971] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:23 2022] DELETE /identity/v3/users/f21abe9d0e7647b08690bc957f3960b1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:23.421889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] MFA Rules not processed for user `c2ea308941ce4dc98b0f21b4225aa533`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:23.421889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:23.519958 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4038/7972] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:23.525268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.526794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:23.607039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4876b53-7e29-4383-b4b9-a0d87e053f32 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.613076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.613863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.614219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.614573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.615355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.617448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.649614 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3935/7973] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:23.653714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.667225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ff3db-7d1f-4347-98e4-512ab4730939 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.740089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.741286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.741739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.742158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.742993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.745209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.768584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4039/7974] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:23 2022] POST /identity/v3/users => generated 301 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:23.773957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.785056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2691388-b2c2-4049-8393-cb04ebadaf76 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.792161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.793727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.794046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.794332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.795060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.797673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9aa3-7b8d-4460-a3cc-6c759aeb8cc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.814021 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3936/7975] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:23.816357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:23.830897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5e2b-3d9b-40d8-a7df-e6c1611e34d1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:23.836574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:23.838418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.838958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.839425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] PATH_INFO: `/v3/projects/3f529f578e354139b790473562a86214/users/fd78f5a722e94823b13618d13a138233/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.857930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f529f578e354139b790473562a86214, user_id=fd78f5a722e94823b13618d13a138233, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:23.861319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:23.879798 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4040/7976] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:23 2022] PUT /identity/v3/projects/3f529f578e354139b790473562a86214/users/fd78f5a722e94823b13618d13a138233/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:23.891449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:23.891771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:23.892023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:23.927935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] MFA Rules not processed for user `fd78f5a722e94823b13618d13a138233`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:23.930096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:24.012058 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3937/7977] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:23 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:24.066923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:24.077690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:24.145248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:24.148722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:24.175782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de17b8d-9757-4350-85e6-28df63d4232a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:24.201981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:24.203367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:24.203658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:24.203966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:24.225998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:24.231778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:24.260809 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4041/7978] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:20:24.286675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13b55-92d0-4592-9cb3-82b5e34b655a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:24.293232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:24.294282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:24.294438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:24.294719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] PATH_INFO: `/v3/projects/08287b395fcf45c38195909db7f53878` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:24.296543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08287b395fcf45c38195909db7f53878)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:24.298826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:24.394848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08287b395fcf45c38195909db7f53878', 'request_id': 'req-c51661be-2215-458b-b010-3cdc98e77671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:24.430484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08287b395fcf45c38195909db7f53878', 'request_id': 'req-c51661be-2215-458b-b010-3cdc98e77671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:24.439365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08287b395fcf45c38195909db7f53878', 'request_id': 'req-c51661be-2215-458b-b010-3cdc98e77671'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:24.469027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] The token cache is being invalidate because project 08287b395fcf45c38195909db7f53878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:24.472867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:24.473802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c51661be-2215-458b-b010-3cdc98e77671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:24.485142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3938/7979] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:24 2022] DELETE /identity/v3/projects/08287b395fcf45c38195909db7f53878 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:25.383280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:25.394124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646880-600e-407f-a92c-ddf23251b21c service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:25.460345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:25.461314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:25.461753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:25.462043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] PATH_INFO: `/v3/users/c2ea308941ce4dc98b0f21b4225aa533` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:25.463279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ea308941ce4dc98b0f21b4225aa533)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:25.465389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:25.528220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ea308941ce4dc98b0f21b4225aa533'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:25.537287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ea308941ce4dc98b0f21b4225aa533'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:25.538779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ea308941ce4dc98b0f21b4225aa533'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:25.539501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ea308941ce4dc98b0f21b4225aa533'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:25.547474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ea308941ce4dc98b0f21b4225aa533'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:25.565200 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4042/7980] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:25 2022] DELETE /identity/v3/users/c2ea308941ce4dc98b0f21b4225aa533 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:25.569867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:25.570350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:25.570815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:25.589920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:25.591094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:25.649404 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3939/7981] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:25.659371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:25.660795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:25.720027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b005d7-535b-44ec-a8f4-00fcfb43d163 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:25.723709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:25.724362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:25.724682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:25.724963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:25.736956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:25.738401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:25.749329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4043/7982] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:26.423624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:26.425260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:26.440995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4b5f-50cd-436e-a441-1acd3d0a737f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:26.447950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:26.449565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:26.450070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:26.450645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] PATH_INFO: `/v3/projects/c4a348d94ff64eadaa5905dbb61b2932` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:26.453778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a348d94ff64eadaa5905dbb61b2932)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:26.456106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:26.539557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a348d94ff64eadaa5905dbb61b2932', 'request_id': 'req-55c162cf-c708-4b1c-81a0-6b9b35c394d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.547964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a348d94ff64eadaa5905dbb61b2932', 'request_id': 'req-55c162cf-c708-4b1c-81a0-6b9b35c394d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.556825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a348d94ff64eadaa5905dbb61b2932', 'request_id': 'req-55c162cf-c708-4b1c-81a0-6b9b35c394d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.574522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] The token cache is being invalidate because project c4a348d94ff64eadaa5905dbb61b2932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:26.575528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.577054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.580001 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3940/7983] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:26 2022] DELETE /identity/v3/projects/c4a348d94ff64eadaa5905dbb61b2932 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:26.585381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:26.599486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8bbd-e94d-4fed-adc2-3e8a37408af7 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:26.672291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:26.674348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:26.674643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:26.674933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] PATH_INFO: `/v3/users/fd78f5a722e94823b13618d13a138233` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:26.676280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd78f5a722e94823b13618d13a138233)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:26.678640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:26.738507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd78f5a722e94823b13618d13a138233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.749424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd78f5a722e94823b13618d13a138233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.750239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd78f5a722e94823b13618d13a138233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.751999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd78f5a722e94823b13618d13a138233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.766148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-52dfe2b4-fd65-4c68-ac9c-3f69ea7b1d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd78f5a722e94823b13618d13a138233'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:26.792252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4044/7984] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:26 2022] DELETE /identity/v3/users/fd78f5a722e94823b13618d13a138233 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:27.720027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:27.721520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:27.739361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c162cf-c708-4b1c-81a0-6b9b35c394d9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:27.830275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:27.831552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:27.832136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:27.832971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] PATH_INFO: `/v3/projects/3f529f578e354139b790473562a86214` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:27.836341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f529f578e354139b790473562a86214)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:27.838496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:27.897024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f529f578e354139b790473562a86214', 'request_id': 'req-bd5da7fd-7fe2-4206-926e-12457462363d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:27.903584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f529f578e354139b790473562a86214', 'request_id': 'req-bd5da7fd-7fe2-4206-926e-12457462363d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:27.909802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f529f578e354139b790473562a86214', 'request_id': 'req-bd5da7fd-7fe2-4206-926e-12457462363d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:27.922705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] The token cache is being invalidate because project 3f529f578e354139b790473562a86214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:27.923675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:27.925177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd5da7fd-7fe2-4206-926e-12457462363d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:27.930991 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3941/7985] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:27 2022] DELETE /identity/v3/projects/3f529f578e354139b790473562a86214 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:27.932530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:27.933007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:27.933082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:27.956706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:27.958398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:28.065431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.065761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.066011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.071185 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4045/7986] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:28.098515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:28.099771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:28.113271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3942/7987] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:28.118187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.130052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981f27-40e7-4115-aadb-106ce3c54d2e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.135910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.136646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.136935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.137599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.138343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:28.138658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.140436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.163345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.184975 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4046/7988] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:20:28.194356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f95f61-6e38-4c0f-8c2d-2a2f0fcd9855 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.210460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.211352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.211714 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.212074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.212922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.214961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.248538 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3943/7989] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:28 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:28.250231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.261406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54448d72-154d-49cd-bacb-570b9ef0ae28 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.372771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.373558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.373844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.374115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.374836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.376819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.406197 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4047/7990] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:28 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:28.407107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.420159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b74bc-76c6-4ee5-ab10-172f84e08bc1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.425564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.426324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.426835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.427197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.428709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.430385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.443250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3944/7991] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:28.447380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.470091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33c419-c3c8-477c-aa63-91cdb47e816e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.476610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.478581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.478881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.479510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.480357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.482553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede0c99-24d2-4068-b34e-1c1f792e1a7a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.496790 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4048/7992] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:28.501153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.512831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e9e3-1810-42a0-8935-03d9bd24722d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.518011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.518976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.519347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.519691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] PATH_INFO: `/v3/projects/2e8bc61a3e3149c3bb79c449929eb875/users/c46cec44517a4a3a9aa20a1789097ce5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.538107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8bc61a3e3149c3bb79c449929eb875, user_id=c46cec44517a4a3a9aa20a1789097ce5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.540804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.555461 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3945/7993] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:28 2022] PUT /identity/v3/projects/2e8bc61a3e3149c3bb79c449929eb875/users/c46cec44517a4a3a9aa20a1789097ce5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:28.561758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.562292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.562590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.590512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:28.591992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:28.695871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4049/7994] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:28.750044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:28.751989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:28.835538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42c838-8a27-41c3-adb3-e610103893f4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:28.839924 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:28.840828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:28.841269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:28.841702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:28.852601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:28.854801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd791c6-a8e0-4981-b154-1a2ef0ee525a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:28.867935 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3946/7995] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:30.237803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:30.239517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:30.279097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5925bda-026f-4aec-ba26-3dcab6d93eaf None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:30.285743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:30.286908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:30.287953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:30.288437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] PATH_INFO: `/v3/users/d88676e4a4d8485fafa63fd5fa7ad084` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:30.290801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88676e4a4d8485fafa63fd5fa7ad084)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:30.293932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:30.392250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88676e4a4d8485fafa63fd5fa7ad084'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:30.407683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88676e4a4d8485fafa63fd5fa7ad084'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:30.409681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88676e4a4d8485fafa63fd5fa7ad084'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:30.410760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88676e4a4d8485fafa63fd5fa7ad084'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:30.435696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88676e4a4d8485fafa63fd5fa7ad084'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:30.490982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4050/7996] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:30 2022] DELETE /identity/v3/users/d88676e4a4d8485fafa63fd5fa7ad084 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:30.495464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530de3c-878c-4d5c-83ce-c036ea62444c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:30.495957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530de3c-878c-4d5c-83ce-c036ea62444c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:30.496064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530de3c-878c-4d5c-83ce-c036ea62444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:30.538513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6530de3c-878c-4d5c-83ce-c036ea62444c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:30.539686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6530de3c-878c-4d5c-83ce-c036ea62444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:30.656098 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3947/7997] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:30.668724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:30.670287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:30.758742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53f45f-7259-47ad-8699-70a25c9e3156 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:30.764152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:30.765597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:30.766008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:30.766386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:30.780694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:30.782750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:30.798962 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4051/7998] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:30.860191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:30.860506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:30.861216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:30.904255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] MFA Rules not processed for user `c46cec44517a4a3a9aa20a1789097ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:30.905520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:31.005366 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3948/7999] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:31.010434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.012143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:31.028548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9916b96-8951-4fec-8fe0-44f00bc020aa service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.035516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.035516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.035516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.035516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.036665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.038917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.080203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4052/8000] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:31.084972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.104035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a43ec-9266-419d-b7fb-5f03eb2a647d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.189249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.190605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.190949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.191347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.192656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.194937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.231002 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3949/8001] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:31.234983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.253477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ee64d-b898-4384-a627-0cabfc5c2b11 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.262535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.263508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.263797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.264077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.264840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.266470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.282791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.283253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4053/8002] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:31.294156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe328c3-e526-45e8-8621-41b1b3ccf8cb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.299493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.300625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.300819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.301279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] PATH_INFO: `/v3/projects/3b82fb5867ea48bbb8aeccfdae749984/users/ff18ba17089b4b57bf12ef928352749a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.325025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.326880 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:31.327307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b82fb5867ea48bbb8aeccfdae749984, user_id=ff18ba17089b4b57bf12ef928352749a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.330125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.346365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138b9f-a32a-4405-b6b0-d969a1f9f448 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.354182 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3950/8003] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:31 2022] PUT /identity/v3/projects/3b82fb5867ea48bbb8aeccfdae749984/users/ff18ba17089b4b57bf12ef928352749a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:31.356342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.446131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.447093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.455432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.455786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] PATH_INFO: `/v3/projects/f14823a3dc184dcd8758175ac610f823` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.457371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14823a3dc184dcd8758175ac610f823)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.459964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.460095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa33ecd-2408-4019-8e95-2c17e1e26a28 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.465314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.465997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.466281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.466561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.467289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.469105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.482676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3951/8004] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:31.486810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.497775 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704939d7-7c8f-493b-82bd-b81c711c73e3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.519808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14823a3dc184dcd8758175ac610f823', 'request_id': 'req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:31.525229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.527950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14823a3dc184dcd8758175ac610f823', 'request_id': 'req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:31.529790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.530098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.530548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] PATH_INFO: `/v3/projects/3b82fb5867ea48bbb8aeccfdae749984/users/ff18ba17089b4b57bf12ef928352749a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.535235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b82fb5867ea48bbb8aeccfdae749984, user_id=ff18ba17089b4b57bf12ef928352749a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.536892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14823a3dc184dcd8758175ac610f823', 'request_id': 'req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:31.539302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6fbb1-2c2f-4862-8909-9fc8c4b7b9be admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.550236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] The token cache is being invalidate because project f14823a3dc184dcd8758175ac610f823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:31.550558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:31.551293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cdc05380-66a6-4a71-abb1-e7d0b2f5cbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:31.553053 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3952/8005] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:31 2022] PUT /identity/v3/projects/3b82fb5867ea48bbb8aeccfdae749984/users/ff18ba17089b4b57bf12ef928352749a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:31.553170 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4054/8006] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:31 2022] DELETE /identity/v3/projects/f14823a3dc184dcd8758175ac610f823 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:31.557800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.558184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.558469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.581066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:31.583694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:31.654250 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4055/8007] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:31.662199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.662663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.664247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.688443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:31.689938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:31.702393 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3953/8008] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:31.707143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.719570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c86c9f-d4c8-415b-92fc-4c93257f1ae2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.724739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.725668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.725953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.726237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.727130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:31.727329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.729248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.743032 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4056/8009] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:20:31.747250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.757432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc79b8-e4b0-4a0b-aa07-7be3b4f461f9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.762387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.763071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.763343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.763819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.764549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.766694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.794914 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3954/8010] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:31.799371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.811480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74388-a608-4f01-bc65-cb862d023c5f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.879570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.880316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.880962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.880962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.882345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.885845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.909427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4057/8011] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:31 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:31.912186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.923306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cafcd-3dc5-447b-89b6-72d98fa6b3d7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.928550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.929230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.929545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.929827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.930550 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.932156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.942767 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3955/8012] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:31.946841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.957484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bbf4e-eea2-4274-9e21-0d8ad591894f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.962674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.963336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.963626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.963907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:31.964664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:31.966301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ddba1-9c5b-4727-89a9-776fea9e44e1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:31.976848 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4058/8013] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:31.981147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:31.991366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cee766-ad99-4bd5-8cd1-3f8311d99b1b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:31.996054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:31.996983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:31.997264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:31.997540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] PATH_INFO: `/v3/projects/907020ab761543329bc7c96793428bde/users/6bcc8b24ff7445bc9415e4a38eb93582/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.013480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907020ab761543329bc7c96793428bde, user_id=6bcc8b24ff7445bc9415e4a38eb93582, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:32.017498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:32.032054 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3956/8014] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:31 2022] PUT /identity/v3/projects/907020ab761543329bc7c96793428bde/users/6bcc8b24ff7445bc9415e4a38eb93582/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:32.042872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c1537-7986-4d2c-9254-b28021bd460e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:32.043167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c1537-7986-4d2c-9254-b28021bd460e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:32.043449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c1537-7986-4d2c-9254-b28021bd460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.073665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-008c1537-7986-4d2c-9254-b28021bd460e None None] MFA Rules not processed for user `6bcc8b24ff7445bc9415e4a38eb93582`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:32.074891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-008c1537-7986-4d2c-9254-b28021bd460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.189198 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4059/8015] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:32.199914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:32.203065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.284015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb436f-d8f4-4d36-9589-a57cc6a5af47 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:32.288757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:32.289499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:32.289789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:32.290070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.310314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:32.311793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee412b0-0bea-478f-bd09-a5e7b6df4252 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:32.322146 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3957/8016] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:32.565893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:32.566351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:32.566567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.615272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] MFA Rules not processed for user `ff18ba17089b4b57bf12ef928352749a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:32.616559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.702667 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4060/8017] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:32.715079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:32.716063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:32.716609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.737514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] MFA Rules not processed for user `c46cec44517a4a3a9aa20a1789097ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:32.739274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.806923 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3958/8018] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:32.818017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:32.819651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.901453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04317a-baff-448d-aab4-d5ca28aba20c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:32.908263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:32.908769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:32.909145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:32.909492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:32.911814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:32.924944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:32.928801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:32.942190 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4061/8019] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:33.619485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:33.620913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:33.634897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9e2aa-4a44-456c-a599-f1f8ed6d250b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:33.638489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:33.639137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:33.639418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:33.639692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:33.641518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:33.653571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:33.654996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59bc48-418b-4020-ae11-66afadcad8e8 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:33.666222 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3959/8020] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:41.462264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:41.537883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88849fd-5025-4ec9-a14e-77a394a7380c service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:41.543268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:41.544711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.545493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.545818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] PATH_INFO: `/v3/users/6bcc8b24ff7445bc9415e4a38eb93582` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:41.547152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bcc8b24ff7445bc9415e4a38eb93582)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:41.549676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:41.607581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bcc8b24ff7445bc9415e4a38eb93582'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.616544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bcc8b24ff7445bc9415e4a38eb93582'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.617532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bcc8b24ff7445bc9415e4a38eb93582'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.618370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bcc8b24ff7445bc9415e4a38eb93582'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.626713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bcc8b24ff7445bc9415e4a38eb93582'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.654330 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4062/8021] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:41 2022] DELETE /identity/v3/users/6bcc8b24ff7445bc9415e4a38eb93582 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:41.658815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.659318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.659687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:41.682154 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:41.683350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.688827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:41.690827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.762687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc3cf4-d00a-4231-9762-4e7432442954 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:41.767617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:41.768536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.768829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.769110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] PATH_INFO: `/v3/users/d3f049a8805a454d818122a8743f6065` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:41.770338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f049a8805a454d818122a8743f6065)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:41.772895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:41.790365 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3960/8022] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:41.801045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:41.803390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.827597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f049a8805a454d818122a8743f6065'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.836480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f049a8805a454d818122a8743f6065'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.837235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f049a8805a454d818122a8743f6065'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.838054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f049a8805a454d818122a8743f6065'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.845856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-4108dcc9-c963-42bb-8afb-f9f4b227c123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f049a8805a454d818122a8743f6065'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:41.868620 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4063/8023] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:41 2022] DELETE /identity/v3/users/d3f049a8805a454d818122a8743f6065 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:41.873014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.873309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.873774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:41.878356 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3b20-edf8-4850-a10b-2c3516990d39 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:41.892811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:41.894187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.938203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:41.938866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.939159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.939443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:41.941309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.961693 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4064/8024] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:41.971025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:41.972421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:41.988138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf57f6-80f4-4954-9c14-28181ed2984c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:41.992057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:41.992767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:41.993060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:41.993346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.003257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.004852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.014453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.016194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.016348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4065/8025] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:20:42.026978 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3961/8026] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:42.263538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.265006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.278800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2e2e-0204-4608-92ba-a06de00cbfbe service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.283728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.284860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.285044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.285386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] PATH_INFO: `/v3/projects/907020ab761543329bc7c96793428bde` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.286920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907020ab761543329bc7c96793428bde)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.289739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.341303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907020ab761543329bc7c96793428bde', 'request_id': 'req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.348919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907020ab761543329bc7c96793428bde', 'request_id': 'req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.350025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.351576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.357439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907020ab761543329bc7c96793428bde', 'request_id': 'req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.366929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4493f-b846-4be2-ac41-600bbbdc6ca4 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.370221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] The token cache is being invalidate because project 907020ab761543329bc7c96793428bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:42.370674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.371465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-12c1f23b-cf1e-4f6c-8a70-b829c9210cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.373556 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4066/8027] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:42 2022] DELETE /identity/v3/projects/907020ab761543329bc7c96793428bde => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:42.378931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164026-5d34-40e3-92b1-978b7ab314b2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.379334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164026-5d34-40e3-92b1-978b7ab314b2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.379780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164026-5d34-40e3-92b1-978b7ab314b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.403186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eb164026-5d34-40e3-92b1-978b7ab314b2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:42.404298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb164026-5d34-40e3-92b1-978b7ab314b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.426364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.427229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.427566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.427852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] PATH_INFO: `/v3/projects/79c75ffe30794479aadda562c9e11974` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.429107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c75ffe30794479aadda562c9e11974)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.431103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.463548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4067/8028] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:42.472858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.473195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.473529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.488122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c75ffe30794479aadda562c9e11974', 'request_id': 'req-5a4d7bcd-235d-4133-8b8e-90888c500dac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.493089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:42.494314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.496285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c75ffe30794479aadda562c9e11974', 'request_id': 'req-5a4d7bcd-235d-4133-8b8e-90888c500dac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.504281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c75ffe30794479aadda562c9e11974', 'request_id': 'req-5a4d7bcd-235d-4133-8b8e-90888c500dac'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.520110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] The token cache is being invalidate because project 79c75ffe30794479aadda562c9e11974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:42.520395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.521052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.523248 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3962/8029] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:42 2022] DELETE /identity/v3/projects/79c75ffe30794479aadda562c9e11974 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:42.527272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.528609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.554484 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4068/8030] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:42.558622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.567419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b3ee8-7bd5-4836-bdb0-76934ba71893 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.572725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.573379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.573668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.573949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.574695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:42.575006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.576646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.588674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4069/8031] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:42.592708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.593031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7bcd-235d-4133-8b8e-90888c500dac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.597674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.598540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.598819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.599091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] PATH_INFO: `/v3/users/0a88204c242b4ea8921be80a1bdfdf7c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.600328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a88204c242b4ea8921be80a1bdfdf7c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.602129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc872a-13dc-42d7-910a-24a1122e7c3b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.602270 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.606819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.607496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.607787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.608064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.608770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.610637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.637094 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4070/8032] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:42.641238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.649711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a88204c242b4ea8921be80a1bdfdf7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.661659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a88204c242b4ea8921be80a1bdfdf7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.662278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a88204c242b4ea8921be80a1bdfdf7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.669652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a88204c242b4ea8921be80a1bdfdf7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.676802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a88204c242b4ea8921be80a1bdfdf7c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.683424 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3963/8033] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:42 2022] DELETE /identity/v3/users/0a88204c242b4ea8921be80a1bdfdf7c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:42.701424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adf295-2d77-49a8-a540-8805925c5653 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.757355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.758031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.758317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.758598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.759289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.761259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.787107 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4071/8034] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:42.788561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.790007 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.804950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e01554-77c7-4673-9e7f-f88094b7c0cc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.810725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.811429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.811715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.811992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.812767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.814459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.826120 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3964/8035] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:42.831199 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.842795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746a2d-9c85-437d-88a2-0fc2208d66cd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.848013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.848747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.849038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.849341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.850233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.852001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.867082 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4072/8036] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:42.868327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.870200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:42.872158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.878921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7c247-8de8-490a-9738-19401fe80468 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.884369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.885308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.885587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.885861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] PATH_INFO: `/v3/projects/25d545f94685450c9e6b1f53a01f20c5/users/abd43e2c4034489b950de213f04aea0e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.894337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c2e9-ae43-412d-8ecf-c5dff4ac9b46 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:42.900787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:42.901765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.902010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d545f94685450c9e6b1f53a01f20c5, user_id=abd43e2c4034489b950de213f04aea0e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.902121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.902362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] PATH_INFO: `/v3/projects/a51f428187b3496b897ace71da0754e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.903526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51f428187b3496b897ace71da0754e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:42.904946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a4920-e13d-4d53-97d1-9965120aa0bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.905463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:42.918309 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3965/8037] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:42 2022] PUT /identity/v3/projects/25d545f94685450c9e6b1f53a01f20c5/users/abd43e2c4034489b950de213f04aea0e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:42.929090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.929391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.929676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:42.953417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51f428187b3496b897ace71da0754e2', 'request_id': 'req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.957131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] MFA Rules not processed for user `abd43e2c4034489b950de213f04aea0e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:42.958366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:42.960058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51f428187b3496b897ace71da0754e2', 'request_id': 'req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.967864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51f428187b3496b897ace71da0754e2', 'request_id': 'req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.978222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] The token cache is being invalidate because project a51f428187b3496b897ace71da0754e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:42.978507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.979164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8e4c5086-0d6f-4fad-b79c-8957bddbe23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:42.987696 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4073/8038] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:42 2022] DELETE /identity/v3/projects/a51f428187b3496b897ace71da0754e2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:42.987696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08596af-3b87-4d22-b899-c77d2cdc43ab None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:42.987696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08596af-3b87-4d22-b899-c77d2cdc43ab None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:42.987696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08596af-3b87-4d22-b899-c77d2cdc43ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.007703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b08596af-3b87-4d22-b899-c77d2cdc43ab None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:43.009016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b08596af-3b87-4d22-b899-c77d2cdc43ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.028943 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3966/8039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:43.039475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.040877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.072604 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4074/8040] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:43.080546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.081354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.081354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.102129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:43.103928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.111797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf8627-1f7b-4b73-8084-613a7a8bc82a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.117492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.118026 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4075/8041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:43.118521 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.118958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.122376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.124858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.132088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c34e1e-847c-44af-8e10-f454c6519eba None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.135534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.137075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.137404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.137805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.138290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.138585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.139307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:43.140321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.142509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.149533 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3967/8042] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:20:43.156128 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4076/8043] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:43.160487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.178326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5ff-f104-4397-ba75-db0556c400fd service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.183734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.184618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.184917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.185226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.186177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.188052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.216998 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3968/8044] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:43.221379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.233782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d395a53-ca8a-4817-8e8e-81909d20237d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.309816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.310507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.311013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.311135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.311861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.314195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.338447 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4077/8045] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:43.340090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.350847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca86e99-5788-44c7-bd65-f042b578880a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.356479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.357280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.357600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.357958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.358751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.360483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.372490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3969/8046] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:43.376615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.386571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40802858-9f03-418f-a6b7-682a5b1838e6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.391345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.392016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.392306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.392622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.393347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.394962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6676ff-273b-4f6a-ae22-9709dec8fa01 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.405191 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4078/8047] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:43.409959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.424899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78349-7750-4474-928f-aa1f2a995157 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.430780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.431681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.431969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.432252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] PATH_INFO: `/v3/projects/c42f6e9898fd462f894f6b9e2ab1253a/users/4ffdd8449eae4cae900a1e1636c8bfee/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.448749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42f6e9898fd462f894f6b9e2ab1253a, user_id=4ffdd8449eae4cae900a1e1636c8bfee, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.451437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.466565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3970/8048] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:43 2022] PUT /identity/v3/projects/c42f6e9898fd462f894f6b9e2ab1253a/users/4ffdd8449eae4cae900a1e1636c8bfee/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:43.478986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.479528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.479528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.510480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] MFA Rules not processed for user `4ffdd8449eae4cae900a1e1636c8bfee`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:43.511715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.546359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.548413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.577232 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4079/8049] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:43.581697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.612867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b25ce-db8e-4d5c-a218-b28543a79307 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.619278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.620330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.620484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.620727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] PATH_INFO: `/v3/users/abd43e2c4034489b950de213f04aea0e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.621943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd43e2c4034489b950de213f04aea0e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.623864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.643682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f6a3-cb2b-4ea3-a5d7-efb3f9394367 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.649545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.650165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.650495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.650777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.651469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.653472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.670964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd43e2c4034489b950de213f04aea0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:43.679251 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4080/8050] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:43.683117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd43e2c4034489b950de213f04aea0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:43.683242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.683810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd43e2c4034489b950de213f04aea0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:43.684973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.691404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd43e2c4034489b950de213f04aea0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:43.698265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5e465158-8fcc-4381-a772-3f3d43e7783b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd43e2c4034489b950de213f04aea0e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:43.704283 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3971/8051] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:43 2022] DELETE /identity/v3/users/abd43e2c4034489b950de213f04aea0e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:43.708577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.709472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.709777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.726989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:43.728197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.751651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdc083-06bf-490f-a883-0e5a487718f8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.788303 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3972/8052] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:43.798286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.799677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:43.807062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.807745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.808030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.808308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.809036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.810961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.831716 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4081/8053] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:43 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:43.835960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.845395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d422e-05b8-4e7c-8ae5-e7945ef1392e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.850003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.850637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.850919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.851194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.851898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.853547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.859832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3bb75-1a76-44d8-abde-fc18a698b69b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.863536 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4082/8054] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:43.864765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.865481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.865747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.866019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.867263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.875262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.876795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.876910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da5266-7f25-4ebe-8c8e-c6c7f0893acf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:43.882673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:43.883545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:43.883831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:43.884207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] PATH_INFO: `/v3/projects/017a8680642748c988daa01f7edbda9b/users/d6d984e9468243b29d850c73add6eace/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:43.889129 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3973/8055] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:20:43.905810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=017a8680642748c988daa01f7edbda9b, user_id=d6d984e9468243b29d850c73add6eace, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:43.908524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:43.924410 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4083/8056] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:43 2022] PUT /identity/v3/projects/017a8680642748c988daa01f7edbda9b/users/d6d984e9468243b29d850c73add6eace/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:43.929075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:43.942326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27530335-0a99-4f9c-bc03-dfa6edf7647b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.001938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.002609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.002895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.003168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.003887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.006233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0a32-ca35-4cfc-ad62-dd7da3f3c5ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.016870 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3974/8057] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:44.020996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.031986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07fedb-75e8-4892-b7a2-ea0e76da8c3e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.037267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.038150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.038432 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.038734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] PATH_INFO: `/v3/projects/017a8680642748c988daa01f7edbda9b/users/d6d984e9468243b29d850c73add6eace/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.040959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=017a8680642748c988daa01f7edbda9b, user_id=d6d984e9468243b29d850c73add6eace, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.043807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.055382 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4084/8058] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:44 2022] PUT /identity/v3/projects/017a8680642748c988daa01f7edbda9b/users/d6d984e9468243b29d850c73add6eace/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:44.065702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.066074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.066398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.093731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] MFA Rules not processed for user `d6d984e9468243b29d850c73add6eace`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:44.094945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:44.163814 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3975/8059] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:44.174553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.182309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.183987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:44.244674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d8174-9cb0-4801-8984-769a16f635cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.248483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.249268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.249549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.249830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.256458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df3de7-c25d-46f4-a2aa-62ef344b617c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.259214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.260702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f58497-3dae-42c1-ab20-b93bf9b53c68 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.261231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.262084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.262371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.262681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] PATH_INFO: `/v3/projects/25d545f94685450c9e6b1f53a01f20c5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.263908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d545f94685450c9e6b1f53a01f20c5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.265859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.271803 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4085/8060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:44.325184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d545f94685450c9e6b1f53a01f20c5', 'request_id': 'req-de9b8824-ba3c-43f2-880f-05f2abe10bbb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:44.332999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d545f94685450c9e6b1f53a01f20c5', 'request_id': 'req-de9b8824-ba3c-43f2-880f-05f2abe10bbb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:44.339807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d545f94685450c9e6b1f53a01f20c5', 'request_id': 'req-de9b8824-ba3c-43f2-880f-05f2abe10bbb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:44.354697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] The token cache is being invalidate because project 25d545f94685450c9e6b1f53a01f20c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:44.355307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:44.357363 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-de9b8824-ba3c-43f2-880f-05f2abe10bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:44.359303 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3976/8061] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:44 2022] DELETE /identity/v3/projects/25d545f94685450c9e6b1f53a01f20c5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:44.365802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.366178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.366535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.386104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:44.387726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:44.464511 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4086/8062] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:44.471842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.472791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.473221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.501053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:44.502586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:44.512959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3977/8063] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:44.517379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.529531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fad801-1f81-49d6-abdb-899316a10511 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.534915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.535575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.535856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.536133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.537535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:44.537892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.539458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.552675 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4087/8064] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:44.560063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.570167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615fb6-7b86-44a2-9849-daefa610f053 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.575049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.575745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.576030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.576311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.577123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.578958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.609959 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3978/8065] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:44.611216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.621591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2276-9f01-47cb-91cf-fa4b821a68b3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.678083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.678634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.678924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.679206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.679915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.681906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.704609 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4088/8066] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:44.709281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.719589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf341b-37c7-409e-9525-bfd25ce141a7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.724615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.725282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.725600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.725882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.726639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.728290 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.740363 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3979/8067] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:44.745162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.756743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1072651-04a8-48d7-be33-0b642cac28dc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.766894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.767801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.768708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.769065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.769879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.772188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd47554-49d8-45ff-aa64-63dd7fb2039e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.785691 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4089/8068] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:44.793834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.801874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b86de-319d-4ad7-9c17-ed18177a7489 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:44.811624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:44.812637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.812946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.813224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] PATH_INFO: `/v3/projects/e4659f11fe174973a3e46f4a6dc70a06/users/11b6b2b8f4b34dab9bfcfd9eb142e47a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.829516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4659f11fe174973a3e46f4a6dc70a06, user_id=11b6b2b8f4b34dab9bfcfd9eb142e47a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:44.832367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:44.850526 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3980/8069] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:44 2022] PUT /identity/v3/projects/e4659f11fe174973a3e46f4a6dc70a06/users/11b6b2b8f4b34dab9bfcfd9eb142e47a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:44.861677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:44.862103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:44.862294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:44.893326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] MFA Rules not processed for user `11b6b2b8f4b34dab9bfcfd9eb142e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:44.894548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:44.981442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:44.981852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4090/8070] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:45.053834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b943b01-09fa-4b16-9c36-daacd2400006 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.058745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.059410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.060095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.060095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.060669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.062592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.105271 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3981/8071] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:44 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:45.106325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.117850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8cfe-9123-4506-99a7-31a1327d2b5b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.178651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.179332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.179727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.180013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.180740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.182663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.204629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4091/8072] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:45 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:45.209591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.219833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d33b6-f744-4412-8897-14cdb4b045cc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.225944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.226767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.226993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.227328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.228130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.229881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.242279 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3982/8073] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:45.246838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.257386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbda7b4-f6ed-4688-ab8f-5c79aa0678ed admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.262091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.262979 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.263266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.263542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] PATH_INFO: `/v3/projects/502c9dc8da5e461e9db515356841d8d7/users/7cafb79eaaac4b2cbb70dd3b9a715205/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.278048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502c9dc8da5e461e9db515356841d8d7, user_id=7cafb79eaaac4b2cbb70dd3b9a715205, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.280725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.294590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4092/8074] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:45 2022] PUT /identity/v3/projects/502c9dc8da5e461e9db515356841d8d7/users/7cafb79eaaac4b2cbb70dd3b9a715205/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:45.299065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.310904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffa5e-a36e-4ddd-b672-b18f13abad0c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.367075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.367741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.368020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.368303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.369047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.370627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c716-9d2b-4407-a0b7-88999a0e82e9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.383443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3983/8075] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:45.384718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.395286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dbc1-903f-4c86-99d0-1812dce52471 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.400222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.401229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.401520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.401851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] PATH_INFO: `/v3/projects/502c9dc8da5e461e9db515356841d8d7/users/7cafb79eaaac4b2cbb70dd3b9a715205/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.403932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=502c9dc8da5e461e9db515356841d8d7, user_id=7cafb79eaaac4b2cbb70dd3b9a715205, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.406648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.417673 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4093/8076] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:45 2022] PUT /identity/v3/projects/502c9dc8da5e461e9db515356841d8d7/users/7cafb79eaaac4b2cbb70dd3b9a715205/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:45.428829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.429121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.429403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.457902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] MFA Rules not processed for user `7cafb79eaaac4b2cbb70dd3b9a715205`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:45.459171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:45.531683 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3984/8077] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:45.543208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.545304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:45.604917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33484368-ed51-41c6-86e6-fca7682cd30b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.608654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.609516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.609797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.610096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.620674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.622162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b2a0e-44dc-40a1-a888-312477c185d4 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.632598 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4094/8078] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:45 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:45.773398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:45.839364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c5491-46b5-4827-a446-a5e8607b991e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:45.844035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:45.845127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.845413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.845689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] PATH_INFO: `/v3/users/11b6b2b8f4b34dab9bfcfd9eb142e47a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.846904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b6b2b8f4b34dab9bfcfd9eb142e47a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:45.848898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:45.897616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b6b2b8f4b34dab9bfcfd9eb142e47a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:45.909571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b6b2b8f4b34dab9bfcfd9eb142e47a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:45.910368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b6b2b8f4b34dab9bfcfd9eb142e47a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:45.919878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b6b2b8f4b34dab9bfcfd9eb142e47a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:45.927171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b6b2b8f4b34dab9bfcfd9eb142e47a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:45.933345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3985/8079] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:45 2022] DELETE /identity/v3/users/11b6b2b8f4b34dab9bfcfd9eb142e47a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:45.937990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:45.938304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:45.938579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:45.959291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:45.960547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:46.018610 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4095/8080] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:46.028971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:46.030389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:46.089831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd35f4-600f-47e3-9044-c50c2743e358 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:46.093392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:46.094042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:46.094326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:46.094603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:46.103663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:46.105121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:46.114981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3986/8081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:46.249671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:46.251222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:46.271841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0871bb-c841-4f6d-9be8-3d0ea507e2b6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:46.276046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:46.277150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:46.277652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:46.278251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:46.280853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:46.342452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:46.344061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:46.356498 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4096/8082] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:46.778260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:46.779749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:46.793373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d5bf-02fc-4896-8b98-d4e5e9dadcd2 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:46.798355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:46.799274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:46.799564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:46.799846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] PATH_INFO: `/v3/projects/e4659f11fe174973a3e46f4a6dc70a06` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:46.801070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4659f11fe174973a3e46f4a6dc70a06)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:46.803630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:46.878518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4659f11fe174973a3e46f4a6dc70a06', 'request_id': 'req-39198797-1856-4ff2-9693-a1d932d3b02d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:46.888936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4659f11fe174973a3e46f4a6dc70a06', 'request_id': 'req-39198797-1856-4ff2-9693-a1d932d3b02d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:46.894794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4659f11fe174973a3e46f4a6dc70a06', 'request_id': 'req-39198797-1856-4ff2-9693-a1d932d3b02d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:46.909787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] The token cache is being invalidate because project e4659f11fe174973a3e46f4a6dc70a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:46.910088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:46.910918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:46.916161 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3987/8083] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:46 2022] DELETE /identity/v3/projects/e4659f11fe174973a3e46f4a6dc70a06 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:46.917353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:46.929272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce073ba-8ac9-4e70-ba09-4cc44c83eabb service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:46.994747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:46.996216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:46.996608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:46.996928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] PATH_INFO: `/v3/users/7cafb79eaaac4b2cbb70dd3b9a715205` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:46.998164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cafb79eaaac4b2cbb70dd3b9a715205)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.000186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.050563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cafb79eaaac4b2cbb70dd3b9a715205'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.058889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cafb79eaaac4b2cbb70dd3b9a715205'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.059777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cafb79eaaac4b2cbb70dd3b9a715205'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.060622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cafb79eaaac4b2cbb70dd3b9a715205'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.068158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cafb79eaaac4b2cbb70dd3b9a715205'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.087275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4097/8084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:46 2022] DELETE /identity/v3/users/7cafb79eaaac4b2cbb70dd3b9a715205 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:47.262387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.263906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.277561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39198797-1856-4ff2-9693-a1d932d3b02d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.336059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.337404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.337768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.338094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] PATH_INFO: `/v3/users/4ffdd8449eae4cae900a1e1636c8bfee` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.339336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffdd8449eae4cae900a1e1636c8bfee)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.341317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.373358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.375217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.390614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afc80d-e7cd-4dbb-a2b8-94a0347addd1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.395515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffdd8449eae4cae900a1e1636c8bfee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.395688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.397564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.397866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.398149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] PATH_INFO: `/v3/projects/502c9dc8da5e461e9db515356841d8d7` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.399490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502c9dc8da5e461e9db515356841d8d7)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.401346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.409282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffdd8449eae4cae900a1e1636c8bfee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.410075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffdd8449eae4cae900a1e1636c8bfee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.418349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffdd8449eae4cae900a1e1636c8bfee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.425490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-509fed68-9a79-4527-916a-c276c13203f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffdd8449eae4cae900a1e1636c8bfee'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.432420 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3988/8085] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:47 2022] DELETE /identity/v3/users/4ffdd8449eae4cae900a1e1636c8bfee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:47.438055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df6dd-5162-4180-9c29-9e07a09317d1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.439801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df6dd-5162-4180-9c29-9e07a09317d1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.440141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588df6dd-5162-4180-9c29-9e07a09317d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.457031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502c9dc8da5e461e9db515356841d8d7', 'request_id': 'req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.457997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-588df6dd-5162-4180-9c29-9e07a09317d1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:47.459793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-588df6dd-5162-4180-9c29-9e07a09317d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.464902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502c9dc8da5e461e9db515356841d8d7', 'request_id': 'req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.473100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502c9dc8da5e461e9db515356841d8d7', 'request_id': 'req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.484448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] The token cache is being invalidate because project 502c9dc8da5e461e9db515356841d8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:47.484870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.485488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7ec1ac1b-b37d-468c-8be5-3eb625e3f8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:47.487301 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4098/8086] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:47 2022] DELETE /identity/v3/projects/502c9dc8da5e461e9db515356841d8d7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:47.491884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.492257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.492685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.510612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:47.511933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.521724 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3989/8087] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:47.524995 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4099/8088] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:47.532754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.533088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.533400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.533619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.535020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.552796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:47.554036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.562297 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3990/8089] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:47.566402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.576216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720c0f-21de-4824-8dd5-10a7d0ac4a76 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.581043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.581704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.581993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.582274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.582990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:47.583304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.585493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.596415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd5252-7695-4a61-b6cd-067c6633a744 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.600392 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3991/8090] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:47.600574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.601027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.601310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.601428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.601609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.610713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.611056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da69a03-539c-47d6-8eba-5a4f01b87063 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.612168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.615708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.616341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.616657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.616945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.617668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.619538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.621543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4100/8091] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:20:47.647283 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3992/8092] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:47.651078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.661004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc729-f7e8-4d51-b988-0fd0dd72fdc8 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.717590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.718391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.718777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.719062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.719858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.721884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.747291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4101/8093] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:47.748641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.760204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676e8f-e9e7-4d62-9fc2-58d3df71ab62 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.777815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.779571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.780110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.780796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.783498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.785446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.797690 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3993/8094] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:47.801452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.814904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed7d58-e427-4f56-9ae7-3bed3147640b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.821129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.822023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.822327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.822592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.823319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.824969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.837486 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4102/8095] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:47.841168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.856690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcaaf-cec1-4d92-9395-11a2cfe0e485 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:47.864794 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:47.865712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.866000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.866442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] PATH_INFO: `/v3/projects/15fa4149e3344e5c9386adc4bafbe8d1/users/2d2e87be8bbc41848cd39312d15de81c/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.883876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa4149e3344e5c9386adc4bafbe8d1, user_id=2d2e87be8bbc41848cd39312d15de81c, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:47.886822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf656a4a-d65e-4e19-9afe-746c1f017d84 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:47.907509 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3994/8096] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:47 2022] PUT /identity/v3/projects/15fa4149e3344e5c9386adc4bafbe8d1/users/2d2e87be8bbc41848cd39312d15de81c/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:47.918617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:47.921204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.924654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:47.925136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:47.925581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:47.946837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:47.948978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:47.949955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bfa08-bff9-463e-853c-bd5b58541d97 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.009554 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3995/8097] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:48.015975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.016995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.017493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.017983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] PATH_INFO: `/v3/projects/c42f6e9898fd462f894f6b9e2ab1253a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.019152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.019384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42f6e9898fd462f894f6b9e2ab1253a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.020682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.021409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.071703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42f6e9898fd462f894f6b9e2ab1253a', 'request_id': 'req-16bf89de-bcfa-4185-810a-ab917fe9fe01'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.078980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42f6e9898fd462f894f6b9e2ab1253a', 'request_id': 'req-16bf89de-bcfa-4185-810a-ab917fe9fe01'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.086369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbc5c5-ad53-4e7a-9804-f75ec2e6a071 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.087908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42f6e9898fd462f894f6b9e2ab1253a', 'request_id': 'req-16bf89de-bcfa-4185-810a-ab917fe9fe01'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.100448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] The token cache is being invalidate because project c42f6e9898fd462f894f6b9e2ab1253a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:48.101076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.101931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.103827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4103/8098] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:47 2022] DELETE /identity/v3/projects/c42f6e9898fd462f894f6b9e2ab1253a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:48.107526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.109079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.146015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.146698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.147194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.147480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.149357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.173791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf89de-bcfa-4185-810a-ab917fe9fe01 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.179133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.180005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.180291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.180602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] PATH_INFO: `/v3/users/d6d984e9468243b29d850c73add6eace` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.181870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d984e9468243b29d850c73add6eace)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.183807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.210891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.212319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.222048 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3996/8099] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:20:48.231622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d984e9468243b29d850c73add6eace'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.238273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d984e9468243b29d850c73add6eace'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.238899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d984e9468243b29d850c73add6eace'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.239590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d984e9468243b29d850c73add6eace'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.247577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d73ad9ae-da30-44b7-b4ae-26ac4a5a171d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d984e9468243b29d850c73add6eace'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.265309 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4104/8100] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:48 2022] DELETE /identity/v3/users/d6d984e9468243b29d850c73add6eace => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:48.605847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.616838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c942ec-eefb-4f3d-a9d1-1551eee36b3c service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.676508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.677968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.678257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.678538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] PATH_INFO: `/v3/projects/017a8680642748c988daa01f7edbda9b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.679746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=017a8680642748c988daa01f7edbda9b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.681734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.729671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017a8680642748c988daa01f7edbda9b', 'request_id': 'req-efe9c4a0-5e9f-4653-9943-7966baa2a48d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.736564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017a8680642748c988daa01f7edbda9b', 'request_id': 'req-efe9c4a0-5e9f-4653-9943-7966baa2a48d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.742734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017a8680642748c988daa01f7edbda9b', 'request_id': 'req-efe9c4a0-5e9f-4653-9943-7966baa2a48d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.754969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] The token cache is being invalidate because project 017a8680642748c988daa01f7edbda9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:48.755421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.756581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-efe9c4a0-5e9f-4653-9943-7966baa2a48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:48.761123 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3997/8101] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:48 2022] DELETE /identity/v3/projects/017a8680642748c988daa01f7edbda9b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:48.762820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3683483-31d4-44b2-84ba-077522e59b9f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.763115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3683483-31d4-44b2-84ba-077522e59b9f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.763394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3683483-31d4-44b2-84ba-077522e59b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.781488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c3683483-31d4-44b2-84ba-077522e59b9f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:48.782605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c3683483-31d4-44b2-84ba-077522e59b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.851437 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4105/8102] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:48.854450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.854940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.855159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.858179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.858475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.858757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.875408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:48.877001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.885323 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3998/8103] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:48.885862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] MFA Rules not processed for user `2d2e87be8bbc41848cd39312d15de81c`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:48.887181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.889526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.899480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a4b11-25bb-49c0-baf1-008f22c5f766 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.904403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.905196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.905486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.905772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.906506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:48.906821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.908509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.929408 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 3999/8104] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:48.930553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.944332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09752d43-3f8a-4ab7-abff-0c54766ecd90 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:48.951106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:48.952005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:48.952484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:48.952920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:48.953763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:48.955846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:48.975084 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4106/8105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:48.979612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.981266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:48.993656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4000/8106] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:48.997563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:48.999138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d656b8-64f4-4020-b3ee-9235e4b2d787 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.068797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.069944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.070238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.070515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.071303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.073414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.082451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c438-7e24-4cc1-927a-9586e6364d64 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.087819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.088536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.088948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.089237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.089941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.092109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.106648 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4107/8107] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:49.110510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.116539 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4001/8108] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:48 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:20:49.123905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.136026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aa971-1e02-4f49-950a-fca55ec8009f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.178681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e7c0c-1e86-4438-a365-bf5a9179c075 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.185493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.186167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.186504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.186785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.187546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.189512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.199190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.199913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.200268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.200774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.201575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.203380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.214577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4108/8109] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:49 2022] POST /identity/v3/users => generated 308 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:49.217139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.222131 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4002/8110] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:49.223237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.229376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb01897-5444-4557-bc24-54574d18e95e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.234809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.235721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.236068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.236293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.236631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7a3af-db0b-4c79-8743-c289ed7c1521 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.237084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.238745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.241616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.242309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.242601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.242914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.243636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.245364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.249459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4109/8111] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:49.254046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.257237 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4003/8112] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:49.261739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.272045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49055a53-43ff-4542-8a65-b00e2b54533e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.276297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff906b-5dd3-4926-b20f-f21cdb340be2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.280878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.281835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.282037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.282399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] PATH_INFO: `/v3/projects/5b4643b7f2224581aad136b362fdf260/users/7652bd604f3f4b8b9c6e57dbd08d73b0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.283640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.284765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.285157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.285722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] PATH_INFO: `/v3/projects/f1b733e7cdc24ae89cbed4bf8b8653d6/users/b5a8117e5bac4c529454a61fcb217411/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.299247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4643b7f2224581aad136b362fdf260, user_id=7652bd604f3f4b8b9c6e57dbd08d73b0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.301989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.306486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b733e7cdc24ae89cbed4bf8b8653d6, user_id=b5a8117e5bac4c529454a61fcb217411, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.310205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80e53-0428-44a9-98a6-52a638b3ba1c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.318661 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4110/8113] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:49 2022] PUT /identity/v3/projects/5b4643b7f2224581aad136b362fdf260/users/7652bd604f3f4b8b9c6e57dbd08d73b0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:49.322660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.328579 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4004/8114] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:49 2022] PUT /identity/v3/projects/f1b733e7cdc24ae89cbed4bf8b8653d6/users/b5a8117e5bac4c529454a61fcb217411/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:49.339242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.339537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.339818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.368327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] MFA Rules not processed for user `b5a8117e5bac4c529454a61fcb217411`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:49.369776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:49.403754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1437-4835-41e2-9aeb-f960c214727e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.448824 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4005/8115] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:49.457558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.459001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:49.471585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.472394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.472819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.473185 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.473915 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.475543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.485452 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4111/8116] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:20:49.489557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:49.499951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526ac8-ae5a-4448-9f28-ebe593e94dc0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.504702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.506143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.506427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.506705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] PATH_INFO: `/v3/projects/5b4643b7f2224581aad136b362fdf260/users/7652bd604f3f4b8b9c6e57dbd08d73b0/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.508742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4643b7f2224581aad136b362fdf260, user_id=7652bd604f3f4b8b9c6e57dbd08d73b0, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.511370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865b40-16f6-42c7-a7a2-17705e1d859a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.521554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333b838-b5d9-4acf-8242-9a02c5d4b882 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:49.523252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4112/8117] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:49 2022] PUT /identity/v3/projects/5b4643b7f2224581aad136b362fdf260/users/7652bd604f3f4b8b9c6e57dbd08d73b0/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:20:49.576088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:49.576833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:49.577237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:49.577523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:49.635486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:49.637090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:49.646545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4006/8118] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:50.255246 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:50.255829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:50.255829 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:50.293058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] MFA Rules not processed for user `7652bd604f3f4b8b9c6e57dbd08d73b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:50.294507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:50.390717 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4113/8119] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:52.477701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:52.562124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aeddf1-d88e-4f19-88fc-5bc27213d1d0 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:52.568291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:52.569739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:52.570238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:52.573075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] PATH_INFO: `/v3/users/2d2e87be8bbc41848cd39312d15de81c` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:52.574155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2e87be8bbc41848cd39312d15de81c)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:52.579721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:52.645516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2e87be8bbc41848cd39312d15de81c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:52.663198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2e87be8bbc41848cd39312d15de81c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:52.664187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2e87be8bbc41848cd39312d15de81c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:52.676049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2e87be8bbc41848cd39312d15de81c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:52.694920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2e87be8bbc41848cd39312d15de81c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:52.707498 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4007/8120] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:52 2022] DELETE /identity/v3/users/2d2e87be8bbc41848cd39312d15de81c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:52.972578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:52.999200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a819-77ee-42af-9a8d-f22791c0ed8c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:53.066583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:53.067464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:53.067780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:53.068058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] PATH_INFO: `/v3/projects/15fa4149e3344e5c9386adc4bafbe8d1` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:53.071407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fa4149e3344e5c9386adc4bafbe8d1)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:53.073374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:53.158472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fa4149e3344e5c9386adc4bafbe8d1', 'request_id': 'req-53919171-b081-4bca-aae2-23ee5441b613'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.167463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fa4149e3344e5c9386adc4bafbe8d1', 'request_id': 'req-53919171-b081-4bca-aae2-23ee5441b613'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.176802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fa4149e3344e5c9386adc4bafbe8d1', 'request_id': 'req-53919171-b081-4bca-aae2-23ee5441b613'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.203101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] The token cache is being invalidate because project 15fa4149e3344e5c9386adc4bafbe8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:53.203547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.204229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.205854 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4114/8121] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:52 2022] DELETE /identity/v3/projects/15fa4149e3344e5c9386adc4bafbe8d1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:53.210507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:53.211986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:53.229052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622572d-e6b0-4381-b7cb-dc942931bf94 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:53.299728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:53.300607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:53.300895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:53.301172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] PATH_INFO: `/v3/users/7652bd604f3f4b8b9c6e57dbd08d73b0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:53.302493 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7652bd604f3f4b8b9c6e57dbd08d73b0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:53.304506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:53.358674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7652bd604f3f4b8b9c6e57dbd08d73b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.375330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7652bd604f3f4b8b9c6e57dbd08d73b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.376094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7652bd604f3f4b8b9c6e57dbd08d73b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.385437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7652bd604f3f4b8b9c6e57dbd08d73b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.393551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-db3f6ac2-c45a-4ba5-971c-5122e54739e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7652bd604f3f4b8b9c6e57dbd08d73b0'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.400603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4008/8122] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:20:53 2022] DELETE /identity/v3/users/7652bd604f3f4b8b9c6e57dbd08d73b0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:53.677359 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:53.679091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:53.695466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53919171-b081-4bca-aae2-23ee5441b613 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:53.801016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:53.802582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:53.802883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:53.803169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] PATH_INFO: `/v3/projects/5b4643b7f2224581aad136b362fdf260` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:53.805104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4643b7f2224581aad136b362fdf260)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:53.807226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:53.863868 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4643b7f2224581aad136b362fdf260', 'request_id': 'req-823f6c49-45cf-4d81-96b6-918eb54b8ec1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.876282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4643b7f2224581aad136b362fdf260', 'request_id': 'req-823f6c49-45cf-4d81-96b6-918eb54b8ec1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.885602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4643b7f2224581aad136b362fdf260', 'request_id': 'req-823f6c49-45cf-4d81-96b6-918eb54b8ec1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.898499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] The token cache is being invalidate because project 5b4643b7f2224581aad136b362fdf260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:20:53.899023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.899860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-823f6c49-45cf-4d81-96b6-918eb54b8ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:20:53.901901 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4115/8123] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:20:53 2022] DELETE /identity/v3/projects/5b4643b7f2224581aad136b362fdf260 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:53.907118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:53.907574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:53.907693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:53.927609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:53.929040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:54.036658 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4009/8124] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:20:54.039631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.040129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.040223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.077952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:54.084103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:54.108351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4116/8125] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:54.112227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.125125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0378a8-712c-4d98-b4a8-b6bc9039d5be None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.132724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.133770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.134209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.134642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.136380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:20:54.137971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.141392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.160150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4010/8126] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:20:54.164138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.176797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780aae9-fc29-4d78-b51c-e28b1d8c068e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.188475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.189164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.189461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.189744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.190585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.192667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.228896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4117/8127] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:54.233318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.251417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64d5ef-6c6e-4d08-affb-7aaea401f3ac admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.324197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.325020 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.325308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.325654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.326381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.328575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.356170 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4011/8128] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:54.357425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.370322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7146be-2322-4e0f-9f2a-9d302db17b12 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.374699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.376298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.376298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.376298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.377039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.378735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.390968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4118/8129] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:54.394739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.405728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711883c-25d3-4ea7-bee0-713cc0bdc8b7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.413741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.413895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.414226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.414443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.415165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.416813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530069e-540a-4330-a8aa-9350340a1e21 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.428900 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4012/8130] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:54.432443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.444237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370da5-4c70-4cac-9578-8842e328bc19 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.450441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.451424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.451780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.452184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] PATH_INFO: `/v3/projects/880d022e832643e18f79bf34a0c60b3a/users/87bc28a7e503451f85e112d26dbf91aa/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.469567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880d022e832643e18f79bf34a0c60b3a, user_id=87bc28a7e503451f85e112d26dbf91aa, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.472421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.488517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4119/8131] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:54 2022] PUT /identity/v3/projects/880d022e832643e18f79bf34a0c60b3a/users/87bc28a7e503451f85e112d26dbf91aa/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:54.497638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.498514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.498514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.526673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] MFA Rules not processed for user `87bc28a7e503451f85e112d26dbf91aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:54.527999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:54.604629 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4013/8132] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:54.611468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.685394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99c436-23f3-4426-beac-240439855451 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.690342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.691052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.691440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.691726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.692421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.694411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.726064 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4120/8133] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:54.727285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.738204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcaa24-92b1-4467-a932-591dcbdace69 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.794234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.795167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.795454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.795729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.796429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.798369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.820447 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4014/8134] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:20:54 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:20:54.824351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.835422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c640-b9cc-4ca2-882e-673b8df8c79b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.840147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.840872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.841157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.841434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.842152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.843785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.859949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4121/8135] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:54.861283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.871745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9fcf-faa1-4fa2-9610-dc5aa85cd064 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:54.876631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:54.877543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:54.877859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:54.878136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] PATH_INFO: `/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a/users/308aa900200c43248bce07304ff99a94/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:54.894468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fd87b3d9b94054ba5ad227e0ab8e3a, user_id=308aa900200c43248bce07304ff99a94, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:54.897689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:54.917540 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4015/8136] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:54 2022] PUT /identity/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a/users/308aa900200c43248bce07304ff99a94/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:54.921582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:54.934961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847c7e9-06f6-452e-9ba5-e0c6a3d6656f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:55.002575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:55.003260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:55.003554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:55.003835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:55.004595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:55.006265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cc4fa-04a3-4ed7-af21-3ad861c3f6a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:55.016945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4122/8137] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:20:55.021452 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:55.032106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1851a-a123-436a-baf4-b5e111c05568 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:55.038006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:55.038925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:55.039379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:55.039838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] PATH_INFO: `/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a/users/308aa900200c43248bce07304ff99a94/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:55.042172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fd87b3d9b94054ba5ad227e0ab8e3a, user_id=308aa900200c43248bce07304ff99a94, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:55.045813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:55.058656 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4016/8138] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:20:55 2022] PUT /identity/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a/users/308aa900200c43248bce07304ff99a94/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:20:55.069382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:55.070300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:55.070745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:55.102947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] MFA Rules not processed for user `308aa900200c43248bce07304ff99a94`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:20:55.104568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:55.182950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4123/8139] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:20:55.194628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:55.196362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:20:55.254648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d4e2b-b0a7-4d84-8abb-fe4592abf01f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:55.259050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:55.259718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:55.259998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:55.260281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:55.270371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:55.272397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:55.283074 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4017/8140] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:20:55.359680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:20:55.371070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17504fe9-9c94-4514-9d36-9f274f031ef0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:20:55.374722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:20:55.375376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:20:55.375661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:20:55.375967 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:20:55.451133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:20:55.452660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:20:55.467427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4124/8141] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:00.184826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:00.186899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:00.266340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df1558-2bec-4a02-b0e7-558b6957d279 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:00.271498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:00.272371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:00.272697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:00.272992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] PATH_INFO: `/v3/users/c46cec44517a4a3a9aa20a1789097ce5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:00.274193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46cec44517a4a3a9aa20a1789097ce5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:00.276122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:00.328870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46cec44517a4a3a9aa20a1789097ce5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.343281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46cec44517a4a3a9aa20a1789097ce5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.344091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46cec44517a4a3a9aa20a1789097ce5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.352263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46cec44517a4a3a9aa20a1789097ce5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.359866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46cec44517a4a3a9aa20a1789097ce5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.366062 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4018/8142] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:00 2022] DELETE /identity/v3/users/c46cec44517a4a3a9aa20a1789097ce5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:00.551382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:00.586949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e948977-d978-4c56-9c67-35a9bb67bcde service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:00.652727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:00.653769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:00.654151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:00.654547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] PATH_INFO: `/v3/projects/2e8bc61a3e3149c3bb79c449929eb875` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:00.656028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8bc61a3e3149c3bb79c449929eb875)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:00.658674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:00.735710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8bc61a3e3149c3bb79c449929eb875', 'request_id': 'req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.744815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8bc61a3e3149c3bb79c449929eb875', 'request_id': 'req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.753823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8bc61a3e3149c3bb79c449929eb875', 'request_id': 'req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.769245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] The token cache is being invalidate because project 2e8bc61a3e3149c3bb79c449929eb875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:00.769455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.770178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.773229 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4125/8143] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:00 2022] DELETE /identity/v3/projects/2e8bc61a3e3149c3bb79c449929eb875 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:00.777386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:00.779032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:00.794558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719881a-60ac-4714-b335-624743133d63 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:00.859089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:00.860249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:00.860584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:00.860968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] PATH_INFO: `/v3/users/ff18ba17089b4b57bf12ef928352749a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:00.862584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff18ba17089b4b57bf12ef928352749a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:00.865427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:00.912034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff18ba17089b4b57bf12ef928352749a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.923747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff18ba17089b4b57bf12ef928352749a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.924416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff18ba17089b4b57bf12ef928352749a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.932425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff18ba17089b4b57bf12ef928352749a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.939346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-189b19b3-b299-4edc-a6ea-53bf24973742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff18ba17089b4b57bf12ef928352749a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:00.945302 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4019/8144] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:00 2022] DELETE /identity/v3/users/ff18ba17089b4b57bf12ef928352749a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:01.118458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.120009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:01.157369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a565c-28c8-4f8a-a10a-6de5946c1aa7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.226008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.226891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.227178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.227486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] PATH_INFO: `/v3/projects/3b82fb5867ea48bbb8aeccfdae749984` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.229081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b82fb5867ea48bbb8aeccfdae749984)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.231063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.296078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b82fb5867ea48bbb8aeccfdae749984', 'request_id': 'req-b84d392c-2249-41ed-82b4-7902eaace482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:01.302956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b82fb5867ea48bbb8aeccfdae749984', 'request_id': 'req-b84d392c-2249-41ed-82b4-7902eaace482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:01.313034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b82fb5867ea48bbb8aeccfdae749984', 'request_id': 'req-b84d392c-2249-41ed-82b4-7902eaace482'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:01.325240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] The token cache is being invalidate because project 3b82fb5867ea48bbb8aeccfdae749984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:01.325803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:01.326554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-b84d392c-2249-41ed-82b4-7902eaace482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:01.331506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4126/8145] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:01 2022] DELETE /identity/v3/projects/3b82fb5867ea48bbb8aeccfdae749984 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:01.333915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.334836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.335334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.365238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:01.366778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:01.450436 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4020/8146] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:01.459188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.459486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.460635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.483776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:01.485760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:01.497132 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4127/8147] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:01.501782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.513228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c3e83-b714-402b-bab8-7e4a8559a120 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.518723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.519483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.519769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.520059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.522460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:01.522877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.524440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.544974 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4021/8148] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:21:01.546610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.557897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebf11d-2b79-4415-8852-a76136874140 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.567633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.568662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.569585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.569585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.570710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.572283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.607462 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4128/8149] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:01 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:01.611929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.624771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7afc1-5528-46d2-a769-8a5f74c23496 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.707062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.708744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.709106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.709398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.710085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.712065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.741231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4022/8150] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:01 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:01.744963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.757982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a088-cd9a-44ef-a5fb-06f2fe8aa529 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.765082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.765684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.765971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.766248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.767134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.768780 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.781443 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4129/8151] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:01.785332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.797982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4783a93-6903-41c6-90f5-a6ebc939c709 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.803003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.803681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.803975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.804259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.805036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.807371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb77e0-5593-4b32-91e2-5d8e71927faa admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.820139 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4023/8152] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:01.824005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.835250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278ac-e3e6-464e-94b8-a6eb778e477b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:01.840381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:01.841419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.841775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.842123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] PATH_INFO: `/v3/projects/5dd8e0cc060f4c5f8583e0b8bed9aa54/users/3d6a53ed145f478498a1c67807c33bfa/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.858575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd8e0cc060f4c5f8583e0b8bed9aa54, user_id=3d6a53ed145f478498a1c67807c33bfa, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:01.861626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:01.878061 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4130/8153] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:01 2022] PUT /identity/v3/projects/5dd8e0cc060f4c5f8583e0b8bed9aa54/users/3d6a53ed145f478498a1c67807c33bfa/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:01.883713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:01.884090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:01.884590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:01.906111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:01.907335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:01.980312 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4024/8154] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:01.990715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:01.993045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:02.085069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bad4f-03d2-4415-b566-d62b73eb90e5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:02.094252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:02.095171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:02.095525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:02.095907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:02.106134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:02.107604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d3320-cd49-4d22-a082-26af487cdcb8 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:02.118852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4131/8155] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:02.647930 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:02.649436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:02.668602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4143c-de46-43db-91c9-a29563e9f40c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:02.674069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:02.674938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:02.675279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:02.675702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] PATH_INFO: `/v3/users/87bc28a7e503451f85e112d26dbf91aa` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:02.677014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bc28a7e503451f85e112d26dbf91aa)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:02.679001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:02.736497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bc28a7e503451f85e112d26dbf91aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:02.753501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bc28a7e503451f85e112d26dbf91aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:02.754386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bc28a7e503451f85e112d26dbf91aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:02.766169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bc28a7e503451f85e112d26dbf91aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:02.776676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bc28a7e503451f85e112d26dbf91aa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:02.783128 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4025/8156] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:02 2022] DELETE /identity/v3/users/87bc28a7e503451f85e112d26dbf91aa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:02.787890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:02.788345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:02.788554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:02.813636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:02.815120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:02.889674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4132/8157] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:02.900345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:02.902095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:02.970046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45988f-e07c-441d-871f-5560c6395736 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:02.974012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:02.974905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:02.975188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:02.975523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:02.985369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:02.986806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:02.997250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4026/8158] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:03.534080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:03.538844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:03.551644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8964-fa93-4d72-b59b-7a43142d6b5c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:03.559343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:03.560999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:03.562353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:03.562353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:03.562674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:03.562931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] PATH_INFO: `/v3/users/b5a8117e5bac4c529454a61fcb217411` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:03.564551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a8117e5bac4c529454a61fcb217411)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:03.566491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:03.583532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2252f-3a09-489b-8cee-271bdde99e11 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:03.589984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:03.591170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:03.591692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:03.592206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] PATH_INFO: `/v3/projects/880d022e832643e18f79bf34a0c60b3a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:03.594248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880d022e832643e18f79bf34a0c60b3a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:03.596476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:03.627044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a8117e5bac4c529454a61fcb217411'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.650731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a8117e5bac4c529454a61fcb217411'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.652092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a8117e5bac4c529454a61fcb217411'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.653755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a8117e5bac4c529454a61fcb217411'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.659323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880d022e832643e18f79bf34a0c60b3a', 'request_id': 'req-042966e4-d146-416a-8bf3-e8df1a697bc9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.666560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880d022e832643e18f79bf34a0c60b3a', 'request_id': 'req-042966e4-d146-416a-8bf3-e8df1a697bc9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.667091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6c0d4e7f-23e0-48d1-bb46-5b067b6e2c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a8117e5bac4c529454a61fcb217411'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.672850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880d022e832643e18f79bf34a0c60b3a', 'request_id': 'req-042966e4-d146-416a-8bf3-e8df1a697bc9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.691064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] The token cache is being invalidate because project 880d022e832643e18f79bf34a0c60b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:03.691409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.692022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.694102 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4133/8159] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:03 2022] DELETE /identity/v3/users/b5a8117e5bac4c529454a61fcb217411 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:03.694228 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4027/8160] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:03 2022] DELETE /identity/v3/projects/880d022e832643e18f79bf34a0c60b3a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:03.700490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:03.700781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:03.701065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:03.701172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:03.702595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:03.723189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:03.726484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:03.801030 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042966e4-d146-416a-8bf3-e8df1a697bc9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:03.803196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4134/8161] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:03.806419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:03.807132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:03.807419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:03.807730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] PATH_INFO: `/v3/users/308aa900200c43248bce07304ff99a94` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:03.808975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308aa900200c43248bce07304ff99a94)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:03.810933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:03.815607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:03.818630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:03.886360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308aa900200c43248bce07304ff99a94'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.891435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d84fe1-22c6-4499-b2c8-81833da72f00 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:03.896094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:03.896786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:03.897075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:03.897393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:03.905092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308aa900200c43248bce07304ff99a94'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.906070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308aa900200c43248bce07304ff99a94'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.911689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:03.912530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:03.916875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308aa900200c43248bce07304ff99a94'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.925644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308aa900200c43248bce07304ff99a94'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:03.926189 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4135/8162] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:03.932577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4028/8163] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:03 2022] DELETE /identity/v3/users/308aa900200c43248bce07304ff99a94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:04.266243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.277741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573297-b4f2-4d9c-b835-eb8da3896554 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.340069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.341986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:04.384869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.387322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.387766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.388343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] PATH_INFO: `/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.390711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fd87b3d9b94054ba5ad227e0ab8e3a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.394611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.524749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52999-464b-4b3e-85be-95078e26c199 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.555405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fd87b3d9b94054ba5ad227e0ab8e3a', 'request_id': 'req-949d2b93-9393-4eae-90a6-71915f0a3737'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.563930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fd87b3d9b94054ba5ad227e0ab8e3a', 'request_id': 'req-949d2b93-9393-4eae-90a6-71915f0a3737'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.583649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fd87b3d9b94054ba5ad227e0ab8e3a', 'request_id': 'req-949d2b93-9393-4eae-90a6-71915f0a3737'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.605317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] The token cache is being invalidate because project 13fd87b3d9b94054ba5ad227e0ab8e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:04.605608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.606312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-949d2b93-9393-4eae-90a6-71915f0a3737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.608600 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4136/8164] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:04 2022] DELETE /identity/v3/projects/13fd87b3d9b94054ba5ad227e0ab8e3a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:04.615909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.616838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.617128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.617412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] PATH_INFO: `/v3/projects/f1b733e7cdc24ae89cbed4bf8b8653d6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.618740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b733e7cdc24ae89cbed4bf8b8653d6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.620959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.633443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1f458-f4af-44ae-815a-a18a27da87f5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.633744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1f458-f4af-44ae-815a-a18a27da87f5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.634023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1f458-f4af-44ae-815a-a18a27da87f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.671362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-39d1f458-f4af-44ae-815a-a18a27da87f5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:04.672747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39d1f458-f4af-44ae-815a-a18a27da87f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:04.689206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b733e7cdc24ae89cbed4bf8b8653d6', 'request_id': 'req-8155464e-a012-411f-83cb-011bbf4921c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.696685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b733e7cdc24ae89cbed4bf8b8653d6', 'request_id': 'req-8155464e-a012-411f-83cb-011bbf4921c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.702609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b733e7cdc24ae89cbed4bf8b8653d6', 'request_id': 'req-8155464e-a012-411f-83cb-011bbf4921c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.722206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] The token cache is being invalidate because project f1b733e7cdc24ae89cbed4bf8b8653d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:04.722505 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.724176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8155464e-a012-411f-83cb-011bbf4921c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:04.728560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4029/8165] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:04 2022] DELETE /identity/v3/projects/f1b733e7cdc24ae89cbed4bf8b8653d6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:04.732793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ce24-0282-4640-b4cb-1c87cbce2848 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.733295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ce24-0282-4640-b4cb-1c87cbce2848 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.733719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ce24-0282-4640-b4cb-1c87cbce2848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.761062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fca8ce24-0282-4640-b4cb-1c87cbce2848 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:04.762430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fca8ce24-0282-4640-b4cb-1c87cbce2848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:04.769753 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4137/8166] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:04.779974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.780284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.780595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.781888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4030/8167] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:04.784189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01da-bde5-49f0-863b-622db3446661 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.784499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01da-bde5-49f0-863b-622db3446661 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.784781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af01da-bde5-49f0-863b-622db3446661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.803957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:04.805219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:04.805757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-68af01da-bde5-49f0-863b-622db3446661 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:04.807068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-68af01da-bde5-49f0-863b-622db3446661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:04.814954 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4138/8168] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:04.818719 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4031/8169] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:04.820166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.822791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af01da-bde5-49f0-863b-622db3446661 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.834588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af01da-bde5-49f0-863b-622db3446661 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.837545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2707c-309d-427c-8c82-87e05cf1144e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.843353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.844091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.844479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.844673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.844959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.845851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:04.846162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.846273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.846683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.847058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.847923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:04.848040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.849002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.851268 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.866892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4032/8170] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:04.868359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.871907 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4139/8171] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:04.873452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.881219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f5f63-7d5a-4333-83b2-2ad7a78637e9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.886336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea88e6-33a0-4711-ba04-7213045b610b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:04.887051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.887948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.888396 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.888742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.889468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.891589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.892792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:04.893910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:04.894348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:04.894820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:04.895971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:04.898615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:04.925632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4033/8172] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:04.930884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:04.940177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4140/8173] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:04.946919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.038765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062b10-d924-4eea-98bc-2ce1c51083dd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.058965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150af2-2580-4cb8-a188-598561d6aece admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.064833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.066479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.066703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.066975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.068875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.072388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.106993 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4141/8174] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:05.112749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.127911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64047a08-aad8-48e0-b72c-cc8c32ba2828 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.139053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.139679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.139812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.140018 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.140295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.141060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.141176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.141731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.142175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.143018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.143336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.147916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.172110 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4142/8175] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:05.174848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.193156 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4034/8176] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:04 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:05.196516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb376a-dcde-4ef6-b513-5e10e3662f1f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.198272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.211977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.212207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a183f35-0a3a-4ad4-af48-bc18188372c6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.213321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.213321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.213705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.214778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.216667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.219827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.220737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.221171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.221454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.222264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.224707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.245898 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4143/8177] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:05.246075 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4035/8178] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:05.247076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.253136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.263789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c25427-3858-4661-b673-b7dbf428b515 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.272151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5b123-f186-49f9-b986-6b83a3566f10 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.275663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.276712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.277071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.277429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] PATH_INFO: `/v3/projects/ac77442d74c04f8c905013d6f48a2f44/users/436750bc90b34e04975ae373cf20800b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.291655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.292011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.292403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.292846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.293854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.297641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.309032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac77442d74c04f8c905013d6f48a2f44, user_id=436750bc90b34e04975ae373cf20800b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.311959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccace9-97f2-4bde-a9d3-447df4ead6de admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.317902 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4036/8179] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:05.321334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.333269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9387da-b99b-4adb-85a7-e8ee6cf0063d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.334075 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4144/8180] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:05 2022] PUT /identity/v3/projects/ac77442d74c04f8c905013d6f48a2f44/users/436750bc90b34e04975ae373cf20800b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:05.344192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.344528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.344817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.385020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] MFA Rules not processed for user `436750bc90b34e04975ae373cf20800b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:05.386248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:05.425432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.426339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.426658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.426936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] PATH_INFO: `/v3/projects/ab7a41652e4c4a399b9b74eb42324576/users/34b053c145fb4ea5b51aae10fbb5cebb/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.460780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a41652e4c4a399b9b74eb42324576, user_id=34b053c145fb4ea5b51aae10fbb5cebb, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.463112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ab3f9-729a-45e4-8d66-50cf48ed368e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.475858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4145/8181] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:05.480252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.494982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d67569-bed8-4270-b588-8d4f3f2a188b None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.496071 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4037/8182] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:05 2022] PUT /identity/v3/projects/ab7a41652e4c4a399b9b74eb42324576/users/34b053c145fb4ea5b51aae10fbb5cebb/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:05.507414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.507711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.507987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.546488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] MFA Rules not processed for user `34b053c145fb4ea5b51aae10fbb5cebb`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:05.548140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:05.575001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.575690 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.576030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.576528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.577323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.579471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.610334 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4146/8183] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:05 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:05.614125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.632765 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4038/8184] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:05.645095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.647220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:05.699099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db916465-b28b-4e8f-810a-1e9f10368702 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.708816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.709515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.709869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.710179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.710920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.720493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.727676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60deab5-b2bd-4add-a1e6-7ecb9f2f27b7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.765257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4147/8185] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:05 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:05.769161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.788341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.790190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.790686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.791378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.791554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1100c1-f04a-473b-8483-c6674df60ac6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.808317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.809022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.809308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.809588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.810329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.811952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.833524 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4148/8186] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:05.834921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.847403 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7602-7e5c-4013-85a3-8cf0dda87a5d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:05.852998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:05.854288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:05.854503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:05.854919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] PATH_INFO: `/v3/projects/88a1b20e49ec4878aee1759bde5bf80a/users/19e9caa9c8284ebaa082714c1350083d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:05.872716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a1b20e49ec4878aee1759bde5bf80a, user_id=19e9caa9c8284ebaa082714c1350083d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.877284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:05.877439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.884373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:05.896577 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4039/8187] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:05.905242 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4149/8188] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:05 2022] PUT /identity/v3/projects/88a1b20e49ec4878aee1759bde5bf80a/users/19e9caa9c8284ebaa082714c1350083d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:05.906426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:05.921252 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a87936-7250-4240-bdda-1aedb1ca254d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:06.031913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:06.032677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:06.033011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:06.033285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:06.034017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:06.035689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d0d0-66fd-414e-a9b1-6a798b48820a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:06.053636 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4040/8189] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:06.057382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:06.074129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab480-4f0b-47f8-8010-2eebf4519947 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:06.085629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:06.086577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:06.087757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:06.088109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] PATH_INFO: `/v3/projects/88a1b20e49ec4878aee1759bde5bf80a/users/19e9caa9c8284ebaa082714c1350083d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:06.091392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a1b20e49ec4878aee1759bde5bf80a, user_id=19e9caa9c8284ebaa082714c1350083d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:06.095470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:06.124485 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4150/8190] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:06 2022] PUT /identity/v3/projects/88a1b20e49ec4878aee1759bde5bf80a/users/19e9caa9c8284ebaa082714c1350083d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:21:06.212996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087c88-355c-4e61-8944-aa0d363972f5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:06.213687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087c88-355c-4e61-8944-aa0d363972f5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:06.213687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087c88-355c-4e61-8944-aa0d363972f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:06.242437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58087c88-355c-4e61-8944-aa0d363972f5 None None] MFA Rules not processed for user `19e9caa9c8284ebaa082714c1350083d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:06.243669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58087c88-355c-4e61-8944-aa0d363972f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:06.330273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4041/8191] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:06.344942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:06.348192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:06.445356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677a0a-19e2-49a8-8e0e-9a05351e10dc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:06.464494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:06.465166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:06.465628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:06.466060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:06.598453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:06.600629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:06.621663 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4151/8192] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:07.940825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:07.941374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:07.941467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:07.993589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] MFA Rules not processed for user `3d6a53ed145f478498a1c67807c33bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:07.994822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:08.083476 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4042/8193] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:08.088103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:08.089730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:08.162684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496678a-9393-4e1c-9d0c-d8f0f50f7321 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:08.167631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:08.168344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.168696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.168980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.169935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:08.172027 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:08.198834 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4152/8194] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:08 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:08.202910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:08.215403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f25f4-95a0-423c-abe2-b785eba8fdba None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:08.220537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:08.221320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.221674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.222038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.222974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:08.225209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb9e3f-57da-406b-aadb-d14861ea92e0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:08.239862 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4043/8195] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:08.241515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:08.254312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4b0e-8d2c-42ce-8a7f-a02a8faf7bc7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:08.261492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:08.262553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.262910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.263262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] PATH_INFO: `/v3/system/users/5559302ad49c4672ac1c41538557581a/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.283162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5559302ad49c4672ac1c41538557581a, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:08.284996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:08.300059 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4153/8196] 10.222.0.18 () {60 vars in 1377 bytes} [Sat Apr 2 21:21:08 2022] PUT /identity/v3/system/users/5559302ad49c4672ac1c41538557581a/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:08.322272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.322571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.322860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.359802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] MFA Rules not processed for user `5559302ad49c4672ac1c41538557581a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:08.362105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:08.470233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4044/8197] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:08 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 02 21:21:08.475508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:08.704837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc3a12-d326-4853-8d4b-40db188f58df admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:08.755266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5559302ad49c4672ac1c41538557581a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:08.755266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.755266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.755684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] PATH_INFO: `/v3/services` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.755684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:08.757644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:08.769177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4154/8198] 10.222.0.18 () {58 vars in 1109 bytes} [Sat Apr 2 21:21:08 2022] GET /identity/v3/services => generated 2191 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:08.771124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:08.889670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5343d-f222-494b-ad70-bd8661d15d19 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:08.932659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5559302ad49c4672ac1c41538557581a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:08.933373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:08.933665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:08.933947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] PATH_INFO: `/v3/limits` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:08.934689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:08.936498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:08.961771 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Apr 02 21:21:08.962971 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4045/8199] 10.222.0.18 () {60 vars in 1125 bytes} [Sat Apr 2 21:21:08 2022] POST /identity/v3/limits => generated 124 bytes in 193 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 02 21:21:08.968310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:09.092685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0f2df-1051-4879-882b-8f23616ddd7b None tempest-ImageQuotaTest-2044028082-system-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:09.130848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5559302ad49c4672ac1c41538557581a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:09.131621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:09.132271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:09.132271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:09.133102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:09.134757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:09.146864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4155/8200] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:21:08 2022] GET /identity/v3/registered_limits => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:09.148374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:09.270906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84cd5-0903-457a-985b-d5439b9f6125 None tempest-ImageQuotaTest-2044028082-system-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:09.314471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5559302ad49c4672ac1c41538557581a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:09.315447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:09.316074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:09.316074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:09.317662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:09.318861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:09.324499 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4046/8201] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:21:09 2022] GET /identity/v3/registered_limits => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:10.662426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:10.664946 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:10.694489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ade834-57ff-4aee-857e-baf028cbc803 None tempest-ImageQuotaTest-2044028082-system-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:10.700652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:10.701336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:10.702088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:10.702088 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:10.727413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:10.731725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:10.755596 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4156/8202] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:13.918677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:13.942648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f915186-5f0b-4a75-8c11-23a3eac41602 None tempest-ImageQuotaTest-2044028082-system-admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:13.949724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:13.950895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:13.951255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:13.951449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] PATH_INFO: `/v3/users/3d6a53ed145f478498a1c67807c33bfa` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:13.954843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6a53ed145f478498a1c67807c33bfa)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:13.959012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:14.038851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6a53ed145f478498a1c67807c33bfa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.061143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6a53ed145f478498a1c67807c33bfa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.062403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6a53ed145f478498a1c67807c33bfa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.080219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6a53ed145f478498a1c67807c33bfa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.090174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6a53ed145f478498a1c67807c33bfa'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.100120 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4047/8203] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:13 2022] DELETE /identity/v3/users/3d6a53ed145f478498a1c67807c33bfa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:14.315858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:14.333040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158c92-26ba-431c-9f6f-04f9ec43717c service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:14.438097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:14.438989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:14.439285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:14.439555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] PATH_INFO: `/v3/projects/5dd8e0cc060f4c5f8583e0b8bed9aa54` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:14.442103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd8e0cc060f4c5f8583e0b8bed9aa54)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:14.444325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:14.541573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd8e0cc060f4c5f8583e0b8bed9aa54', 'request_id': 'req-cab197a2-a612-46d2-b0cb-96fe069571a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.549004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd8e0cc060f4c5f8583e0b8bed9aa54', 'request_id': 'req-cab197a2-a612-46d2-b0cb-96fe069571a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.586715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd8e0cc060f4c5f8583e0b8bed9aa54', 'request_id': 'req-cab197a2-a612-46d2-b0cb-96fe069571a2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.613231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] The token cache is being invalidate because project 5dd8e0cc060f4c5f8583e0b8bed9aa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:14.613588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.619447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-cab197a2-a612-46d2-b0cb-96fe069571a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.621978 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4157/8204] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:14 2022] DELETE /identity/v3/projects/5dd8e0cc060f4c5f8583e0b8bed9aa54 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:14.625717 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:14.627139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:14.650945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490d499-aadd-4b47-9900-fba871d9a6b4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:14.790134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:14.791874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:14.795642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:14.796338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] PATH_INFO: `/v3/users/5559302ad49c4672ac1c41538557581a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:14.799288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5559302ad49c4672ac1c41538557581a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:14.810340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:14.925534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5559302ad49c4672ac1c41538557581a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.960371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5559302ad49c4672ac1c41538557581a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.961195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5559302ad49c4672ac1c41538557581a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.977271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5559302ad49c4672ac1c41538557581a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:14.998615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5559302ad49c4672ac1c41538557581a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:15.000440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:15.000899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:15.001234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:15.017199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4048/8205] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:14 2022] DELETE /identity/v3/users/5559302ad49c4672ac1c41538557581a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:15.033514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] MFA Rules not processed for user `fb1ba274f1104befa1bd14c95525c3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:15.034891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:15.143332 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4158/8206] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:15.556948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:15.558499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:15.691806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14e01-4526-4835-94c1-4bc6a959da64 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:15.698026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:15.699099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:15.699703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:15.700171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:15.711778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:15.714582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:15.734538 ncdv-master-1 devstack@keystone.service[97316]: WARNING keystone.server.flask.application [None req-cfbfa64a-0ec8-4ba0-b1c7-4330617617b8 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Apr 02 21:21:15.737057 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4049/8207] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:21:15 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 02 21:21:25.936074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:25.937620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:25.950941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb833ec-2b6a-40b3-b5cd-a027d9bd8084 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:25.955521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:25.956389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:25.956700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:25.956977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] PATH_INFO: `/v3/users/436750bc90b34e04975ae373cf20800b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:25.958153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] RBAC: Authorizing `identity:delete_user(user_id=436750bc90b34e04975ae373cf20800b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:25.960599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:26.005959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436750bc90b34e04975ae373cf20800b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.013856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436750bc90b34e04975ae373cf20800b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.014494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436750bc90b34e04975ae373cf20800b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.015132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436750bc90b34e04975ae373cf20800b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.022660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436750bc90b34e04975ae373cf20800b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.040863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4159/8208] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:25 2022] DELETE /identity/v3/users/436750bc90b34e04975ae373cf20800b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:26.045705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:26.046172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:26.046293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:26.064544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:26.065770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:26.126623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4050/8209] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:26.136347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:26.137795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:26.198341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8768ad-767a-4b34-ab2b-b8866405721a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:26.202934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:26.203594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:26.203882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:26.204158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:26.220169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:26.222369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:26.232758 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4160/8210] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:26.535231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:26.536751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:26.558069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee266f28-4a66-497e-8a63-85324d6583ea None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:26.563274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:26.564160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:26.564479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:26.564777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] PATH_INFO: `/v3/projects/ac77442d74c04f8c905013d6f48a2f44` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:26.566029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac77442d74c04f8c905013d6f48a2f44)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:26.568652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:26.616882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac77442d74c04f8c905013d6f48a2f44', 'request_id': 'req-5bed9403-a70d-4082-ae7d-51dadcf2bc49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.623655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac77442d74c04f8c905013d6f48a2f44', 'request_id': 'req-5bed9403-a70d-4082-ae7d-51dadcf2bc49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.630822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac77442d74c04f8c905013d6f48a2f44', 'request_id': 'req-5bed9403-a70d-4082-ae7d-51dadcf2bc49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.642577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] The token cache is being invalidate because project ac77442d74c04f8c905013d6f48a2f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:26.642865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.643564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.645150 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4051/8211] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:26 2022] DELETE /identity/v3/projects/ac77442d74c04f8c905013d6f48a2f44 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:26.649341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:26.659193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4999-42ce-4a51-8295-7ec79625dd37 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:26.720110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:26.720933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:26.721217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:26.721492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] PATH_INFO: `/v3/users/19e9caa9c8284ebaa082714c1350083d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:26.722700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e9caa9c8284ebaa082714c1350083d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:26.724754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:26.775205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e9caa9c8284ebaa082714c1350083d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.783380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e9caa9c8284ebaa082714c1350083d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.783991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e9caa9c8284ebaa082714c1350083d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.784689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e9caa9c8284ebaa082714c1350083d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.792379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-228b5b38-6b93-40f2-bb2a-8d0429648338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e9caa9c8284ebaa082714c1350083d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:26.811352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4161/8212] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:26 2022] DELETE /identity/v3/users/19e9caa9c8284ebaa082714c1350083d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:21:27.104979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.107131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:27.122915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed9403-a70d-4082-ae7d-51dadcf2bc49 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.191331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.192219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.192528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.193349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] PATH_INFO: `/v3/projects/88a1b20e49ec4878aee1759bde5bf80a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.194552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a1b20e49ec4878aee1759bde5bf80a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.196448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.250690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a1b20e49ec4878aee1759bde5bf80a', 'request_id': 'req-1d8a9127-3caa-46a3-968a-03810a83f109'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:27.257853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a1b20e49ec4878aee1759bde5bf80a', 'request_id': 'req-1d8a9127-3caa-46a3-968a-03810a83f109'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:27.270331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a1b20e49ec4878aee1759bde5bf80a', 'request_id': 'req-1d8a9127-3caa-46a3-968a-03810a83f109'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:27.294938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] The token cache is being invalidate because project 88a1b20e49ec4878aee1759bde5bf80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:27.295232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:27.296105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1d8a9127-3caa-46a3-968a-03810a83f109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:27.298220 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4052/8213] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:27 2022] DELETE /identity/v3/projects/88a1b20e49ec4878aee1759bde5bf80a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:27.303480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494d087-2327-4202-a704-29dce3c8581d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.304002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494d087-2327-4202-a704-29dce3c8581d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.304096 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494d087-2327-4202-a704-29dce3c8581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.326420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7494d087-2327-4202-a704-29dce3c8581d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:27.327743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7494d087-2327-4202-a704-29dce3c8581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:27.386632 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4162/8214] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:27.394383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.394668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.394940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.414108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:27.415410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:27.424490 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4053/8215] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:27.429083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494d087-2327-4202-a704-29dce3c8581d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.444604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494d087-2327-4202-a704-29dce3c8581d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.446971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.447681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.447981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.448255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.452532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:27.452532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.452532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.467308 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4163/8216] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:21:27.468712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.478374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637d658-c48d-45e7-a737-a5fa34a5c088 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.483399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.484067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.484352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.484778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.485503 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.487441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.513676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4054/8217] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:27.517853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.528398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b245f-9f75-4df4-a23e-263f0547b268 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.583131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.584208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.584523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.584806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.585499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.587411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.607852 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4164/8218] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:27.611890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.622841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a91b-e391-4272-a4a0-97c370c50efd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.627742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.628411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.628724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.629121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.629847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.632051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.642788 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4055/8219] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:27.647048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.657411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac25d-84e3-4eee-9a91-0562e6539354 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.662674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.663345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.663632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.663942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.664698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.666307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed58e5-08c0-4890-884c-4cf5a738cd5b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.676553 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4165/8220] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:27.681238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.691167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af17f8-763b-481c-a0ea-f4ec7da7c674 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.695993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.696903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.697189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.697466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] PATH_INFO: `/v3/projects/96e39ba1844f432b98e6c724a4e1660f/users/cdcda4ea3e0a46439a55c24590db8683/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.711992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e39ba1844f432b98e6c724a4e1660f, user_id=cdcda4ea3e0a46439a55c24590db8683, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.714809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.729438 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4056/8221] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:27 2022] PUT /identity/v3/projects/96e39ba1844f432b98e6c724a4e1660f/users/cdcda4ea3e0a46439a55c24590db8683/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:27.739481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.739784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.740068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.768237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] MFA Rules not processed for user `cdcda4ea3e0a46439a55c24590db8683`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:27.769504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:27.850329 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4166/8222] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:27.855690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.939342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd33ab-fcb6-4a9a-b19c-0e8ac39da429 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:27.944166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:27.944862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:27.945151 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:27.945435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:27.946122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:27.948033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:27.976816 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4057/8223] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:27.978271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:27.989045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991155f8-ce30-42f8-bf0b-980df1b0c073 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.045480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.046086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.046968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.047284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.048020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.050083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.073804 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4167/8224] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:27 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:28.075045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.086095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f836be-86c9-48d0-af3a-15d5411878a0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.090840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.091517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.091806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.092106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.092852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.094456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.106356 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4058/8225] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:28.110539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.126108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d898-8e9c-4c49-8174-2317446820ee admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.130899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.131790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.132076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.132354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] PATH_INFO: `/v3/projects/c905679f3e4648b4a35d2201057c7622/users/2e12b62d327c4c53901187397092fa49/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.147570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c905679f3e4648b4a35d2201057c7622, user_id=2e12b62d327c4c53901187397092fa49, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.150341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.163662 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4168/8226] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:28 2022] PUT /identity/v3/projects/c905679f3e4648b4a35d2201057c7622/users/2e12b62d327c4c53901187397092fa49/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:28.167633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.178211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8549af-97e7-4431-876f-4afdb1be22b8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.235927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.236628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.236917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.237200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.237913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.239539 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daa0a2-1b30-4d8a-93c4-c35f35a71efc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.249780 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4059/8227] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:28.253936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.265500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646813d4-386d-4a54-b85e-82e4deb2d986 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.270191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.271781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.272181 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.272479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] PATH_INFO: `/v3/projects/c905679f3e4648b4a35d2201057c7622/users/2e12b62d327c4c53901187397092fa49/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.274479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c905679f3e4648b4a35d2201057c7622, user_id=2e12b62d327c4c53901187397092fa49, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.277133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.288188 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4169/8228] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:28 2022] PUT /identity/v3/projects/c905679f3e4648b4a35d2201057c7622/users/2e12b62d327c4c53901187397092fa49/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:28.299989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.300226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.300637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.329736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] MFA Rules not processed for user `2e12b62d327c4c53901187397092fa49`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:28.330863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:28.400378 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4060/8229] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:28.411447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.413775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:28.473151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fc7a-5064-4831-b73b-330f07de3a60 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.476971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.477769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.477935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.478217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.487684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.489229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c834ede-3c18-4b0b-93f2-fb3898491916 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.499404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4170/8230] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:28.619590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.681019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242fafe-446d-4acd-b292-a5d0aad3ff12 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.685786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.686666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.686953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.687236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] PATH_INFO: `/v3/users/cdcda4ea3e0a46439a55c24590db8683` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.688524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcda4ea3e0a46439a55c24590db8683)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:28.690642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:28.738487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcda4ea3e0a46439a55c24590db8683'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:28.751806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcda4ea3e0a46439a55c24590db8683'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:28.752813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcda4ea3e0a46439a55c24590db8683'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:28.767264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcda4ea3e0a46439a55c24590db8683'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:28.782183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcda4ea3e0a46439a55c24590db8683'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:28.789323 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4061/8231] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:28 2022] DELETE /identity/v3/users/cdcda4ea3e0a46439a55c24590db8683 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:28.794167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.794646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.794934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:28.816474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:28.818372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:28.896197 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4171/8232] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:28.916158 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:28.917836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:28.986857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dab90-f3eb-43bc-8d95-b387b7da3a53 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:28.991152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:28.991814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:28.992501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:28.992637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:29.003709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:29.006226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:29.016489 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4062/8233] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:21:29.626723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:29.628303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:29.640624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26310748-f4f3-4fae-8cc2-84e45d21cbb8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:29.646641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:29.648188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:29.648739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:29.649228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] PATH_INFO: `/v3/projects/96e39ba1844f432b98e6c724a4e1660f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:29.650707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e39ba1844f432b98e6c724a4e1660f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:29.652907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:29.719254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e39ba1844f432b98e6c724a4e1660f', 'request_id': 'req-346fb82d-7511-4bb2-8a5e-40cf270b59a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:29.727660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e39ba1844f432b98e6c724a4e1660f', 'request_id': 'req-346fb82d-7511-4bb2-8a5e-40cf270b59a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:29.737128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e39ba1844f432b98e6c724a4e1660f', 'request_id': 'req-346fb82d-7511-4bb2-8a5e-40cf270b59a1'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:29.749429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] The token cache is being invalidate because project 96e39ba1844f432b98e6c724a4e1660f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:29.749810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:29.750529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:29.752685 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4172/8234] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:29 2022] DELETE /identity/v3/projects/96e39ba1844f432b98e6c724a4e1660f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:29.756629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:29.769789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d28ff-daa4-48cb-abff-4337978fdc2f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:29.871190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:29.873258 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:29.874050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:29.874852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] PATH_INFO: `/v3/users/2e12b62d327c4c53901187397092fa49` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:29.877549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e12b62d327c4c53901187397092fa49)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:29.881431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:29.982491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e12b62d327c4c53901187397092fa49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.017109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e12b62d327c4c53901187397092fa49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.018887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e12b62d327c4c53901187397092fa49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.038399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e12b62d327c4c53901187397092fa49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.048494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0acaf48d-d9c5-405d-ad1c-38ad6f36e7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e12b62d327c4c53901187397092fa49'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.060119 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4063/8235] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:29 2022] DELETE /identity/v3/users/2e12b62d327c4c53901187397092fa49 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:30.620707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:30.622356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:30.637418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb82d-7511-4bb2-8a5e-40cf270b59a1 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:30.699730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:30.700632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:30.700916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:30.701401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] PATH_INFO: `/v3/projects/c905679f3e4648b4a35d2201057c7622` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:30.702604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c905679f3e4648b4a35d2201057c7622)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:30.704539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:30.755573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c905679f3e4648b4a35d2201057c7622', 'request_id': 'req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.762469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c905679f3e4648b4a35d2201057c7622', 'request_id': 'req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.772035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c905679f3e4648b4a35d2201057c7622', 'request_id': 'req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.783821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] The token cache is being invalidate because project c905679f3e4648b4a35d2201057c7622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:30.784355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.785051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ec1479f7-9d1d-44b9-bd8e-cb6499fe84ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:30.786643 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4173/8236] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:30 2022] DELETE /identity/v3/projects/c905679f3e4648b4a35d2201057c7622 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:30.791496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:30.792323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:30.792654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:30.811926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:30.813189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:30.875406 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4064/8237] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:30.883782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:30.884074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:30.884361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:30.904396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:30.905854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:30.914235 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4174/8238] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:30.919344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:30.930084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c03b0-2a8e-4ea4-b09a-2e61400d43bf None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:30.934904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:30.935831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:30.936184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:30.936704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:30.937498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:30.938000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:30.940045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:30.959618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4065/8239] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:30.960848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:30.970283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d8e2-dff5-40c2-9871-fe85ed1d79f1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:30.976982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:30.977928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:30.978399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:30.979625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:30.980437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:30.982696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.012865 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4175/8240] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:31.017088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.035040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868458-40b7-438a-8e5f-35656597582a admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.102946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.103519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.103812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.104105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.104854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.106995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.129164 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4066/8241] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:31 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:31.133988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.145114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c16e-c5dc-4954-8cd1-e329950d6cc7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.152031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.152962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.153447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.153875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.154765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.156601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.172837 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4176/8242] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:31.175378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.188254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addacbd-3058-448c-8f7c-0e5a0b11c209 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.193792 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.194813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.195086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.195435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.196770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.199440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71358f86-5eb0-46f8-9c08-2483e58fbd1d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.217016 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4067/8243] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:31.221523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.236592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0d86d-e3f7-43e4-9abc-509bd01227a5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.242959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.243998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.244373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.244898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] PATH_INFO: `/v3/projects/c8d54a3b13574820bff3f7005b8948c4/users/0ca0a53a483d47a0a011a692aca909d2/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.264536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d54a3b13574820bff3f7005b8948c4, user_id=0ca0a53a483d47a0a011a692aca909d2, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.267467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.285325 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4177/8244] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:31 2022] PUT /identity/v3/projects/c8d54a3b13574820bff3f7005b8948c4/users/0ca0a53a483d47a0a011a692aca909d2/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:21:31.298400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.298916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.299398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.338977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] MFA Rules not processed for user `0ca0a53a483d47a0a011a692aca909d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:31.340473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:31.449407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4068/8245] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:31.465311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.467049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:31.535055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73206c42-1058-4e05-8dc4-4b7533bb81e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.539753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.540486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.540953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.541236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.555556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.557232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0946-cca7-4358-8ec7-1f596e0a1243 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.567408 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4178/8246] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:31.588757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.660267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69274f6-869c-422d-8013-4ca773c30a68 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.665684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.666561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.666847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.667122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] PATH_INFO: `/v3/users/0ca0a53a483d47a0a011a692aca909d2` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.669228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca0a53a483d47a0a011a692aca909d2)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.671190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.730920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca0a53a483d47a0a011a692aca909d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:31.744962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca0a53a483d47a0a011a692aca909d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:31.745685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca0a53a483d47a0a011a692aca909d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:31.756292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca0a53a483d47a0a011a692aca909d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:31.765142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca0a53a483d47a0a011a692aca909d2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:31.772405 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4069/8247] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:31 2022] DELETE /identity/v3/users/0ca0a53a483d47a0a011a692aca909d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:31.776804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.777331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.777426 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.794947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:31.796080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:31.865630 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4179/8248] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:31.875524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:31.877097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:31.942266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea203f68-f361-46bd-8e31-453c9c422f48 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:31.946582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:31.947248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:31.947540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:31.947819 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:31.957244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:31.959357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16f51e-7c75-4970-922f-88c969c383da service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:31.969011 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4070/8249] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:32.313083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:32.314804 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:32.329894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9449e63-9b3d-43fd-a0df-014ebb3e3f82 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:32.342057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:32.343132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.343416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.343702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] PATH_INFO: `/v3/projects/c8d54a3b13574820bff3f7005b8948c4` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.345422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d54a3b13574820bff3f7005b8948c4)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:32.349415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:32.428835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d54a3b13574820bff3f7005b8948c4', 'request_id': 'req-5c8fbb2c-551e-4fb1-be97-6886656674c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:32.436416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d54a3b13574820bff3f7005b8948c4', 'request_id': 'req-5c8fbb2c-551e-4fb1-be97-6886656674c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:32.453305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d54a3b13574820bff3f7005b8948c4', 'request_id': 'req-5c8fbb2c-551e-4fb1-be97-6886656674c8'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:32.470368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] The token cache is being invalidate because project c8d54a3b13574820bff3f7005b8948c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:32.470608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:32.471547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5c8fbb2c-551e-4fb1-be97-6886656674c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:32.474404 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4180/8250] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:32 2022] DELETE /identity/v3/projects/c8d54a3b13574820bff3f7005b8948c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:32.480145 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.480892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.481317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.553395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:32.554724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:32.687628 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4071/8251] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:32.696054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57179f5-5664-487c-aedc-71146697346c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.696637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57179f5-5664-487c-aedc-71146697346c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.696959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57179f5-5664-487c-aedc-71146697346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.728666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d57179f5-5664-487c-aedc-71146697346c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:32.730013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d57179f5-5664-487c-aedc-71146697346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:32.751136 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4181/8252] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:32.752160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:32.765064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87438aaf-3407-4a68-b360-5a1169a456bc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:32.779291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:32.780354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.780874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.781367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.782300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:32.783016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:32.785338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:32.806815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57179f5-5664-487c-aedc-71146697346c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:32.819327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57179f5-5664-487c-aedc-71146697346c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:32.819559 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4072/8253] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:32.825525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:32.826522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.826960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.828117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.829086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:32.831237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:32.882776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:32.894425 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4182/8254] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:32 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:32.894936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db7b7e-f3ee-4bec-ac5f-79aaa2837825 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:32.980694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:32.981745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:32.982268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:32.982916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:32.984680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:32.986909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.017289 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4073/8255] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:32 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:33.018860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.033612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac68ba-c12b-4147-a68e-0de88889861d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.039164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.040064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.040345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.041075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.041972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.044695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.063180 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4183/8256] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:33.064274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.100035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6a1e6-6de1-4ad7-8a6f-9877ac4e5792 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.124260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.125174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.125688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.126070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.127466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.129812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496bc24-b483-4ca8-98e0-f80d6209a42b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.165552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4074/8257] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:33.166828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.186048 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105f1ea-dc2a-4558-89d2-ebc830a17d15 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.196360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.197821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.197821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.197821 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] PATH_INFO: `/v3/projects/e6d02664cad84408b9cd67f50650bff6/users/6c64e63d775f4224995e5010056d6707/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.220679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d02664cad84408b9cd67f50650bff6, user_id=6c64e63d775f4224995e5010056d6707, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.224145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.244505 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4184/8258] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:33 2022] PUT /identity/v3/projects/e6d02664cad84408b9cd67f50650bff6/users/6c64e63d775f4224995e5010056d6707/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:33.253737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.254042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.254490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.343580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] MFA Rules not processed for user `6c64e63d775f4224995e5010056d6707`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:33.345651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:33.454080 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4075/8259] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:33.458569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.557614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628864-80d5-4568-890f-ff90f1ca0bce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.565034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.566959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.568056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.568577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.578032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.581566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.636632 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4185/8260] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:33 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:33.639122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.651188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af72b-7bcc-4ccb-8119-8a9b56fe01a8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.730593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.731284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.731572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.731856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.732584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.734514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.760214 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4076/8261] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:33 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:33.767807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.781345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11be2b-787b-4b6a-8411-5bb30598d61b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.787394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.788178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.788634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.788919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.789680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.791304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.804529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4186/8262] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:33.808813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.819467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726f9b2-590d-45e7-b83a-8f93e45cdebd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.824441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:33.825361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:33.825644 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:33.825953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] PATH_INFO: `/v3/projects/0df292c9d6904128a47c64bcaedefaca/users/ef169bb1db66489ba8fce708bd185181/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:33.844881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df292c9d6904128a47c64bcaedefaca, user_id=ef169bb1db66489ba8fce708bd185181, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:33.848484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:33.867945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4077/8263] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:33 2022] PUT /identity/v3/projects/0df292c9d6904128a47c64bcaedefaca/users/ef169bb1db66489ba8fce708bd185181/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:33.872060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.897468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c2a5-9912-4582-9d2f-7d46b670f087 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:33.927378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:33.929028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.043266 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456881a-9ae3-42eb-8c19-800bb9b274f6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:34.044392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.045308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.045747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.046198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.047082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.048874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.062680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4187/8264] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:34.065816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.066317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.066531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.067026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.068059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:34.069455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.080318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0878-db29-46c0-b181-e2aafa02b1eb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:34.089518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.090897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d9f0-acdc-46f6-bd6c-02546498a1ac service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.096557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.099393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.099688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.100061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] PATH_INFO: `/v3/projects/0df292c9d6904128a47c64bcaedefaca/users/ef169bb1db66489ba8fce708bd185181/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.103897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df292c9d6904128a47c64bcaedefaca, user_id=ef169bb1db66489ba8fce708bd185181, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.107585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.112733 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4078/8265] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:21:34.119352 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4188/8266] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:34 2022] PUT /identity/v3/projects/0df292c9d6904128a47c64bcaedefaca/users/ef169bb1db66489ba8fce708bd185181/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:34.131530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.131880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.132135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.165088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] MFA Rules not processed for user `ef169bb1db66489ba8fce708bd185181`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:34.166415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.262247 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4079/8267] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:34.275357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:34.277302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.314955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:34.316628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.349427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f60195-0d47-4d75-b9f0-36386ed2074a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:34.355280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.356068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.356687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.357965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.383589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573558-fd36-4de6-84cf-fef51b138069 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:34.389226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.389946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.391249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.391249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.393711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.409494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.411812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235ab3f-665c-4223-826c-b9517f607cb0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.424084 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4080/8268] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:21:34.433924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.435405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0141966-9386-4c2b-842e-94daaf46b77c service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.445290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4189/8269] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:34.627731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b0e1-98e1-411a-80d2-c39d9a16d36d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.627867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b0e1-98e1-411a-80d2-c39d9a16d36d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.628142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b0e1-98e1-411a-80d2-c39d9a16d36d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.631148 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4081/8270] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:21:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:21:34.637676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.637911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.638190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.683397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:34.684925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:34.774791 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4190/8271] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:21:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:34.805043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b0e1-98e1-411a-80d2-c39d9a16d36d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:34.830287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b0e1-98e1-411a-80d2-c39d9a16d36d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:34.837754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:34.838858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:34.839303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:34.839899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:34.852409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:34.855500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:34.868613 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4082/8272] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:35.092540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:35.105014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ba779-8b18-42ac-adc6-f11394f06904 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:35.109191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:35.109871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:35.110266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:35.110869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:35.113289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:35.195913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:35.197455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6341a1-f485-49f0-b38a-0d9220fc7a79 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:35.211989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4191/8273] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:37.313685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:37.375355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4db1-4ce8-4704-bb2e-cd7d39a5a8f1 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:37.380446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:37.381343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:37.381628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:37.381902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] PATH_INFO: `/v3/users/6c64e63d775f4224995e5010056d6707` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:37.383083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c64e63d775f4224995e5010056d6707)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:37.385024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:37.431802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c64e63d775f4224995e5010056d6707'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:37.444765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c64e63d775f4224995e5010056d6707'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:37.445851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c64e63d775f4224995e5010056d6707'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:37.455444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c64e63d775f4224995e5010056d6707'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:37.465262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c64e63d775f4224995e5010056d6707'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:37.471374 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4083/8274] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:37 2022] DELETE /identity/v3/users/6c64e63d775f4224995e5010056d6707 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:37.476021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:37.476676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:37.476676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:37.495372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:37.497182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:37.573077 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4192/8275] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:37.582848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:37.584827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:37.654271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6ba1-2294-417e-9376-75733683f180 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:37.658222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:37.658904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:37.659184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:37.659483 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:37.669939 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:37.671568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:37.682017 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4084/8276] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:38.062347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:38.064345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:38.087696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f023-7c7a-49fe-a912-b670c7c4d842 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:38.093151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:38.094227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:38.094666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:38.095235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] PATH_INFO: `/v3/projects/e6d02664cad84408b9cd67f50650bff6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:38.097229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d02664cad84408b9cd67f50650bff6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:38.099660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:38.182231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d02664cad84408b9cd67f50650bff6', 'request_id': 'req-3c6df3e7-6868-452f-97d8-0699e57dd3cf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.190065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d02664cad84408b9cd67f50650bff6', 'request_id': 'req-3c6df3e7-6868-452f-97d8-0699e57dd3cf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.198364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d02664cad84408b9cd67f50650bff6', 'request_id': 'req-3c6df3e7-6868-452f-97d8-0699e57dd3cf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.211335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] The token cache is being invalidate because project e6d02664cad84408b9cd67f50650bff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:38.211884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.212638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.217249 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4193/8277] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:38 2022] DELETE /identity/v3/projects/e6d02664cad84408b9cd67f50650bff6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:38.218418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:38.229462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8135a2-c116-4c14-a62d-236ae6847d2f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:38.306665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:38.309581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:38.310708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:38.311167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] PATH_INFO: `/v3/users/ef169bb1db66489ba8fce708bd185181` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:38.313420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef169bb1db66489ba8fce708bd185181)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:38.315581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:38.373908 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef169bb1db66489ba8fce708bd185181'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.390532 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef169bb1db66489ba8fce708bd185181'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.392312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef169bb1db66489ba8fce708bd185181'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.400973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef169bb1db66489ba8fce708bd185181'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.412795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-064cc7f2-49b8-40c7-9429-e930e0e27471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef169bb1db66489ba8fce708bd185181'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.422788 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4085/8278] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:38 2022] DELETE /identity/v3/users/ef169bb1db66489ba8fce708bd185181 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:38.758616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:38.760767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:38.777111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df3e7-6868-452f-97d8-0699e57dd3cf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:38.843819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:38.845277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:38.845575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:38.845858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] PATH_INFO: `/v3/projects/0df292c9d6904128a47c64bcaedefaca` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:38.847160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df292c9d6904128a47c64bcaedefaca)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:38.849906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:38.922872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df292c9d6904128a47c64bcaedefaca', 'request_id': 'req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.934809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df292c9d6904128a47c64bcaedefaca', 'request_id': 'req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.950949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df292c9d6904128a47c64bcaedefaca', 'request_id': 'req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.967420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] The token cache is being invalidate because project 0df292c9d6904128a47c64bcaedefaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:38.967842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.968730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c5b24c6e-10ba-4a93-9ad6-5acc1ddc79d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:38.973528 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4194/8279] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:38 2022] DELETE /identity/v3/projects/0df292c9d6904128a47c64bcaedefaca => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:38.980163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:38.980757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:38.981267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.005239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:39.007651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:39.119552 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4086/8280] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:39.132332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.133033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.133482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.160206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:39.162105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:39.170966 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4195/8281] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:39.175680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.187823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb34fc9-37da-42a0-af28-c1e9e86213b5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.193186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.194080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.194529 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.194950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.195967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:39.196549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.198235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.210995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4087/8282] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:21:39.216385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.227291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e035656-7836-4d4d-abe8-e9b7d6627b2a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.233754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.234113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.234399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.234677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.235601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.237923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.266895 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4196/8283] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:39 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:39.271496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.282867 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62852-83a2-4ebe-bfeb-b648d987238b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.340732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.341348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.341587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.341865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.342576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.344471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.365187 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4088/8284] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:39 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:39.369211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.379798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a178e2-9eff-44b1-ad19-adaa67e2f650 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.385499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.386178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.386462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.386736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.387572 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.389241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.400933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4197/8285] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:39.405054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.416434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecb7a-5a39-4faa-919f-e89d75ff73a2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.421661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.422429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.422784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.423136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.423993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.425758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6323f-b7a6-47b1-ae34-0bb951e576d5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.439089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4089/8286] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:21:39.440498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.450718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb3ef-f2c6-4c10-a936-aff9d789164d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.455928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.456997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.457420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.457594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] PATH_INFO: `/v3/projects/a23649e6091d43be90cdd8417947c925/users/1206356d5f4b48c0b647febb3f83d886/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.474211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23649e6091d43be90cdd8417947c925, user_id=1206356d5f4b48c0b647febb3f83d886, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.477005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.512472 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4198/8287] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:39 2022] PUT /identity/v3/projects/a23649e6091d43be90cdd8417947c925/users/1206356d5f4b48c0b647febb3f83d886/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:39.515174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.515611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.516021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.553982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] MFA Rules not processed for user `1206356d5f4b48c0b647febb3f83d886`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:39.555573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:39.637698 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4090/8288] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:39.650658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:39.652503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:39.724077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3223bd-c2da-4bc0-9026-7cd5b682e245 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:39.727931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:39.728561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:39.728845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:39.729122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:39.738913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:39.740499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e114fc-c06e-403b-84ea-ad3c02c28934 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:39.751095 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4199/8289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:48.055805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:48.118983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b2a7b-5cea-462f-9d67-39bf01bc92d7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:48.123557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:48.124638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:48.124959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:48.125256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] PATH_INFO: `/v3/users/1206356d5f4b48c0b647febb3f83d886` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:48.126573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1206356d5f4b48c0b647febb3f83d886)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:48.128695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:48.182365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1206356d5f4b48c0b647febb3f83d886'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.195330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1206356d5f4b48c0b647febb3f83d886'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.196039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1206356d5f4b48c0b647febb3f83d886'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.203564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1206356d5f4b48c0b647febb3f83d886'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.210598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1206356d5f4b48c0b647febb3f83d886'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.217651 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4091/8290] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:48 2022] DELETE /identity/v3/users/1206356d5f4b48c0b647febb3f83d886 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:48.222156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:48.222646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:48.222773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:48.241116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:48.242321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:48.299902 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4200/8291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:21:48.313670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:48.315165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:48.381263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f4bc-4677-465e-acf2-c89c0a7c5ffd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:48.387653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:48.387653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:48.387653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:48.387653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:48.397611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:48.399130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:48.409287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4092/8292] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:21:48.880536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:48.882108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:48.896187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81792-d6fe-42b4-8abf-7ec30832c64f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:48.903178 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:48.904157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:48.904598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:48.904936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] PATH_INFO: `/v3/projects/a23649e6091d43be90cdd8417947c925` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:48.906374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23649e6091d43be90cdd8417947c925)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:48.908384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:48.972922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23649e6091d43be90cdd8417947c925', 'request_id': 'req-16365b5d-998f-40cf-9959-3fa0ddf50381'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.980222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23649e6091d43be90cdd8417947c925', 'request_id': 'req-16365b5d-998f-40cf-9959-3fa0ddf50381'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:48.990575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23649e6091d43be90cdd8417947c925', 'request_id': 'req-16365b5d-998f-40cf-9959-3fa0ddf50381'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:49.008473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] The token cache is being invalidate because project a23649e6091d43be90cdd8417947c925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:49.008797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:49.009464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:49.011054 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4201/8293] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:48 2022] DELETE /identity/v3/projects/a23649e6091d43be90cdd8417947c925 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:51.286059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:51.298044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d3101-6f56-424f-a514-48a1698d7d8f service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:51.354330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:51.354997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:51.355286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:51.355566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:51.357373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:51.436437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:51.447632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:51.465512 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4093/8294] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:52.652170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:52.653713 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:52.669137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b5d-998f-40cf-9959-3fa0ddf50381 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:52.673400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:52.674049 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:52.674474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:52.674756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:52.677080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:52.693353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:52.694779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675223-948f-4270-89a7-c0e810297f42 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:52.708968 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4202/8295] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:54.211075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:54.212611 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.277063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5b946-16ee-48dc-812d-b382f35fc4dc service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:54.281645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:54.282544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.282831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.283135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] PATH_INFO: `/v3/users/34b053c145fb4ea5b51aae10fbb5cebb` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.284315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b053c145fb4ea5b51aae10fbb5cebb)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:54.286257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:54.332596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b053c145fb4ea5b51aae10fbb5cebb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.343977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b053c145fb4ea5b51aae10fbb5cebb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.344706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b053c145fb4ea5b51aae10fbb5cebb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.352136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b053c145fb4ea5b51aae10fbb5cebb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.358964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b053c145fb4ea5b51aae10fbb5cebb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.365873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4094/8296] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:21:54 2022] DELETE /identity/v3/users/34b053c145fb4ea5b51aae10fbb5cebb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:54.370501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.371011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.371102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.389283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:54.390753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.457580 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4203/8297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:54.467613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:54.470225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.534084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554ba4-d6ca-4744-8dfc-d7432fb2981b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:54.538797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:54.539601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.539890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.540169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.550391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:54.552345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338726a-9279-4568-91f0-5a6a114cada7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:54.562181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4095/8298] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:21:54.736920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:54.738973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.753233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940a22b-ea15-4121-b418-95dab4fbc9de None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:54.758610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:54.759485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.759770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.760046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] PATH_INFO: `/v3/projects/ab7a41652e4c4a399b9b74eb42324576` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.761328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7a41652e4c4a399b9b74eb42324576)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:54.763328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:54.817017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7a41652e4c4a399b9b74eb42324576', 'request_id': 'req-aea85d5a-2abb-427f-8993-23fa9c448a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.823237 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7a41652e4c4a399b9b74eb42324576', 'request_id': 'req-aea85d5a-2abb-427f-8993-23fa9c448a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.830631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7a41652e4c4a399b9b74eb42324576', 'request_id': 'req-aea85d5a-2abb-427f-8993-23fa9c448a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.840852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] The token cache is being invalidate because project ab7a41652e4c4a399b9b74eb42324576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:21:54.841136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.841777 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aea85d5a-2abb-427f-8993-23fa9c448a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:21:54.843871 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4204/8299] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:21:54 2022] DELETE /identity/v3/projects/ab7a41652e4c4a399b9b74eb42324576 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:54.849676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.850042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.850387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.868983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:54.870194 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.928929 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4096/8300] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:54.937173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.937665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.937957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.958060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:54.959252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:54.967933 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4205/8301] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:54.972085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:54.982382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d3ad-64d2-4f33-b52b-7771e1eaaa5a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:54.987049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:54.987760 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:54.988039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:54.988343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:54.989709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:21:54.990013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:54.991598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.006869 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4097/8302] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:21:55.008153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.017436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b1ade-4830-4623-84a5-a4c9c9c1e8cd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.023176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.023841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.024155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.024434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.025151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.027069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.057384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4206/8303] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:21:55 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:55.058981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.078299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4339d9-fb7f-4f49-83ff-5f79b3dfd56c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.167573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.168774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.169205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.169643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.170910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.174476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.208877 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4098/8304] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:21:55 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:21:55.210942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.221264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f0548-948f-4ad6-8fa5-299edabe08f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.227128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.227418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.227702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.227977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.228727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.230324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.245903 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4207/8305] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:55.249556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.267559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f73e-01db-49a4-8221-4fbd1fcc66b7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.277163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.277877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.278162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.278502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.280076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.283526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433ca48-b621-4ba1-9aa1-ff6cf8610f37 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.299019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4099/8306] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:21:55.306058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.321748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b4c6-4d36-47bb-858d-b15a720b0fce admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.330659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.334717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.335145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.335295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] PATH_INFO: `/v3/projects/00543203562741b3b0bbd78ebe735239/users/11daea344ed6497e807f8e446d20e82e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.356422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=00543203562741b3b0bbd78ebe735239, user_id=11daea344ed6497e807f8e446d20e82e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.359721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.377130 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4208/8307] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:21:55 2022] PUT /identity/v3/projects/00543203562741b3b0bbd78ebe735239/users/11daea344ed6497e807f8e446d20e82e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:21:55.388192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.388507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.388807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.419047 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] MFA Rules not processed for user `11daea344ed6497e807f8e446d20e82e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:21:55.420264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:55.491560 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4100/8308] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:21:55.502716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:21:55.505539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:21:55.569186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1260899-6e65-47f0-a1e9-a264bd55ecaa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:21:55.574931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:21:55.576066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:21:55.577250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:21:55.577250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:21:55.588749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:21:55.590289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:21:55.600164 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4209/8309] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:10.314587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:10.317409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:10.419059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de6c0-3573-4b85-8f14-e143a6025c6a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:10.424411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:10.425892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:10.426338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:10.426909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:10.429205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:10.444660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:10.446408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f1a1-6c55-44db-bae7-c225bbc125b7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:10.460607 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4101/8310] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:17.369950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:17.484727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bae6cb-a251-4c80-9b6c-55a1f9edaea2 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:17.490922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:17.492103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:17.492296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:17.492771 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] PATH_INFO: `/v3/users/11daea344ed6497e807f8e446d20e82e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:17.494622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11daea344ed6497e807f8e446d20e82e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:17.496912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:17.555115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11daea344ed6497e807f8e446d20e82e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:17.563293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11daea344ed6497e807f8e446d20e82e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:17.564382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11daea344ed6497e807f8e446d20e82e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:17.564864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11daea344ed6497e807f8e446d20e82e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:17.574356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11daea344ed6497e807f8e446d20e82e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:17.592773 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4210/8311] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:22:17 2022] DELETE /identity/v3/users/11daea344ed6497e807f8e446d20e82e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:17.597514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:17.597977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:17.598136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:17.650093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:17.651451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:17.712999 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4102/8312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:17.722764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:17.724179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:17.783527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa2ef8-e648-4d53-b8ab-d822f25c1571 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:17.787267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:17.787917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:17.788200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:17.788548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:17.798378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:17.800317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167c3b-d6e3-4dbf-b975-e7a16287431a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:17.812271 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4211/8313] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:17.998736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.000201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:18.017612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7c5ea-3f62-4fef-b0ae-b1337a9264ef None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.033428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.035037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.035276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.035558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] PATH_INFO: `/v3/projects/00543203562741b3b0bbd78ebe735239` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.036855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00543203562741b3b0bbd78ebe735239)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.038844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.091912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00543203562741b3b0bbd78ebe735239', 'request_id': 'req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:18.096586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00543203562741b3b0bbd78ebe735239', 'request_id': 'req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:18.102982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00543203562741b3b0bbd78ebe735239', 'request_id': 'req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:18.116171 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] The token cache is being invalidate because project 00543203562741b3b0bbd78ebe735239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:22:18.116399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:18.117065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d8d30bba-941b-45fb-a8bc-a57efaad6cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:18.118624 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4103/8314] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:22:17 2022] DELETE /identity/v3/projects/00543203562741b3b0bbd78ebe735239 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:18.123492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.123862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.124212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.181682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:18.184497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:18.243002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4212/8315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:18.256661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.256661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.256661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.274817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:18.276129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:18.285481 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4104/8316] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:18.290040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.301357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784dcd-8e42-4ee8-87cf-0baa744610d7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.306819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.307841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.308147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.308433 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.309209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:22:18.309606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.312041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.328682 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4213/8317] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:22:18.329820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.339846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef848b-b52d-43c7-bb84-ebf1d0305809 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.344836 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.345546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.345889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.346240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.347727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.349823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.377040 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4105/8318] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:22:18 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:22:18.381290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.391806 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe552a-4ecd-4d09-bb8e-97213836467e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.459808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.460559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.461286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.461753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.462463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.464722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.489394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4214/8319] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:22:18 2022] POST /identity/v3/users => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:22:18.494001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.505367 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e717d2-887e-46b4-9a46-8ed75ff1268e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.510353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.511222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.511537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.511814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.512573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.514169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.525832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4106/8320] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:22:18.529954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.540720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c586-100c-4aaa-baae-bae7cfdc2fc6 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.546043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.546710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.547001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.547286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.548013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.549664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbfc77-acff-4714-910a-ccca6b74e063 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.563360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4215/8321] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:22:18.564698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.576303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f28d-8c90-4f95-832b-d52ff26a25e1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.581980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.583591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.583591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.592536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] PATH_INFO: `/v3/projects/1aa19f5436424f00a07a5d797e03f77b/users/d262893c4b5e4eb0a40d3c765085770b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.603886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa19f5436424f00a07a5d797e03f77b, user_id=d262893c4b5e4eb0a40d3c765085770b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.607488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.621707 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4107/8322] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:22:18 2022] PUT /identity/v3/projects/1aa19f5436424f00a07a5d797e03f77b/users/d262893c4b5e4eb0a40d3c765085770b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:22:18.633161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d356-3b3a-4ef4-8277-1f76291bc78f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.633459 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d356-3b3a-4ef4-8277-1f76291bc78f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.633741 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d356-3b3a-4ef4-8277-1f76291bc78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.662882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6667d356-3b3a-4ef4-8277-1f76291bc78f None None] MFA Rules not processed for user `d262893c4b5e4eb0a40d3c765085770b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:18.666198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6667d356-3b3a-4ef4-8277-1f76291bc78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:18.742736 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4216/8323] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:18.753583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:18.755475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:18.814602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4994fdc-192d-4b97-b5fd-bcc58a089fa3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:18.818899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:18.819629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:18.820037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:18.820377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:18.828948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:18.830450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:18.840019 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4108/8324] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:27.150378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd574-5490-4b6e-a6f4-0d7b00f57d3d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:27.150867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd574-5490-4b6e-a6f4-0d7b00f57d3d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:27.151000 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd574-5490-4b6e-a6f4-0d7b00f57d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:27.186236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ba4cd574-5490-4b6e-a6f4-0d7b00f57d3d None None] MFA Rules not processed for user `fb1ba274f1104befa1bd14c95525c3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:27.187852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ba4cd574-5490-4b6e-a6f4-0d7b00f57d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:27.283346 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4217/8325] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:28.500346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:28.503089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:28.631265 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f8470-b02b-40e8-b838-03199c185771 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:28.637260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:28.638926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:28.638926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:28.638926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:28.641128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:28.660995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:28.663386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:28.689753 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4109/8326] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:48.607608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf832-d44d-4e0c-85bb-085db9f35f38 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:48.608730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf832-d44d-4e0c-85bb-085db9f35f38 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:48.609182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cf832-d44d-4e0c-85bb-085db9f35f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:48.647497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5d2cf832-d44d-4e0c-85bb-085db9f35f38 None None] MFA Rules not processed for user `c87f4a9a2f5a4c9d831ca26b8bc91f17`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:48.649536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d2cf832-d44d-4e0c-85bb-085db9f35f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:48.756506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4218/8327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:50.836328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:50.951502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027077a0-3333-42bb-8a5a-7ca187faeb2c service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:50.957564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:50.959424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:50.959884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:50.960313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] PATH_INFO: `/v3/users/d262893c4b5e4eb0a40d3c765085770b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:50.961700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d262893c4b5e4eb0a40d3c765085770b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:50.963765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:51.020921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd262893c4b5e4eb0a40d3c765085770b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.034041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd262893c4b5e4eb0a40d3c765085770b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.034778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd262893c4b5e4eb0a40d3c765085770b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.047681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd262893c4b5e4eb0a40d3c765085770b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.052692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd262893c4b5e4eb0a40d3c765085770b'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.062517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4110/8328] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:22:50 2022] DELETE /identity/v3/users/d262893c4b5e4eb0a40d3c765085770b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:51.064727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.065215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.065320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.086803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:51.088211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:51.156497 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4219/8329] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:51.166942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:51.168512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:51.246128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369611b1-d5fc-4970-8b5f-8b7dbd8deba6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:51.250368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:51.251156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.251549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.251952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.264726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:51.266359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fb599-c34d-4487-9e08-9a1c5a3c0332 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:51.280007 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4111/8330] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:51.517935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:51.528047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:51.547531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cac835-fa81-4b4b-8193-5a2407cda855 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:51.571244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:51.572541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.572928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.573224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] PATH_INFO: `/v3/projects/1aa19f5436424f00a07a5d797e03f77b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.574465 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa19f5436424f00a07a5d797e03f77b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:51.576519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:51.675361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa19f5436424f00a07a5d797e03f77b', 'request_id': 'req-da2807fa-d351-44b2-9ccb-c48effe25504'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.683625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa19f5436424f00a07a5d797e03f77b', 'request_id': 'req-da2807fa-d351-44b2-9ccb-c48effe25504'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.694235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa19f5436424f00a07a5d797e03f77b', 'request_id': 'req-da2807fa-d351-44b2-9ccb-c48effe25504'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.709208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] The token cache is being invalidate because project 1aa19f5436424f00a07a5d797e03f77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:22:51.709792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.710685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da2807fa-d351-44b2-9ccb-c48effe25504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:51.713864 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4220/8331] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:22:51 2022] DELETE /identity/v3/projects/1aa19f5436424f00a07a5d797e03f77b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:51.719769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.720063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.720376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.745347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:51.746892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:51.849046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4112/8332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:22:51.849670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.849846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.850127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.873261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:51.874668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:51.886410 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4221/8333] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:22:51.890572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:51.903568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf4115-b243-4e3d-bed6-276282346f9a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:51.913703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:51.914683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.915841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.916360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.918123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:22:51.918626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:51.921254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:51.938188 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4113/8334] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:22:51.943557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:51.953862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f133940-0f0a-40fc-94ea-d63bd8621f29 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:51.964883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:51.965571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:51.965855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:51.966133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:51.966842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:51.968764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.007323 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4222/8335] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:22:51 2022] POST /identity/v3/projects => generated 359 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:22:52.011331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:52.032334 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ba56e-aa4b-481e-bddc-2c26cb61ea67 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:52.130655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:52.131494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.131904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.132416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.133365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:52.136560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.168603 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4114/8336] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:22:52 2022] POST /identity/v3/users => generated 280 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:22:52.174255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:52.193646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a92228-3a32-4a49-8ed6-5308f7ed1af3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:52.200094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:52.200831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.201137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.201416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.202143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:52.208100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.225723 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4223/8337] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:22:52.229821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:52.243713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfddcc-0fb4-4e8c-af7c-ed9521d598d3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:52.249463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:52.250263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.250623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.250984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.252368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:52.254237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907aaef-13fd-4ad0-a85a-204ed23297b2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.268377 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4115/8338] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:22:52.273009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:52.306656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1af5a0-d691-42d4-be9e-68a0af0f1988 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:52.323222 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:52.324496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.324795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.325072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] PATH_INFO: `/v3/projects/38830c68eca94caa842ad2601d222f2f/users/af6b094f2bad47e3894dcf0b0f353b03/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.346244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38830c68eca94caa842ad2601d222f2f, user_id=af6b094f2bad47e3894dcf0b0f353b03, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:52.349480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.379867 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4224/8339] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:22:52 2022] PUT /identity/v3/projects/38830c68eca94caa842ad2601d222f2f/users/af6b094f2bad47e3894dcf0b0f353b03/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:52.381155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.381474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.381742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.432392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] MFA Rules not processed for user `af6b094f2bad47e3894dcf0b0f353b03`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:52.433663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:52.556125 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4116/8340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:22:52.571051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:52.573718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:52.665862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e65ff-d82a-4855-8e7f-b7ba107bd241 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:52.671119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:52.671801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:52.672091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:52.672378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:52.687897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:52.689488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e32fd-b934-40b9-bcb1-ac5ffdbd6cce service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:52.700748 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4225/8341] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:22:59.605566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:59.665303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021ad03-2dc9-4bea-8af7-b9d51706da35 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:59.670080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:59.670949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:59.671232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:59.671510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] PATH_INFO: `/v3/users/af6b094f2bad47e3894dcf0b0f353b03` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:59.672725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6b094f2bad47e3894dcf0b0f353b03)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:59.675143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:59.719525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6b094f2bad47e3894dcf0b0f353b03'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:59.730992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6b094f2bad47e3894dcf0b0f353b03'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:59.731675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6b094f2bad47e3894dcf0b0f353b03'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:59.739210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6b094f2bad47e3894dcf0b0f353b03'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:59.745818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6b094f2bad47e3894dcf0b0f353b03'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:22:59.752339 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4117/8342] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:22:59 2022] DELETE /identity/v3/users/af6b094f2bad47e3894dcf0b0f353b03 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:22:59.756981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:59.757444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:59.757562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:59.774367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:22:59.775561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:59.832291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4226/8343] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:22:59.841876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:22:59.843263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:22:59.902119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e087f-95ca-42c4-b670-25ff67935010 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:22:59.905831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:22:59.906480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:22:59.906768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:22:59.907049 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:22:59.917408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:22:59.918852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75094b12-fdab-45da-95bc-19304a61c2a1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:22:59.929098 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4118/8344] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:00.095903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.097391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:00.113103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11af70-4e41-45c6-a4ca-77d69f0bef84 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.126585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.127470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.127755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.128031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] PATH_INFO: `/v3/projects/38830c68eca94caa842ad2601d222f2f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.129287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=38830c68eca94caa842ad2601d222f2f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.131201 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.178090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38830c68eca94caa842ad2601d222f2f', 'request_id': 'req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:00.184081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38830c68eca94caa842ad2601d222f2f', 'request_id': 'req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:00.191025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38830c68eca94caa842ad2601d222f2f', 'request_id': 'req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:00.200756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] The token cache is being invalidate because project 38830c68eca94caa842ad2601d222f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:00.201038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:00.201652 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fcce2678-cb44-4a35-a5e3-402c52a0c3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:00.203172 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4227/8345] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:00 2022] DELETE /identity/v3/projects/38830c68eca94caa842ad2601d222f2f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:00.208713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.209000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.209277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.227750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:00.229010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:00.288684 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4119/8346] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:00.296616 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.296976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.297257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.315323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:00.316558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:00.324636 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4228/8347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:00.328856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.339016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addec19-1da1-433b-b73c-24cdea5651b0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.343541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.344175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.344478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.344774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.346108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:00.346417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.348001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.359545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4120/8348] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:00.364124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.373749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1437dd-115b-4fe3-91b3-1a3a4bbca69c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.378684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.379347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.379638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.379920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.380648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.382553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.409298 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4229/8349] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:00 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:00.413863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.424442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd30f-d280-4af0-84fe-414047a41f19 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.484842 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.485563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.485851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.486135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.486892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.488966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.509314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4121/8350] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:00 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:00.513294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.526379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0e856-8290-49bf-b073-50ef786b8fa8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.531313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.531989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.532297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.533131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.533857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.535483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.546374 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4230/8351] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:00.550421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.560627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeebb7-edf1-45f8-8c75-f8544a6e4286 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.565524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.566195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.566519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.566759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.567478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.569118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa76fd-9370-4dff-a45a-7fd4a618f65b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.580413 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4122/8352] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:00.584532 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.594434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea625a8-dd6b-4baa-8c6c-8bcda276c660 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.599515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.600395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.600711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.600986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] PATH_INFO: `/v3/projects/4cf046d04a12409fafb0326c4dbf2783/users/695a27d08d6b4b1b93fad0bc7e92c59a/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.615666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf046d04a12409fafb0326c4dbf2783, user_id=695a27d08d6b4b1b93fad0bc7e92c59a, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.618430 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.631160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4231/8353] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:00 2022] PUT /identity/v3/projects/4cf046d04a12409fafb0326c4dbf2783/users/695a27d08d6b4b1b93fad0bc7e92c59a/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:00.644323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.644323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.644323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.672093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] MFA Rules not processed for user `695a27d08d6b4b1b93fad0bc7e92c59a`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:00.673354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:00.742083 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4123/8354] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:00.752839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:00.754625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:00.815319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949cbdf-709d-4e7e-8275-1d582c6e141a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:00.819309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:00.820019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:00.820335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:00.820641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:00.829955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:00.831397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521a183-0beb-44e8-8327-45eb12892891 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:00.840506 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4232/8355] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:04.867821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:04.936148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140bc34-355e-40f5-9266-6e03c5dd9acb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:04.940751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:04.941616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:04.941902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:04.942179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] PATH_INFO: `/v3/users/695a27d08d6b4b1b93fad0bc7e92c59a` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:04.943368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695a27d08d6b4b1b93fad0bc7e92c59a)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:04.945317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:04.989845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695a27d08d6b4b1b93fad0bc7e92c59a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.001239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695a27d08d6b4b1b93fad0bc7e92c59a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.002096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695a27d08d6b4b1b93fad0bc7e92c59a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.008993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695a27d08d6b4b1b93fad0bc7e92c59a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.016282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695a27d08d6b4b1b93fad0bc7e92c59a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.022639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4124/8356] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:04 2022] DELETE /identity/v3/users/695a27d08d6b4b1b93fad0bc7e92c59a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:05.027175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.027641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.027738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.045470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:05.046736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.103728 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4233/8357] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:05.114204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.115603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.173592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce0076-81a6-4aab-968e-7d5a531c0562 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.177223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.177862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.178146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.178424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.187599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.189572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342070bd-c0c9-499a-8fa4-a893adb54218 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.198918 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4125/8358] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:05.368279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.369761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.385647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68089f-9810-47da-9b04-e433e825d39f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.392205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.393113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.393439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.393669 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] PATH_INFO: `/v3/projects/4cf046d04a12409fafb0326c4dbf2783` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.394865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf046d04a12409fafb0326c4dbf2783)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.396857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.442272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf046d04a12409fafb0326c4dbf2783', 'request_id': 'req-9b66d811-a91d-4ecf-8586-02b228861b13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.448540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf046d04a12409fafb0326c4dbf2783', 'request_id': 'req-9b66d811-a91d-4ecf-8586-02b228861b13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.457367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf046d04a12409fafb0326c4dbf2783', 'request_id': 'req-9b66d811-a91d-4ecf-8586-02b228861b13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.468287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] The token cache is being invalidate because project 4cf046d04a12409fafb0326c4dbf2783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:05.468615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.469257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9b66d811-a91d-4ecf-8586-02b228861b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:05.470842 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4234/8359] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:05 2022] DELETE /identity/v3/projects/4cf046d04a12409fafb0326c4dbf2783 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:05.475845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.476140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.476420 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.493659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:05.494846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.553540 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4126/8360] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:05.561183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.561500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.561782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.581308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:05.582507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.590863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4235/8361] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:05.595053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.604749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddb1b7-a496-4409-aa13-56ac534fd48a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.609404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.610053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.610886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.611115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.611827 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:05.612135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.613764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.625027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4127/8362] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:05.629850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.639124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe7121-0d46-4145-b9db-f5f09d50af6f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.643823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.644499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.644794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.645072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.645769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.647689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.672594 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4236/8363] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:05.677170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.687028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585368c6-6c99-4999-a89a-c61c92da0939 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.741513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.742259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.742516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.742785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.743556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.745661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.766058 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4128/8364] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/users => generated 279 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:05.769957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.780314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248485-8a1f-4387-9077-e1ef6f31cdc9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.785013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.785673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.785963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.786239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.786984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.788611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.799423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4237/8365] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:05.803293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.813170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36dda7-e400-491d-b362-f6739895d079 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.818464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.819123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.819412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.819691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.820410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.822023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba9a32-1fe4-43c8-9ded-a77fd50ccb03 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.832292 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4129/8366] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:23:05.836066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.845914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284a4a-491a-4521-bebb-2d1eac3678d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:05.850538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:05.851404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.851692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.851968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] PATH_INFO: `/v3/projects/1c81024d11864c5c96ae6f320ae21105/users/c066e21f09e14b55b16730f82fe53cb1/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.866541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c81024d11864c5c96ae6f320ae21105, user_id=c066e21f09e14b55b16730f82fe53cb1, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:05.869179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:05.882078 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4238/8367] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:05 2022] PUT /identity/v3/projects/1c81024d11864c5c96ae6f320ae21105/users/c066e21f09e14b55b16730f82fe53cb1/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:05.893188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:05.893678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:05.893788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:05.920991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] MFA Rules not processed for user `c066e21f09e14b55b16730f82fe53cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:05.922193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:05.983482 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4130/8368] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:05.994014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:05.995779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:06.053134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce527a9e-7980-4f4c-9a84-4eeaecbcbad5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:06.056815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:06.057454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:06.057742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:06.058022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:06.066340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:06.067772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896790f-f7ed-4f0d-9430-f1abd9e91c11 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:06.076551 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4239/8369] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:14.045282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.107137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e8c1a-f64b-4159-b8bf-26d79a2c35c0 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.112207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.113104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.113390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.113669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] PATH_INFO: `/v3/users/c066e21f09e14b55b16730f82fe53cb1` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.114844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c066e21f09e14b55b16730f82fe53cb1)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.116851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.162777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c066e21f09e14b55b16730f82fe53cb1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.174692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c066e21f09e14b55b16730f82fe53cb1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.175366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c066e21f09e14b55b16730f82fe53cb1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.182360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c066e21f09e14b55b16730f82fe53cb1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.190973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c066e21f09e14b55b16730f82fe53cb1'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.198703 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4131/8370] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:14 2022] DELETE /identity/v3/users/c066e21f09e14b55b16730f82fe53cb1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:14.203438 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.203993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.204098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.221257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:14.222453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:14.277849 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4240/8371] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:14.288398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.289897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:14.349251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331469-32ea-490a-9b94-0b67115a44f9 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.352922 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.353562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.353846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.354119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.363905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.365360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a170206-95c9-47e5-a434-4dae637b20b2 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.374565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4132/8372] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:14.545166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.547064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:14.567568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1e0a-23d5-4f2f-8740-544ade047a2a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.573400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.574453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.574684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.574966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] PATH_INFO: `/v3/projects/1c81024d11864c5c96ae6f320ae21105` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.576446 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c81024d11864c5c96ae6f320ae21105)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.578483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.624133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c81024d11864c5c96ae6f320ae21105', 'request_id': 'req-45bb8196-e14d-4335-b455-cddc3d78d17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.630033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c81024d11864c5c96ae6f320ae21105', 'request_id': 'req-45bb8196-e14d-4335-b455-cddc3d78d17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.636883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c81024d11864c5c96ae6f320ae21105', 'request_id': 'req-45bb8196-e14d-4335-b455-cddc3d78d17e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.647174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] The token cache is being invalidate because project 1c81024d11864c5c96ae6f320ae21105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:14.647475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.648112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45bb8196-e14d-4335-b455-cddc3d78d17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:14.649641 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4241/8373] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:14 2022] DELETE /identity/v3/projects/1c81024d11864c5c96ae6f320ae21105 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:14.654657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.654942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.655215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.673388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:14.674571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:14.732030 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4133/8374] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:14.739663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.739953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.740229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.758164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:14.759348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:14.768518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4242/8375] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:14.772796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.783319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1000b-6f8a-43a2-b20d-1da18f6aabe7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.787953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.788649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.788936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.789239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.789979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:14.790288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.792162 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.804381 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4134/8376] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:23:14.808133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.817872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07ff51-e37c-4422-bb0e-488255a4aeba None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.822674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.823405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.823762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.824113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.824928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.826907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.854022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4243/8377] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:14 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:14.858136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.870297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8d897-7e50-472e-bb39-5da3b13b2c0b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.926929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.927595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.927881 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.928160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.928890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.930787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.950338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4135/8378] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:14 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:14.955132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.965544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a849-135c-41cb-830f-7614b583dcaf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:14.970254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:14.970940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:14.971228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:14.971509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:14.972230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:14.973867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:14.984502 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4244/8379] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:14.988291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:14.998273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a08c6c-4e0f-490a-8488-23302802ffdd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.003435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.004087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.004377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.004691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.005409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.006991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81786d-81ca-4306-8932-46ac4b5a6b75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.016715 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4136/8380] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:15.021080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.030724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1a2b-e4a4-4c38-85b5-0b56df3dc988 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.035768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.036673 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.036959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.037232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] PATH_INFO: `/v3/projects/2a7a7c29951a4a14a9533087cd0a5722/users/3d6f56cdf2bf428caa0be7f8ce212038/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.051677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7a7c29951a4a14a9533087cd0a5722, user_id=3d6f56cdf2bf428caa0be7f8ce212038, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.054363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.066729 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4245/8381] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:15 2022] PUT /identity/v3/projects/2a7a7c29951a4a14a9533087cd0a5722/users/3d6f56cdf2bf428caa0be7f8ce212038/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:15.076756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.076756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.078864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.104190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] MFA Rules not processed for user `3d6f56cdf2bf428caa0be7f8ce212038`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:15.105434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:15.166851 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4137/8382] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:15.171272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.233341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236f926-b344-48b4-928a-2a5e7d24f697 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.238859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.239473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.239751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.240034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.240754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.242661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.267105 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4246/8383] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:15 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:15.271322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.282708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9672-0a23-451e-b735-b30c4f55dc24 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.336614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.337279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.337566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.337844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.338517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.340422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.360789 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4138/8384] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:15 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:15.364837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.374797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e185d-df36-4714-a5dd-6c3054db504f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.379364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.380026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.380314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.380627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.381335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.382928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.393823 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4247/8385] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:15.397789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.408300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6436-d6e8-485c-8ca1-00a7c9e0a4ba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.413029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.413936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.414222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.414501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] PATH_INFO: `/v3/projects/dc46b6823685481b85863feb1c480197/users/14def73e81f04a46b8e60e202d7d7458/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.429416 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc46b6823685481b85863feb1c480197, user_id=14def73e81f04a46b8e60e202d7d7458, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.432058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.454306 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4139/8386] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:15 2022] PUT /identity/v3/projects/dc46b6823685481b85863feb1c480197/users/14def73e81f04a46b8e60e202d7d7458/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:15.458242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.468341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7a3e6-0843-4244-af74-b12b2a17384d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.524412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.525055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.525342 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.525622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.526337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.527959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99c073-39a6-46bd-a1de-89e2b7759d0e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.537956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4248/8387] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:15.542329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.552700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e32dd-5b8c-4ce9-ab0b-cc7e07063ed7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.558052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.559138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.559430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.559704 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] PATH_INFO: `/v3/projects/dc46b6823685481b85863feb1c480197/users/14def73e81f04a46b8e60e202d7d7458/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.561851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc46b6823685481b85863feb1c480197, user_id=14def73e81f04a46b8e60e202d7d7458, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.564620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.575020 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4140/8388] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:15 2022] PUT /identity/v3/projects/dc46b6823685481b85863feb1c480197/users/14def73e81f04a46b8e60e202d7d7458/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:15.586364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.586658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.586940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.614120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] MFA Rules not processed for user `14def73e81f04a46b8e60e202d7d7458`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:15.615321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:15.679902 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4249/8389] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:15.692524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:15.694235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:15.752202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72cf7-ed34-4768-9c01-6cbfcc9e31c4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:15.755835 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:15.756509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:15.756796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:15.757071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:15.766634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:15.768060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1f4af-93ff-41e5-a1a9-75c87aa4be4a service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:15.777383 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4141/8390] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:16.127291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:16.187307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b96355-c00a-4650-a54f-6fc001a9bfd9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:16.192498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:16.193374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:16.193656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:16.193930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] PATH_INFO: `/v3/users/3d6f56cdf2bf428caa0be7f8ce212038` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:16.195119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6f56cdf2bf428caa0be7f8ce212038)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:16.197072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:16.239243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6f56cdf2bf428caa0be7f8ce212038'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.246130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6f56cdf2bf428caa0be7f8ce212038'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.246761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6f56cdf2bf428caa0be7f8ce212038'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.247376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6f56cdf2bf428caa0be7f8ce212038'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.254677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6f56cdf2bf428caa0be7f8ce212038'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.271373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4250/8391] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:16 2022] DELETE /identity/v3/users/3d6f56cdf2bf428caa0be7f8ce212038 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:16.275952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:16.276428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:16.276569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:16.294197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:16.295320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:16.351009 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4142/8392] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:16.361278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:16.362687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:16.419989 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569015-2cf7-4e63-85f1-9eb474b300ef admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:16.424200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:16.424876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:16.425159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:16.425436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:16.434381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:16.435809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:16.445586 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4251/8393] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:16.722337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:16.723850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:16.736902 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00f73e-6874-4cc7-9994-c40875543555 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:16.741708 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:16.742570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:16.742857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:16.743136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] PATH_INFO: `/v3/projects/2a7a7c29951a4a14a9533087cd0a5722` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:16.744320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7a7c29951a4a14a9533087cd0a5722)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:16.746273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:16.794189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7a7c29951a4a14a9533087cd0a5722', 'request_id': 'req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.800181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7a7c29951a4a14a9533087cd0a5722', 'request_id': 'req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.805598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7a7c29951a4a14a9533087cd0a5722', 'request_id': 'req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.817428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] The token cache is being invalidate because project 2a7a7c29951a4a14a9533087cd0a5722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:16.817715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.818332 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.819914 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4143/8394] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:16 2022] DELETE /identity/v3/projects/2a7a7c29951a4a14a9533087cd0a5722 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:16.823911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:16.833974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f026a2-b865-4168-82f3-23a4bfda9c57 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:16.888339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:16.889084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:16.889377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:16.889659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] PATH_INFO: `/v3/users/14def73e81f04a46b8e60e202d7d7458` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:16.890864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=14def73e81f04a46b8e60e202d7d7458)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:16.893332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:16.937592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14def73e81f04a46b8e60e202d7d7458'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.944257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14def73e81f04a46b8e60e202d7d7458'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.944909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14def73e81f04a46b8e60e202d7d7458'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.945519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14def73e81f04a46b8e60e202d7d7458'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.952051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-5e7ea703-cdf6-46d2-8c96-c7b70316f5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14def73e81f04a46b8e60e202d7d7458'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:16.969047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4252/8395] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:16 2022] DELETE /identity/v3/users/14def73e81f04a46b8e60e202d7d7458 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:17.225730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.227179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:17.258453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd44b22-e58e-4a1e-90fc-b3666ef8d295 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.319527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.320515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.320801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.321079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] PATH_INFO: `/v3/projects/dc46b6823685481b85863feb1c480197` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.322296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc46b6823685481b85863feb1c480197)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.324190 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.368291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc46b6823685481b85863feb1c480197', 'request_id': 'req-e65f17b3-87c9-4871-9b39-9678964eedcf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:17.374351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc46b6823685481b85863feb1c480197', 'request_id': 'req-e65f17b3-87c9-4871-9b39-9678964eedcf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:17.380182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc46b6823685481b85863feb1c480197', 'request_id': 'req-e65f17b3-87c9-4871-9b39-9678964eedcf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:17.393931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] The token cache is being invalidate because project dc46b6823685481b85863feb1c480197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:17.394219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:17.394851 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-e65f17b3-87c9-4871-9b39-9678964eedcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:17.396396 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4144/8396] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:17 2022] DELETE /identity/v3/projects/dc46b6823685481b85863feb1c480197 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:17.401476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.401937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.402073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.419585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:17.420844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:17.479668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4253/8397] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:17.487534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.487852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.488129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.507560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:17.508854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:17.516866 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4145/8398] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:17.521830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.531519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c15dc-2296-4122-be2a-eb11dfed534c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.536089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.536768 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.537053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.537329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.538041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:17.538345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.539962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.555562 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4254/8399] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:17.556777 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.567330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541d0e2-1b17-4936-91e0-8b0aebccb5ed None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.572241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.573166 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.573362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.573639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.574319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.576214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.604093 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4146/8400] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:17.605311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.615838 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7a9ca-f7a2-4f6e-a445-dba7324e059a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.671636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.672277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.672613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.672895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.674130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.676189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.699459 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4255/8401] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:17.700812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.710956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1229a-a544-4e20-84ec-85e8e291cfd5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.716076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.716776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.717063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.717343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.718063 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.719665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.730345 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4147/8402] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:17.734525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.745001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc1d6-cae1-4919-a539-12eb8f9716a2 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.749674 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.750332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.750683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.750963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.752280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.753888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35633392-4ef1-449a-8156-a649f7204576 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.766730 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4256/8403] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:17.769123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.779619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216804-7f14-4aeb-8e89-83f5f1c88a70 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.784535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.785542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.785913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.786366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] PATH_INFO: `/v3/projects/300e31ed1c8142b98d8cfc376a51dfa6/users/9460e58c311543cdad759154f22ec164/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.801738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300e31ed1c8142b98d8cfc376a51dfa6, user_id=9460e58c311543cdad759154f22ec164, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:17.804486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:17.818491 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4148/8404] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:17 2022] PUT /identity/v3/projects/300e31ed1c8142b98d8cfc376a51dfa6/users/9460e58c311543cdad759154f22ec164/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:17.828256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.828582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.828865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.855499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] MFA Rules not processed for user `9460e58c311543cdad759154f22ec164`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:17.856728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:17.923039 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4257/8405] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:17.928127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:17.991173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27779-5e27-485a-b82d-8c735edd0be5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:17.996029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:17.997259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:17.997559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:17.997961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:17.998676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.000647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.025266 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4149/8406] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:17 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:18.029267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.041207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c9953-9ffd-45ff-aa92-da0a6c65173c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.096180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.096926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.097216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.097498 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.098198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.100122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.123460 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4258/8407] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:18 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:18.125129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.135797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ebab8-9db8-4307-b1e7-cea14a2d98c7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.144008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.144008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.144008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.144008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.144421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.144421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.155288 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4150/8408] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:23:18.160161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.170300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213166-703a-49ab-8229-cc05ac01b667 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.175822 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.176683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.177002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.177281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] PATH_INFO: `/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97/users/d6e03297d56042a68d0235b013e60f64/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.200150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4bd00c809c42d9a15ae2ab7973dd97, user_id=d6e03297d56042a68d0235b013e60f64, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.203005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.216750 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4259/8409] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:18 2022] PUT /identity/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97/users/d6e03297d56042a68d0235b013e60f64/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:18.221395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.231709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4835-3d2c-4b95-a983-8e0da3d0534f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.287878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.288579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.288861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.289140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.289858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.291728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fef29c-9f8d-4927-b925-c1f6bf933745 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.301811 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4151/8410] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:18.305864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.316215 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5af2ae-7e8f-4164-81aa-83485d757d57 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.321852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.322835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.323126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.323406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] PATH_INFO: `/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97/users/d6e03297d56042a68d0235b013e60f64/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.326208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4bd00c809c42d9a15ae2ab7973dd97, user_id=d6e03297d56042a68d0235b013e60f64, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.329135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.349340 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4260/8411] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:18 2022] PUT /identity/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97/users/d6e03297d56042a68d0235b013e60f64/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:18.360771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.361249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.361343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.397671 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.400484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:18.404154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] MFA Rules not processed for user `d6e03297d56042a68d0235b013e60f64`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:18.405398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:18.505385 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4152/8412] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:18.513435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:18.515298 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:18.549100 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f5ba-7508-4374-b7f3-610daa2f94a3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.555723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.556467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.557409 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.557707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.560482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:18.581940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.584814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.606216 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4261/8413] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:23:18.613500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eb2d0-b621-4fa6-a3ab-4aeb5a7bfe04 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:18.617247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:18.618175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:18.618469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:18.618882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:18.634469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:18.635905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66fd8-3d94-4e13-be94-3fe7aac03b98 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:18.650855 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4153/8414] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:23:20.074477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:20.138638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf832d5-1fba-4dbe-a861-85075ca38456 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:20.144280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:20.145188 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:20.145478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:20.145758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] PATH_INFO: `/v3/users/9460e58c311543cdad759154f22ec164` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:20.146959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9460e58c311543cdad759154f22ec164)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:20.155769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:20.198962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9460e58c311543cdad759154f22ec164'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.207111 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9460e58c311543cdad759154f22ec164'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.207779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9460e58c311543cdad759154f22ec164'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.208387 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9460e58c311543cdad759154f22ec164'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.215104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9460e58c311543cdad759154f22ec164'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.231965 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4262/8415] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:20 2022] DELETE /identity/v3/users/9460e58c311543cdad759154f22ec164 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:20.236595 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:20.237117 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:20.237225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:20.255547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:20.256692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:20.314899 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4154/8416] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:20.325930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:20.327753 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:20.388594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25db67-c0ad-4c6f-9f74-37643f84bb1f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:20.393289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:20.393947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:20.394238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:20.394518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:20.403835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:20.405301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:20.414883 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4263/8417] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:20.714368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:20.715871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:20.728438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87c8a-bbb0-4e78-81dc-e7d121f87260 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:20.733484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:20.734344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:20.734628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:20.734936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] PATH_INFO: `/v3/projects/300e31ed1c8142b98d8cfc376a51dfa6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:20.736853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300e31ed1c8142b98d8cfc376a51dfa6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:20.739703 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:20.789100 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300e31ed1c8142b98d8cfc376a51dfa6', 'request_id': 'req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.795648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300e31ed1c8142b98d8cfc376a51dfa6', 'request_id': 'req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.801274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300e31ed1c8142b98d8cfc376a51dfa6', 'request_id': 'req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.812946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] The token cache is being invalidate because project 300e31ed1c8142b98d8cfc376a51dfa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:20.813234 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.813887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.816658 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4155/8418] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:20 2022] DELETE /identity/v3/projects/300e31ed1c8142b98d8cfc376a51dfa6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:20.820835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:20.831236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8fc74-d60a-4d38-b9df-17928ac49dcd service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:20.889693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:20.890582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:20.890870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:20.891336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] PATH_INFO: `/v3/users/d6e03297d56042a68d0235b013e60f64` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:20.893224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e03297d56042a68d0235b013e60f64)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:20.895186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:20.957960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e03297d56042a68d0235b013e60f64'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.968835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e03297d56042a68d0235b013e60f64'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.969642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e03297d56042a68d0235b013e60f64'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.970492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e03297d56042a68d0235b013e60f64'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:20.981118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-bee86e6b-6e75-4790-8dd0-0f2fc2d534a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e03297d56042a68d0235b013e60f64'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.006577 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4264/8419] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:20 2022] DELETE /identity/v3/users/d6e03297d56042a68d0235b013e60f64 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:21.281189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.283182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:21.297727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443df6e-0f55-45f3-b4a5-b10d75db9dc3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.355673 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.356562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.356852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.357128 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] PATH_INFO: `/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.358340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4bd00c809c42d9a15ae2ab7973dd97)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.360257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.405058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4bd00c809c42d9a15ae2ab7973dd97', 'request_id': 'req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.411646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4bd00c809c42d9a15ae2ab7973dd97', 'request_id': 'req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.417281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4bd00c809c42d9a15ae2ab7973dd97', 'request_id': 'req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.429090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] The token cache is being invalidate because project eb4bd00c809c42d9a15ae2ab7973dd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:21.429383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.430052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bf40f9b3-57b7-41f3-aa3e-63a291f14c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:21.431630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4156/8420] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:21 2022] DELETE /identity/v3/projects/eb4bd00c809c42d9a15ae2ab7973dd97 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:21.436657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.437127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.437258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.455242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:21.456487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:21.513474 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4265/8421] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:21.521656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.521975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.522259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.541315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:21.542450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:21.550471 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4157/8422] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:21.554561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.564176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fdb01-9bd4-43f1-b5e0-2b0c04656ad2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.568816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.569470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.569757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.570029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.570748 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:21.571058 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.572678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.587169 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4266/8423] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:21.588496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.598730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ecdf0-9126-481a-8fe8-8e6299bfb5a9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.603839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.604542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.604832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.605113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.605838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.607755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.634161 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4158/8424] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:21.637693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.648184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c657d0f-f8d8-477d-aa6e-7345a7a27b59 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.701323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.701997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.702286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.702689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.703472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.706047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.727322 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4267/8425] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:21.731568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.742472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fde2e8-a264-4316-a93e-f66375b0e1cb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.747165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.747828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.748115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.748399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.749192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.750828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.761517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4159/8426] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:21.765540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.775930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748311e-fd77-495e-923d-f25901b9b5cc admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.780473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.781174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.781458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.781734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.782442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.784011 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580bd32-2443-434e-80d4-24d85e4d0738 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.793914 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4268/8427] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:23:21.797877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:21.807805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeab15-ea2d-4ecf-be5b-01901f7a18a2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:21.812522 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:21.813398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.814185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.814459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] PATH_INFO: `/v3/projects/6d5e15a125994c2bbe968e70eb1458c8/users/9f25979ceb3f4af89842abdeb89ca8ba/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.828372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5e15a125994c2bbe968e70eb1458c8, user_id=9f25979ceb3f4af89842abdeb89ca8ba, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:21.831722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:21.844563 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4160/8428] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:21 2022] PUT /identity/v3/projects/6d5e15a125994c2bbe968e70eb1458c8/users/9f25979ceb3f4af89842abdeb89ca8ba/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:21.855275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:21.855574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:21.855861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:21.882158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] MFA Rules not processed for user `9f25979ceb3f4af89842abdeb89ca8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:21.883390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:21.948365 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4269/8429] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:21.952986 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.012409 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f23bd2-dc7f-45fd-b1e0-d368eb3abb2c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.017626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.018278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.018565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.018844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.019526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.021468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.046530 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4161/8430] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:21 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:22.050589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.061675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a10914-c190-40bc-a018-b2beff351e14 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.118507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.119182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.119471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.119785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.120499 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.122436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.143168 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4270/8431] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:22 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:22.147146 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.158188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220ddf-b0f7-40d2-a7ff-7e96831763b3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.164315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.165140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.166202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.166202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.166698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.168304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.182446 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4162/8432] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:22.183405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.193484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342463dd-c5b0-44fc-9fbe-d75b97cd4ad9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.198898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.199581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.199871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.200440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.201205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.202814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066196-8484-4c74-b84f-c89e3b32d3bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.213720 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4271/8433] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:22.218309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.229480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69627c-d5f4-4819-a551-5366d52a2c9c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.234295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.235314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.235629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.235911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] PATH_INFO: `/v3/projects/2286f5ba57824086820f6b4bd21ff876/users/fbabc7a7330e444c8e5ee87beb21f565/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.251427 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2286f5ba57824086820f6b4bd21ff876, user_id=fbabc7a7330e444c8e5ee87beb21f565, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.254488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.270923 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4163/8434] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:22 2022] PUT /identity/v3/projects/2286f5ba57824086820f6b4bd21ff876/users/fbabc7a7330e444c8e5ee87beb21f565/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:22.281032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.281340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.281593 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.312882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] MFA Rules not processed for user `fbabc7a7330e444c8e5ee87beb21f565`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:22.314406 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:22.380806 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4272/8435] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:22.385348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.447617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec99367-393f-4b19-afe2-cd0ad17b4dc0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.453048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.453718 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.454003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.454958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.455656 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.457610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.486760 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4164/8436] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:22 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:22.488541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.500169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eeed9-0ba9-42d4-be1f-a2a3c15a08fe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.556147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.557013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.557304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.557589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.558275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.560231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.581135 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4273/8437] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:22 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:22.585159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.595804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf5f8-7e2c-4f65-a960-4bfb3f228348 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.600509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.601200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.601662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.601992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.603175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.605571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.626608 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4165/8438] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:23:22.627793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.637871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afc2ba-6449-4bd6-9a50-70cba8aca8c9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.643139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.644026 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.644311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.644624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] PATH_INFO: `/v3/projects/02817484f8f94adca5a110557c4a04fe/users/00f9893b3e91460e9727a9d1c541fbb6/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.659171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=02817484f8f94adca5a110557c4a04fe, user_id=00f9893b3e91460e9727a9d1c541fbb6, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.661862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.675176 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4274/8439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:22 2022] PUT /identity/v3/projects/02817484f8f94adca5a110557c4a04fe/users/00f9893b3e91460e9727a9d1c541fbb6/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:22.679140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.689625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6b5b2-7998-473b-8d2d-b7e2ae722caf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.745380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.746256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.746639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.746928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.747658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.749299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400ca80-154a-4b56-9d4e-d9acf2b98259 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.760105 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4166/8440] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:22.764128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.774944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81428a-aada-483f-b00c-afa08ead03ff admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.779632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.780560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.780849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.781132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] PATH_INFO: `/v3/projects/02817484f8f94adca5a110557c4a04fe/users/00f9893b3e91460e9727a9d1c541fbb6/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.783186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02817484f8f94adca5a110557c4a04fe, user_id=00f9893b3e91460e9727a9d1c541fbb6, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.785884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:22.796685 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4275/8441] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:22 2022] PUT /identity/v3/projects/02817484f8f94adca5a110557c4a04fe/users/00f9893b3e91460e9727a9d1c541fbb6/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:22.807579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.807879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.808165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.836355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] MFA Rules not processed for user `00f9893b3e91460e9727a9d1c541fbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:22.837607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:22.904618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4167/8442] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:22.915386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:22.917513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:22.975927 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc3dac-18c1-4a25-b443-4735dfcfb2b4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:22.979603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:22.980283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:22.980605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:22.980888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:22.990879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:22.992308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:23.002869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4276/8443] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:23.485524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:23.487431 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:23.502455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531c4bb-c32b-452b-8a65-9e2ded5b0c3b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:23.506629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:23.507355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:23.507639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:23.508118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:23.571800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:23.573399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c05b9b-8fc4-49df-9610-697333f2ca71 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:23.585148 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4168/8444] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:25.796678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:25.799145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:25.863509 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a3c06-8f87-49f3-9678-3c4b47faee00 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:25.868194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:25.869095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:25.869384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:25.869665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] PATH_INFO: `/v3/users/fb1ba274f1104befa1bd14c95525c3ab` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:25.870843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1ba274f1104befa1bd14c95525c3ab)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:25.872796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:25.917634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1ba274f1104befa1bd14c95525c3ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:25.925094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1ba274f1104befa1bd14c95525c3ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:25.926004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1ba274f1104befa1bd14c95525c3ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:25.926925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1ba274f1104befa1bd14c95525c3ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:25.934128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1ba274f1104befa1bd14c95525c3ab'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:25.952839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4277/8445] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:25 2022] DELETE /identity/v3/users/fb1ba274f1104befa1bd14c95525c3ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:25.957609 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:25.958078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:25.958161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:25.975729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:25.976994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:26.038833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4169/8446] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:26.049376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:26.050783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:26.107491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5aa0c-a099-464a-9e67-86591e1c4d3d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:26.111662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:26.112309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:26.112635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:26.112913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:26.121734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:26.123170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:26.133007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4278/8447] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:23:26.316025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:26.317497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:26.330578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e756e6-1c93-4858-8c71-ee3f078e1542 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:26.336163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:26.337074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:26.337360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:26.337832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] PATH_INFO: `/v3/projects/7c63afebe86f46e8b16647d8eda2cfb9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:26.339031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c63afebe86f46e8b16647d8eda2cfb9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:26.340987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:26.392809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c63afebe86f46e8b16647d8eda2cfb9', 'request_id': 'req-ca717769-888f-49d9-a0d0-9e545e27b618'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.400782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c63afebe86f46e8b16647d8eda2cfb9', 'request_id': 'req-ca717769-888f-49d9-a0d0-9e545e27b618'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.406889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c63afebe86f46e8b16647d8eda2cfb9', 'request_id': 'req-ca717769-888f-49d9-a0d0-9e545e27b618'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.422182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] The token cache is being invalidate because project 7c63afebe86f46e8b16647d8eda2cfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:26.422649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.424361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.429676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4170/8448] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:26 2022] DELETE /identity/v3/projects/7c63afebe86f46e8b16647d8eda2cfb9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:26.434163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:26.446235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831955bd-f5ad-487d-9864-771490e78597 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:26.507296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:26.508284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:26.508615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:26.508901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] PATH_INFO: `/v3/users/e6e90de75bb84dc1b57a68306c854fc9` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:26.510117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e90de75bb84dc1b57a68306c854fc9)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:26.512038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:26.558960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e90de75bb84dc1b57a68306c854fc9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.566659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e90de75bb84dc1b57a68306c854fc9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.567376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e90de75bb84dc1b57a68306c854fc9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.568081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e90de75bb84dc1b57a68306c854fc9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.575257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-88774d57-4aae-44f0-a415-5d8bcb3e5832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e90de75bb84dc1b57a68306c854fc9'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:26.592356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4279/8449] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:26 2022] DELETE /identity/v3/users/e6e90de75bb84dc1b57a68306c854fc9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:26.865546 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:26.867184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:26.891748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717769-888f-49d9-a0d0-9e545e27b618 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:26.949764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:26.950654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:26.950940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:26.951215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] PATH_INFO: `/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:26.952388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0ee664e09941108231c2b4c4a4f0e0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:26.954339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:26.998820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0ee664e09941108231c2b4c4a4f0e0', 'request_id': 'req-8a0333bc-19f3-4d10-b38f-fc48ea13b193'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:27.004637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0ee664e09941108231c2b4c4a4f0e0', 'request_id': 'req-8a0333bc-19f3-4d10-b38f-fc48ea13b193'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:27.009918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0ee664e09941108231c2b4c4a4f0e0', 'request_id': 'req-8a0333bc-19f3-4d10-b38f-fc48ea13b193'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:27.021523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] The token cache is being invalidate because project bf0ee664e09941108231c2b4c4a4f0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:27.021803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:27.022432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8a0333bc-19f3-4d10-b38f-fc48ea13b193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:27.024000 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4171/8450] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:26 2022] DELETE /identity/v3/projects/bf0ee664e09941108231c2b4c4a4f0e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:27.029363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.029817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.029913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.048583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:27.049761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.105460 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4280/8451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:27.115863 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.116159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.116447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.134428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:27.135630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.143815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4172/8452] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:27.147974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.158483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92d780-1523-4e72-8ab2-4dd52ebef962 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.163148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.163808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.164095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.164371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.165108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:27.165416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.167340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.179616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4281/8453] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:27.183729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.192728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa697-83aa-41a9-b0e7-8ec82df886ef None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.197358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.197996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.198280 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.198557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.199227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.201143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.225776 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4173/8454] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:27 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:27.229747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.240331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd12d6-7298-4d91-9f01-5e7398850999 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.295128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.295728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.296044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.296346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.297061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.298985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.323089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.323589 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4282/8455] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:27 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:27.335425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977a36-3e07-4277-b79a-2109d492d59d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.340182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.340900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.341186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.341462 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.342207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.343800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.355155 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4174/8456] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:27.359137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.369078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b72a67-269d-4d69-b587-6975d9224e88 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.373626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.374280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.374564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.374839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.375544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.377159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec56ad-1471-4abd-a993-c0d24ce499a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.386716 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4283/8457] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:27.390761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.401342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc256ec2-5060-4bc1-8fe9-02484a455c00 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.406036 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.406955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.407877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.408160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] PATH_INFO: `/v3/projects/0ac7776ae2fb45cfa015c4056f0ab4a0/users/4cb67e8ec9b44d6f89640b4ccabd1987/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.422572 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac7776ae2fb45cfa015c4056f0ab4a0, user_id=4cb67e8ec9b44d6f89640b4ccabd1987, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.425257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.437873 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4175/8458] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:27 2022] PUT /identity/v3/projects/0ac7776ae2fb45cfa015c4056f0ab4a0/users/4cb67e8ec9b44d6f89640b4ccabd1987/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:27.443401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.443792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.444166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.463306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:27.464645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.524199 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4284/8459] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:27.534214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.536009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.595628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef816a-ca04-4a6d-9dec-a3adb6442287 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.599352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.599998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.600281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.600593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.609743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.611402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.620981 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4176/8460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:27.648792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:27.650858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.721754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9ff64-e62f-43f9-a308-17bb9c0b864a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:27.725681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:27.726336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:27.726623 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:27.726902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:27.728765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:27.795469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:27.797431 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8a054-71e1-4067-8e0b-c8ad8bbeb619 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:27.807869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4285/8461] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:29.963251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:29.964874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:29.979474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f66167-4ec5-4071-983a-091c26c41b9d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:29.985729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:29.987204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:29.987560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:29.987912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] PATH_INFO: `/v3/users/9f25979ceb3f4af89842abdeb89ca8ba` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:29.989221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f25979ceb3f4af89842abdeb89ca8ba)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:29.991330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:30.045042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f25979ceb3f4af89842abdeb89ca8ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.063694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f25979ceb3f4af89842abdeb89ca8ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.064721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f25979ceb3f4af89842abdeb89ca8ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.076872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f25979ceb3f4af89842abdeb89ca8ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.085594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f25979ceb3f4af89842abdeb89ca8ba'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.092116 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4177/8462] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:29 2022] DELETE /identity/v3/users/9f25979ceb3f4af89842abdeb89ca8ba => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:30.097253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:30.097759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:30.097857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:30.116373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:30.117641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:30.178769 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4286/8463] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:30.189677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:30.191520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:30.283349 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368f787-7407-4826-88ff-b3cb06374179 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:30.287445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:30.288124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:30.288412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:30.288730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:30.299475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:30.301948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:30.312619 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4178/8464] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:30.750255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:30.751907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:30.766891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852f34-1aa3-44ce-b069-c4b4ef085df2 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:30.775856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:30.776522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:30.776792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:30.777200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] PATH_INFO: `/v3/projects/6d5e15a125994c2bbe968e70eb1458c8` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:30.778650 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5e15a125994c2bbe968e70eb1458c8)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:30.781193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:30.858844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5e15a125994c2bbe968e70eb1458c8', 'request_id': 'req-2c11b4b8-b667-4768-8306-2396a096d087'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.868223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5e15a125994c2bbe968e70eb1458c8', 'request_id': 'req-2c11b4b8-b667-4768-8306-2396a096d087'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.889908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5e15a125994c2bbe968e70eb1458c8', 'request_id': 'req-2c11b4b8-b667-4768-8306-2396a096d087'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.905783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] The token cache is being invalidate because project 6d5e15a125994c2bbe968e70eb1458c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:30.906139 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.907385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:30.912613 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4287/8465] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:30 2022] DELETE /identity/v3/projects/6d5e15a125994c2bbe968e70eb1458c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:30.914179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:30.926184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8f2d0-cdbb-4bc6-8cc2-5f3e04b39a92 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:30.992475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:30.995173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:30.995575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:30.996467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] PATH_INFO: `/v3/users/fbabc7a7330e444c8e5ee87beb21f565` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:30.997870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbabc7a7330e444c8e5ee87beb21f565)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:31.000016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:31.056442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbabc7a7330e444c8e5ee87beb21f565'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.072357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbabc7a7330e444c8e5ee87beb21f565'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.073168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbabc7a7330e444c8e5ee87beb21f565'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.084312 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbabc7a7330e444c8e5ee87beb21f565'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.095251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbabc7a7330e444c8e5ee87beb21f565'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.101692 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4179/8466] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:30 2022] DELETE /identity/v3/users/fbabc7a7330e444c8e5ee87beb21f565 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:31.409629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:31.412075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:31.434885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11b4b8-b667-4768-8306-2396a096d087 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:31.544251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:31.545167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:31.545448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:31.545725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] PATH_INFO: `/v3/projects/2286f5ba57824086820f6b4bd21ff876` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:31.548155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2286f5ba57824086820f6b4bd21ff876)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:31.550476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:31.606681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2286f5ba57824086820f6b4bd21ff876', 'request_id': 'req-e0ddf4e9-3dce-484e-8104-a8f2724de6be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.614846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2286f5ba57824086820f6b4bd21ff876', 'request_id': 'req-e0ddf4e9-3dce-484e-8104-a8f2724de6be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.624343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2286f5ba57824086820f6b4bd21ff876', 'request_id': 'req-e0ddf4e9-3dce-484e-8104-a8f2724de6be'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.637061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] The token cache is being invalidate because project 2286f5ba57824086820f6b4bd21ff876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:31.637863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.638920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e0ddf4e9-3dce-484e-8104-a8f2724de6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.640844 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4288/8467] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:31 2022] DELETE /identity/v3/projects/2286f5ba57824086820f6b4bd21ff876 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:31.649052 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:31.653454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:31.668559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ecf4d-685a-4b6f-9a1f-176dac5d314e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:31.740292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:31.741463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:31.741927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:31.742354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] PATH_INFO: `/v3/users/00f9893b3e91460e9727a9d1c541fbb6` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:31.743705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f9893b3e91460e9727a9d1c541fbb6)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:31.746093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:31.795943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f9893b3e91460e9727a9d1c541fbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.808502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f9893b3e91460e9727a9d1c541fbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.809239 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f9893b3e91460e9727a9d1c541fbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.817442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f9893b3e91460e9727a9d1c541fbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.824825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f9893b3e91460e9727a9d1c541fbb6'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:31.831301 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4180/8468] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:31 2022] DELETE /identity/v3/users/00f9893b3e91460e9727a9d1c541fbb6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:32.527857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.528510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.528510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.545907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:32.548015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:32.566481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] MFA Rules not processed for user `4cb67e8ec9b44d6f89640b4ccabd1987`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:32.567862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:32.627432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c756e-0d4a-4e63-8fd1-ad3ebba90653 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:32.633944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:32.634837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.635125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.635405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] PATH_INFO: `/v3/projects/02817484f8f94adca5a110557c4a04fe` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.636709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02817484f8f94adca5a110557c4a04fe)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:32.639285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:32.653328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4289/8469] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:32.658303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:32.659867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:32.677317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859a8c-a1e4-4b09-b01b-25d6bf5ed399 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:32.682770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:32.683729 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.684209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.684770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.685562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:32.687610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:32.704659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02817484f8f94adca5a110557c4a04fe', 'request_id': 'req-13834001-5336-4324-bad8-56bd3fc325d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:32.715051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02817484f8f94adca5a110557c4a04fe', 'request_id': 'req-13834001-5336-4324-bad8-56bd3fc325d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:32.722702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02817484f8f94adca5a110557c4a04fe', 'request_id': 'req-13834001-5336-4324-bad8-56bd3fc325d9'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:32.736566 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4290/8470] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:32 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:32.740343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:32.742961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] The token cache is being invalidate because project 02817484f8f94adca5a110557c4a04fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:32.743273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:32.745307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-13834001-5336-4324-bad8-56bd3fc325d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:32.747248 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4181/8471] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:32 2022] DELETE /identity/v3/projects/02817484f8f94adca5a110557c4a04fe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:32.753154 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.753456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.753743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.774826 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:32.776131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:32.840917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34beb3f-d45c-4051-bfa0-04b07ed07241 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:32.847279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:32.847966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.848252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.848560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.849265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:32.851200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:32.870473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4182/8472] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:32.878640 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4291/8473] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:32 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:32.890361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:32.893043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:32.907432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38436cee-be28-491b-8f35-a5432fd4c31f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:32.913038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:32.913508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.914122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.914487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.915767 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:32.917405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62960-52b8-4dc3-a0c4-9b614aea1f81 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:32.935031 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4183/8474] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:32.935901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:32.947564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37765-5f8f-4f0e-9ab9-32dff348a27f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:32.953689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:32.955151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.955440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.955719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] PATH_INFO: `/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd/users/f7869aeb89eb486c8d78cf4a7d1a6f85/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.971602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:32.971961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:32.972181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:32.974895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24d54a3f4d64e24b23d5626d77e90dd, user_id=f7869aeb89eb486c8d78cf4a7d1a6f85, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:32.977694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:32.996502 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4292/8475] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:32 2022] PUT /identity/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd/users/f7869aeb89eb486c8d78cf4a7d1a6f85/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:33.000266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.002167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:33.003495 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:33.069673 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4184/8476] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:33.070449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9217e63-4e71-4548-9115-1821437c24de admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.073306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.073502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.073993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.074279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.074558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.075289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.076934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.083880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b313b5-5e7f-42cf-a7bc-bb475c70d193 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.088252 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4293/8477] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:33.091872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.092580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.092864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.093148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.093870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:33.094023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.094177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.096433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.104761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b385d2-c9e0-4361-9804-ef665055b202 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.112513 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4185/8478] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:33.112971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.112971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.112971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.112971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] PATH_INFO: `/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd/users/f7869aeb89eb486c8d78cf4a7d1a6f85/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.114516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.115144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24d54a3f4d64e24b23d5626d77e90dd, user_id=f7869aeb89eb486c8d78cf4a7d1a6f85, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.117893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.125412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7acf-8ad4-43fc-897c-bb54f7d257d0 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.130072 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4294/8479] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:33 2022] PUT /identity/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd/users/f7869aeb89eb486c8d78cf4a7d1a6f85/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:33.188046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.188911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.189202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.189486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.190180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.192119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.224625 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4186/8480] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:33 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:33.230208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.243444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb309-663a-4af6-9d79-bc1de8a07e05 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.308203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.308802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.309069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.309339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.310151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.312114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.343451 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4295/8481] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:33 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:33.344822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.356168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4398f-c87f-40f9-a1ea-bed733944de1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.362444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.363353 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.363642 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.363920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.364682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.366296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.380932 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4187/8482] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:33.382219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.394040 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8ea13-8e39-4401-bd80-8ec887bd81ac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.401054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.401744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.402205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.402493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.403238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.404887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311624-3a53-4a7c-9cf2-db65e81e9717 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.418606 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4296/8483] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:33.423764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.436657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b80ba-11e3-4fee-bec7-dfbe01533d21 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.443023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.444006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.444376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.444823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] PATH_INFO: `/v3/projects/e25150de5c0748dd9c77a162a880d82b/users/bf0bfceaef6e4d86a587b585c0697aec/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.465083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25150de5c0748dd9c77a162a880d82b, user_id=bf0bfceaef6e4d86a587b585c0697aec, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.473097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.496763 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4188/8484] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:33 2022] PUT /identity/v3/projects/e25150de5c0748dd9c77a162a880d82b/users/bf0bfceaef6e4d86a587b585c0697aec/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:33.505984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.506292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.506579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.537703 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] MFA Rules not processed for user `bf0bfceaef6e4d86a587b585c0697aec`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:33.539607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:33.616657 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4297/8485] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:33.620516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.689077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272a45c-3e0f-42d6-9e05-8ec89dd36f76 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.694031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.694747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.695050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.695514 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.696325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.698469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.729142 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4189/8486] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:33 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:33.730368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.741894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5af35-b816-438b-ab6e-4cb641e6814f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.808933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.809730 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.810025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.810876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.811510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.814472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.840512 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4298/8487] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:33 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:33.845386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.856423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52906-121f-4298-9b04-9b1a8924bf31 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.864560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.865571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.865950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.866219 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.867037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.868689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.883866 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4190/8488] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:33.888296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.902896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3f6ca-a22b-4041-9675-af5d7b7d829c admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:33.910152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:33.911256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:33.911615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:33.911966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] PATH_INFO: `/v3/projects/bab59977950445ca95b0ba1b73fec14c/users/fc54ffd601d94edc80cfb46a48a59a92/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:33.932151 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab59977950445ca95b0ba1b73fec14c, user_id=fc54ffd601d94edc80cfb46a48a59a92, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:33.935047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:33.954261 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4299/8489] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:33 2022] PUT /identity/v3/projects/bab59977950445ca95b0ba1b73fec14c/users/fc54ffd601d94edc80cfb46a48a59a92/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:33.955663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:33.966508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c4fd4-1c7a-46b9-8b0c-1173f81442e8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:34.034974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:34.035789 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.036423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.036423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.037140 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:34.038745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55d99-f2fc-4f9b-9447-002110d4490c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:34.053510 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4191/8490] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:34.054914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:34.065826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109622ec-90e0-45b0-bdc0-14c19207be4d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:34.070820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:34.072510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.072510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.072510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] PATH_INFO: `/v3/projects/bab59977950445ca95b0ba1b73fec14c/users/fc54ffd601d94edc80cfb46a48a59a92/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.074744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab59977950445ca95b0ba1b73fec14c, user_id=fc54ffd601d94edc80cfb46a48a59a92, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:34.080020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:34.107842 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4300/8491] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:34 2022] PUT /identity/v3/projects/bab59977950445ca95b0ba1b73fec14c/users/fc54ffd601d94edc80cfb46a48a59a92/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:34.110058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.110457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.110870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.147950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] MFA Rules not processed for user `fc54ffd601d94edc80cfb46a48a59a92`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:34.150430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:34.245221 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4192/8492] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:34.254802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:34.256856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:34.343677 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81aebd-c78c-4568-b288-6fcbb026fb51 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:34.350164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:34.350981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.351373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.351818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.366013 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:34.367060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4080-df80-4917-afd9-04f55fda33df service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:34.381355 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4301/8493] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:34.547377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:34.647383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae42ab-8fea-429e-b7eb-4e58f688cab1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:34.656857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:34.658494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.659002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.659800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] PATH_INFO: `/v3/users/bf0bfceaef6e4d86a587b585c0697aec` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.664564 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0bfceaef6e4d86a587b585c0697aec)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:34.667739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:34.730678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0bfceaef6e4d86a587b585c0697aec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:34.746401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0bfceaef6e4d86a587b585c0697aec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:34.748336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0bfceaef6e4d86a587b585c0697aec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:34.773841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0bfceaef6e4d86a587b585c0697aec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:34.816091 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0bfceaef6e4d86a587b585c0697aec'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:34.828149 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4193/8494] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:34 2022] DELETE /identity/v3/users/bf0bfceaef6e4d86a587b585c0697aec => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:34.833386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:34.833845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:34.834293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:34.867001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:34.867001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:34.974089 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4302/8495] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:34.987373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:34.989227 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:35.107602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452bef0-2268-4026-b253-19eae942672e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:35.113744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:35.114594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:35.114911 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:35.115165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:35.128632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:35.130096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:35.144428 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4194/8496] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:35.515057 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:35.517143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:35.539197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84e8e2-1a43-4b51-8fb4-e12b28b6aff4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:35.548010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:35.549198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:35.549642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:35.550665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] PATH_INFO: `/v3/projects/e25150de5c0748dd9c77a162a880d82b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:35.552371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25150de5c0748dd9c77a162a880d82b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:35.554517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:35.639217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25150de5c0748dd9c77a162a880d82b', 'request_id': 'req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.648331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25150de5c0748dd9c77a162a880d82b', 'request_id': 'req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.669924 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25150de5c0748dd9c77a162a880d82b', 'request_id': 'req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.696916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] The token cache is being invalidate because project e25150de5c0748dd9c77a162a880d82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:35.698384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.704800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.706966 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4303/8497] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:35 2022] DELETE /identity/v3/projects/e25150de5c0748dd9c77a162a880d82b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:35.711446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:35.731212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b140e-1e35-4cfb-804e-6e8fb08effa1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:35.868960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:35.870578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:35.871384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:35.871844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] PATH_INFO: `/v3/users/fc54ffd601d94edc80cfb46a48a59a92` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:35.873764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc54ffd601d94edc80cfb46a48a59a92)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:35.878828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:35.972013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc54ffd601d94edc80cfb46a48a59a92'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.990471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc54ffd601d94edc80cfb46a48a59a92'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:35.991383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc54ffd601d94edc80cfb46a48a59a92'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.005186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc54ffd601d94edc80cfb46a48a59a92'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.015098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7a24ce56-5e45-4119-a08a-41a543667113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc54ffd601d94edc80cfb46a48a59a92'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.026417 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4195/8498] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:35 2022] DELETE /identity/v3/users/fc54ffd601d94edc80cfb46a48a59a92 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:36.474486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:36.477495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:36.498739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b3e9-f5e5-44e1-b99c-f2adf5018c56 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:36.586980 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:36.588568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:36.589228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:36.589785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] PATH_INFO: `/v3/projects/bab59977950445ca95b0ba1b73fec14c` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:36.592131 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab59977950445ca95b0ba1b73fec14c)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:36.596517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:36.675452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab59977950445ca95b0ba1b73fec14c', 'request_id': 'req-78ddff55-f82c-4102-93db-69e6e5897ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.682552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab59977950445ca95b0ba1b73fec14c', 'request_id': 'req-78ddff55-f82c-4102-93db-69e6e5897ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.694953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab59977950445ca95b0ba1b73fec14c', 'request_id': 'req-78ddff55-f82c-4102-93db-69e6e5897ecf'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.712675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] The token cache is being invalidate because project bab59977950445ca95b0ba1b73fec14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:36.712929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.715630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-78ddff55-f82c-4102-93db-69e6e5897ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:36.719827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4304/8499] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:36 2022] DELETE /identity/v3/projects/bab59977950445ca95b0ba1b73fec14c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:36.725352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:36.726341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:36.726949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:36.751387 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:36.753015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:36.850973 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4196/8500] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:36.863443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:36.863943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:36.864314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:36.914174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:36.920905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:36.937213 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4305/8501] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:36.948616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:36.960684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752c587-1a34-42c2-a3e6-73ffb62a4437 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:36.965246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:36.966516 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:36.966813 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:36.967098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:36.967984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:36.968307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:36.972783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:36.997531 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4197/8502] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:36.998978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.027789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7b29-3b67-4b82-9b15-c40686cf8816 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.044119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.044912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.045303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.045686 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.047894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.058960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.111502 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4306/8503] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:36 2022] POST /identity/v3/projects => generated 407 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:37.112693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.128520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e77c7b-a9f0-440d-9cc2-9e0629b06949 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.224429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.225354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.225747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.226318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.227781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.230540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.267174 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4198/8504] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:37 2022] POST /identity/v3/users => generated 304 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:37.271114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.285757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b85f4-b53a-4a6b-9877-f8253a947a5d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.291318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.292009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.292301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.292786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.293531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.296156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.310967 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4307/8505] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:37.312099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.325347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8b71-b060-4e7e-8258-cf2e5df4fcfb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.331043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.331719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.331999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.332276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.333104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.334785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb6ab7-9dbe-4447-8b78-f9d4fab1788a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.355200 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4199/8506] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:37.359145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.371101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660675-13b1-4248-9d7e-477f8b0dc1f5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.379377 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.380643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.381007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.381548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] PATH_INFO: `/v3/projects/9b949bfbe8a945aa941f82a98c0d1888/users/bd977c83d1154bc69810ac243e07676e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.408827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b949bfbe8a945aa941f82a98c0d1888, user_id=bd977c83d1154bc69810ac243e07676e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.413326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.435351 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4308/8507] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:37 2022] PUT /identity/v3/projects/9b949bfbe8a945aa941f82a98c0d1888/users/bd977c83d1154bc69810ac243e07676e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:37.445425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.445723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.446012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.487731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] MFA Rules not processed for user `bd977c83d1154bc69810ac243e07676e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:37.489359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:37.582932 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4200/8508] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:37.583649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.736007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ad048-2dfe-4399-917d-b36a83ac2322 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.747556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.748249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.751132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.752006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.752782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.757948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.812407 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4309/8509] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:37 2022] POST /identity/v3/projects => generated 407 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:37.815324 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:37.836786 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89e059-b417-41aa-8d82-302f8a3ff120 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:37.952327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:37.953183 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:37.953620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:37.955021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:37.955883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:37.958624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:37.998884 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4201/8510] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:37 2022] POST /identity/v3/users => generated 310 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:38.003504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.018381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46089cca-bd28-48e5-9336-f8cb9801a428 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.031288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.032053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.032399 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.032774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.033524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.035254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.048712 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4310/8511] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:38.053435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.076657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec1bc0-2c0d-44bb-bf6d-75b486a9e8bd admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.083651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.084850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.085011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.085395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] PATH_INFO: `/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b/users/174ee0aed2bc47629b57684c22200837/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.102025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1c01fc9ec4e10a96a77f31e10156b, user_id=174ee0aed2bc47629b57684c22200837, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.104964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.124573 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4202/8512] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:38 2022] PUT /identity/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b/users/174ee0aed2bc47629b57684c22200837/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:38.129060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.139184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0da2-20dd-4a6e-83bb-577502f27d10 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.214766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.215492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.215839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.216137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.216896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.218908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac0bb6-a1c6-4398-8949-e439edf84f3a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.232070 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4311/8513] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:38.236657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.248990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b2de-54ac-44c4-88c5-989bc34aa043 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.255090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.256278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.256743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.257173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] PATH_INFO: `/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b/users/174ee0aed2bc47629b57684c22200837/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.260818 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1c01fc9ec4e10a96a77f31e10156b, user_id=174ee0aed2bc47629b57684c22200837, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.263968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.277610 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4203/8514] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:38 2022] PUT /identity/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b/users/174ee0aed2bc47629b57684c22200837/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:23:38.289571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.289875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.290160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.337662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] MFA Rules not processed for user `174ee0aed2bc47629b57684c22200837`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:38.338896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:38.479182 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4312/8515] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:38.499352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.501901 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:38.545317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.546907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:38.600800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b59249-4d8e-4d51-82a5-900480943bbc admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.605520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.606316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.606715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.607103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.617994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.620821 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5949-6b9d-4089-bff7-439ce3ea0897 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.636376 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4204/8516] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:38.710640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20df7dd-f0dc-4a6e-895a-00f9b058f9b9 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.715879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.717336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.717336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.717336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.731466 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:38.759061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:38.761871 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:38.807731 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4313/8517] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:23:38.861948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa89a9e-15b7-4a96-a6f7-d7ebc19cd228 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.862488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa89a9e-15b7-4a96-a6f7-d7ebc19cd228 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.862575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa89a9e-15b7-4a96-a6f7-d7ebc19cd228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:38.898144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ffa89a9e-15b7-4a96-a6f7-d7ebc19cd228 None None] MFA Rules not processed for user `f7869aeb89eb486c8d78cf4a7d1a6f85`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:38.899499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ffa89a9e-15b7-4a96-a6f7-d7ebc19cd228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:38.946411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:38.960317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1559-a9a2-40bb-8fb0-0224eced00ce service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:38.964284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:38.964976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:38.965261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:38.965540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.010815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4205/8518] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:39.012132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8fbd-bf9a-4074-b076-682a27ad82de None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:39.012426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8fbd-bf9a-4074-b076-682a27ad82de None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:39.012737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab8fbd-bf9a-4074-b076-682a27ad82de None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.014557 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4206/8519] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:23:39.020110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:39.020428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:39.020736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.038211 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:39.039667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:39.041215 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:39.042438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:39.049616 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4314/8520] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:23:39.050367 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:39.051785 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:39.113365 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4207/8521] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:23:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:39.142783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:39.144964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:39.147323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239c4fa-c77b-438e-af1c-d979b286e8b8 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:39.151586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:39.152682 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:39.153189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:39.153708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.155932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:39.164168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314f46-30a5-478d-8948-aafff0833b3d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:39.170848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:39.171938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:39.172866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:39.173126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.183269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:39.185053 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:39.195762 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4208/8522] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:39.240916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:39.243458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:39.260115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4315/8523] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:39.462958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:39.477923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe003-8005-426e-a59e-45818b3bd977 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:39.482222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:39.482893 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:39.483184 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:39.483466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:39.490088 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:39.585985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:39.588824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50bbc6-a71c-42bc-bd1f-4a918ddbf2fa service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:39.635257 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4209/8524] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:47.806129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:47.896694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfec671-5717-4c5e-ad72-a3499cc0ed62 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:47.901254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:47.902135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:47.902419 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:47.902699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] PATH_INFO: `/v3/users/bd977c83d1154bc69810ac243e07676e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:47.903885 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd977c83d1154bc69810ac243e07676e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:47.905867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:47.952787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd977c83d1154bc69810ac243e07676e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:47.961798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd977c83d1154bc69810ac243e07676e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:47.962506 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd977c83d1154bc69810ac243e07676e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:47.963138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd977c83d1154bc69810ac243e07676e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:47.970570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd977c83d1154bc69810ac243e07676e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:47.989929 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4316/8525] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:47 2022] DELETE /identity/v3/users/bd977c83d1154bc69810ac243e07676e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:47.994682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:47.995186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:47.995299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:48.017987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:48.019276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:48.097606 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4210/8526] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:48.108994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:48.110709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:48.196508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef3b1-dac9-43b9-8a5b-e05fdda023bb admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:48.198286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:48.199159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:48.199451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:48.199731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:48.210555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:48.212031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:48.227509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4317/8527] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:48.596108 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:48.597955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:48.617809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc09f9-dc59-40ac-b8b5-e07065e24349 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:48.633657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:48.637230 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:48.637538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:48.637923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] PATH_INFO: `/v3/projects/9b949bfbe8a945aa941f82a98c0d1888` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:48.640245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b949bfbe8a945aa941f82a98c0d1888)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:48.643797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:48.747149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b949bfbe8a945aa941f82a98c0d1888', 'request_id': 'req-1fb72f9c-8401-4634-87d6-7fd9235fe95e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.756627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b949bfbe8a945aa941f82a98c0d1888', 'request_id': 'req-1fb72f9c-8401-4634-87d6-7fd9235fe95e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.765319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b949bfbe8a945aa941f82a98c0d1888', 'request_id': 'req-1fb72f9c-8401-4634-87d6-7fd9235fe95e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.784620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] The token cache is being invalidate because project 9b949bfbe8a945aa941f82a98c0d1888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:48.784921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.785886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.788020 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4211/8528] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:48 2022] DELETE /identity/v3/projects/9b949bfbe8a945aa941f82a98c0d1888 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:48.793670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:48.808324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c323a64-f764-480a-a095-208c87488bfc service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:48.881570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:48.882478 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:48.882789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:48.883071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] PATH_INFO: `/v3/users/174ee0aed2bc47629b57684c22200837` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:48.884264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=174ee0aed2bc47629b57684c22200837)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:48.886247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:48.930107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174ee0aed2bc47629b57684c22200837'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.937983 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174ee0aed2bc47629b57684c22200837'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.938636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174ee0aed2bc47629b57684c22200837'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.939279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174ee0aed2bc47629b57684c22200837'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.945981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8ee6990f-a3ed-4f55-9ea3-0deb59d24a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174ee0aed2bc47629b57684c22200837'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:48.962917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4318/8529] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:23:48 2022] DELETE /identity/v3/users/174ee0aed2bc47629b57684c22200837 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:49.245249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.246743 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:49.263361 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72f9c-8401-4634-87d6-7fd9235fe95e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.328905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.329774 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.330060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.330341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] PATH_INFO: `/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.331533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee1c01fc9ec4e10a96a77f31e10156b)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.333523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.379336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee1c01fc9ec4e10a96a77f31e10156b', 'request_id': 'req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:49.385293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee1c01fc9ec4e10a96a77f31e10156b', 'request_id': 'req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:49.390608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee1c01fc9ec4e10a96a77f31e10156b', 'request_id': 'req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:49.402482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] The token cache is being invalidate because project 4ee1c01fc9ec4e10a96a77f31e10156b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:23:49.402771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:49.403395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-37f02deb-a3b5-4d2e-9e28-0ab2aec137d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:23:49.404970 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4212/8530] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:23:49 2022] DELETE /identity/v3/projects/4ee1c01fc9ec4e10a96a77f31e10156b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:49.410418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.410716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.411019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.429413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:49.430242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:49.489676 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4319/8531] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:49.497565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.497857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.498133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.516681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:49.517907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:49.525881 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4213/8532] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:49.530133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.540846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671d30-d0cf-4368-b4e4-b4e968ff066e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.545695 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.546357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.546644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.547501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.548226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:23:49.548567 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.550184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.562268 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4320/8533] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:23:49.566567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.575845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdbcef-fe73-43c1-9079-02fbebdec2b3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.580664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.581318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.581603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.581879 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.582590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.585068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.616805 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4214/8534] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:49.622331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.632787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a266-ea74-471b-be7a-6c61cbff5dcf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.690293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.691007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.691294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.691574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.692262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.694262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.715207 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4321/8535] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:23:49.719943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.730355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea830-ab0e-4f56-a505-fd1b8ce60ca3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.735574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.736235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.736618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.736844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.737568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.739175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.750231 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4215/8536] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:49.754447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.765102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d762b-0ebc-4f5a-bce2-9617ccde329b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.771264 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.772116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.772494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.772789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.773522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.775146 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a989e-d17f-4a71-b764-96022ea9b8c4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.787222 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4322/8537] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:49.791803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:49.802027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9955c-1c2b-46fb-8ba9-eeadedf38680 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:49.806817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:49.807706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.807995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.808282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] PATH_INFO: `/v3/projects/e439a4f5dae544f0bfe852f45f89c689/users/12d297c31444417f80657d3f4ddfef5e/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.823487 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e439a4f5dae544f0bfe852f45f89c689, user_id=12d297c31444417f80657d3f4ddfef5e, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:49.826671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:49.847205 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4216/8538] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:49 2022] PUT /identity/v3/projects/e439a4f5dae544f0bfe852f45f89c689/users/12d297c31444417f80657d3f4ddfef5e/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:49.853510 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:49.853984 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:49.854256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:49.882091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] MFA Rules not processed for user `12d297c31444417f80657d3f4ddfef5e`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:49.883301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:49.952491 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4323/8539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:49.957468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.029581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdb3a3-f3e6-487c-8fef-b23603142a1f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.035236 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.035982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.036341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.036854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.038040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.040345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.069216 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4217/8540] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:50.073144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.087382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15dec8-ec35-43ac-83b0-cc993d7f3a89 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.147849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.148588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.148884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.149263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.149854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.151778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.172831 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4324/8541] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:23:50 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:23:50.176946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.187039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5174ee-b614-4293-b20e-65e4cf769ee5 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.191646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.192296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.192625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.192903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.193613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.195192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.205666 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4218/8542] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:50.209660 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.220003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f863e-bc51-4ecd-9204-4a7820e58e9b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.224691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.225566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.225855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.226137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] PATH_INFO: `/v3/projects/bd1a43dd42a746e297e5fac4ae74236d/users/d0710ab1e5e84258a206c7fd56e98bbf/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.240930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1a43dd42a746e297e5fac4ae74236d, user_id=d0710ab1e5e84258a206c7fd56e98bbf, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.243589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.256478 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4325/8543] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:50 2022] PUT /identity/v3/projects/bd1a43dd42a746e297e5fac4ae74236d/users/d0710ab1e5e84258a206c7fd56e98bbf/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:50.260358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.270701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f75ab8-8135-4577-9736-b68eba8e507d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.327413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.328045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.328335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.328650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.329374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.330970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563535-944e-4922-b90f-21fe5accb59b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.341014 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4219/8544] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:23:50.345899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.356006 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122111c-a0aa-4cdc-98d7-d3cf2ead613d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.361633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.362518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.362819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.363099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] PATH_INFO: `/v3/projects/bd1a43dd42a746e297e5fac4ae74236d/users/d0710ab1e5e84258a206c7fd56e98bbf/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.365126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1a43dd42a746e297e5fac4ae74236d, user_id=d0710ab1e5e84258a206c7fd56e98bbf, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.367791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.377900 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4326/8545] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:23:50 2022] PUT /identity/v3/projects/bd1a43dd42a746e297e5fac4ae74236d/users/d0710ab1e5e84258a206c7fd56e98bbf/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:23:50.387953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.388275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.388591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.414247 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] MFA Rules not processed for user `d0710ab1e5e84258a206c7fd56e98bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:50.415699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:50.484009 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4220/8546] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:23:50.495074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:50.496794 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:50.555329 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ace76-37b2-4916-8c04-5c76d678c1a0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:50.558994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:50.559637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:50.559918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:50.560241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:50.613223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:50.614583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425fd6-83c8-4849-86ef-eacae9d0d9c8 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:50.623144 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4327/8547] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:55.197038 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:55.210725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64edb5-60c3-489c-ad32-9474ce4ee614 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:55.215873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:55.216838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:55.217224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:55.217569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:55.227785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:55.229348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:55.238916 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4221/8548] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:57.435217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:57.435758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:57.435856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:57.469501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] MFA Rules not processed for user `4cb67e8ec9b44d6f89640b4ccabd1987`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:23:57.470752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:57.526565 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4328/8549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:23:59.219771 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:59.221260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:59.289374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252b0d2-938e-4825-bbb9-f211859f2ff3 service cinder] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:23:59.295217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:23:59.296180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:23:59.296790 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:23:59.297109 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:23:59.299264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:23:59.314491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:23:59.315920 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:23:59.331955 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4222/8550] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:23:59.990288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:23:59.993204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:00.122416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7a8c4-0faa-44a2-8471-3d38de510409 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:00.128976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:00.129689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:00.130064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:00.130396 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:00.133141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:00.133950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:00.150476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:00.152619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6652c-68d6-49d9-baea-8026a9b104d8 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:00.183006 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4329/8551] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:00.272039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624427-005e-4506-80f0-a58ac6a717ec service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:00.279995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:00.281528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:00.281866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:00.282152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] PATH_INFO: `/v3/users/12d297c31444417f80657d3f4ddfef5e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:00.284773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d297c31444417f80657d3f4ddfef5e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:00.286750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:00.421208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d297c31444417f80657d3f4ddfef5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:00.453033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d297c31444417f80657d3f4ddfef5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:00.454159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d297c31444417f80657d3f4ddfef5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:00.474719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d297c31444417f80657d3f4ddfef5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:00.483601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d297c31444417f80657d3f4ddfef5e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:00.495736 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4223/8552] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:24:00 2022] DELETE /identity/v3/users/12d297c31444417f80657d3f4ddfef5e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:24:00.502860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:00.503161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:00.503508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:00.547936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:00.552295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:00.697041 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4330/8553] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:00.719752 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:00.723342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:00.841037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244ca0-130f-4e1a-bc77-2ffa6f7edd6c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:00.846065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:00.847106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:00.847631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:00.848066 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:00.861342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:00.863259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:00.879599 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4224/8554] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:01.539922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:01.541444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:01.562452 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43117-0fd6-49ba-9247-94233c745f68 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:01.574667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:01.575798 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:01.576183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:01.576604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] PATH_INFO: `/v3/projects/e439a4f5dae544f0bfe852f45f89c689` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:01.579482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e439a4f5dae544f0bfe852f45f89c689)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:01.581936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:01.665731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e439a4f5dae544f0bfe852f45f89c689', 'request_id': 'req-9ed189be-5181-409b-9d6d-238cecd45f9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.678313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e439a4f5dae544f0bfe852f45f89c689', 'request_id': 'req-9ed189be-5181-409b-9d6d-238cecd45f9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.688373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e439a4f5dae544f0bfe852f45f89c689', 'request_id': 'req-9ed189be-5181-409b-9d6d-238cecd45f9e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.707209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] The token cache is being invalidate because project e439a4f5dae544f0bfe852f45f89c689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:24:01.707951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.708844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.710734 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4331/8555] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:24:01 2022] DELETE /identity/v3/projects/e439a4f5dae544f0bfe852f45f89c689 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:01.715210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:01.727326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf382-20d0-41f4-9e88-78243ecd164a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:01.804960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:01.805854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:01.806139 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:01.806606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] PATH_INFO: `/v3/users/d0710ab1e5e84258a206c7fd56e98bbf` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:01.807838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0710ab1e5e84258a206c7fd56e98bbf)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:01.809983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:01.860795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0710ab1e5e84258a206c7fd56e98bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.873701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0710ab1e5e84258a206c7fd56e98bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.874658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0710ab1e5e84258a206c7fd56e98bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.881891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0710ab1e5e84258a206c7fd56e98bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.888955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-15954581-817c-46b0-88ed-2b4503b1f6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0710ab1e5e84258a206c7fd56e98bbf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:01.895324 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4225/8556] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:24:01 2022] DELETE /identity/v3/users/d0710ab1e5e84258a206c7fd56e98bbf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:02.184640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.186074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:02.207186 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed189be-5181-409b-9d6d-238cecd45f9e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.273689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.274606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.274891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.275168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] PATH_INFO: `/v3/projects/bd1a43dd42a746e297e5fac4ae74236d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.276361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1a43dd42a746e297e5fac4ae74236d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.278441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.330422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1a43dd42a746e297e5fac4ae74236d', 'request_id': 'req-aabcfc78-1d48-4d43-aa3b-5c655555189b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:02.337590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1a43dd42a746e297e5fac4ae74236d', 'request_id': 'req-aabcfc78-1d48-4d43-aa3b-5c655555189b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:02.353611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1a43dd42a746e297e5fac4ae74236d', 'request_id': 'req-aabcfc78-1d48-4d43-aa3b-5c655555189b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:02.366385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] The token cache is being invalidate because project bd1a43dd42a746e297e5fac4ae74236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:24:02.366750 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:02.367508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-aabcfc78-1d48-4d43-aa3b-5c655555189b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:02.370133 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4332/8557] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:24:02 2022] DELETE /identity/v3/projects/bd1a43dd42a746e297e5fac4ae74236d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:02.376502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.376979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.377377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.398013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:02.399506 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:02.463894 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4226/8558] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:02.472612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.473107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.473775 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.492890 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:02.494274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:02.504423 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4333/8559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:24:02.508586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.518970 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdd650-dc05-4225-b60f-8d847e233e5b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.524474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.525386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.525677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.525953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.526687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:24:02.527527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.528834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.541355 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4227/8560] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:24:02.545588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.556425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a225ba8-df19-4251-b53d-588a8a92ab26 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.562783 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.563733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.564126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.564534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.565347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.567544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.607839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4334/8561] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:24:02 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:24:02.612337 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.625633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea5616-a1d8-4003-b61d-0da1445c5c45 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.696905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.697693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.698057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.698445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.699220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.701311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.723448 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4228/8562] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:24:02 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:24:02.727728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.740975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa9e2-9c1e-4f39-8d98-24ca8a0a3196 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.746069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.746833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.747351 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.747707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.748826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.751089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.762599 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4335/8563] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:24:02.766469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.777031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8140da-42cb-44e0-9f8f-ac13ce067da7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.782407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.783086 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.783370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.783650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.784509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.786179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea827f-90ab-4c04-8022-64cb9d4f2c38 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.806141 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4229/8564] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:24:02.811008 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:02.822334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ebaf4-5ce1-4678-a172-cfeb59532975 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:02.827192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:02.828190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.828581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.828937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] PATH_INFO: `/v3/projects/9113447cf19747d0a263d8091a7bd7ca/users/691c9fe8c2824883a8da9c78e22c8cc5/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.844138 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9113447cf19747d0a263d8091a7bd7ca, user_id=691c9fe8c2824883a8da9c78e22c8cc5, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:02.846931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:02.863060 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4336/8565] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:24:02 2022] PUT /identity/v3/projects/9113447cf19747d0a263d8091a7bd7ca/users/691c9fe8c2824883a8da9c78e22c8cc5/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:02.876132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:02.876419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:02.876739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:02.906962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] MFA Rules not processed for user `691c9fe8c2824883a8da9c78e22c8cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:02.908168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:02.991095 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4230/8566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:03.002737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.004574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.062381 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32415fb-1fd2-4f7d-b514-fc9afdad31ae admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.066149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.066797 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.067079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.067353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.075743 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.077209 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5c53b-1911-4c89-8aa7-c36f15fe29f1 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:03.086029 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4337/8567] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:03.110844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.174144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b3651-901a-42ac-9328-504ea6f0e269 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.178895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.179764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.180046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.180322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] PATH_INFO: `/v3/users/691c9fe8c2824883a8da9c78e22c8cc5` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.181548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691c9fe8c2824883a8da9c78e22c8cc5)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.183448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:03.227983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691c9fe8c2824883a8da9c78e22c8cc5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.240067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691c9fe8c2824883a8da9c78e22c8cc5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.240809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691c9fe8c2824883a8da9c78e22c8cc5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.248068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691c9fe8c2824883a8da9c78e22c8cc5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.254685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691c9fe8c2824883a8da9c78e22c8cc5'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.260401 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4231/8568] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:24:03 2022] DELETE /identity/v3/users/691c9fe8c2824883a8da9c78e22c8cc5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:03.265402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.265697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.265978 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.284233 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:03.285488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.345949 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4338/8569] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:03.355840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.357418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.416221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f97dce-cefb-48e0-899c-c4d161fb7600 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.420095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.420787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.421131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.421442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.430844 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.432272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb70c2-b7a1-459d-86d7-04d0c12ffdd0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:03.441854 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4232/8570] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:03.716599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.718552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.730651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1a32d-d7c4-4326-ad44-e550fe8b5d4e None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.735947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.736843 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.737124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.737400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] PATH_INFO: `/v3/projects/9113447cf19747d0a263d8091a7bd7ca` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.738584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9113447cf19747d0a263d8091a7bd7ca)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.740544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:03.785877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9113447cf19747d0a263d8091a7bd7ca', 'request_id': 'req-25cde939-bbef-4a68-993b-7a93bc9eabb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.792084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9113447cf19747d0a263d8091a7bd7ca', 'request_id': 'req-25cde939-bbef-4a68-993b-7a93bc9eabb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.799520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9113447cf19747d0a263d8091a7bd7ca', 'request_id': 'req-25cde939-bbef-4a68-993b-7a93bc9eabb2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.809722 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] The token cache is being invalidate because project 9113447cf19747d0a263d8091a7bd7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:24:03.810043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.810709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-25cde939-bbef-4a68-993b-7a93bc9eabb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:03.812275 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4339/8571] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:24:03 2022] DELETE /identity/v3/projects/9113447cf19747d0a263d8091a7bd7ca => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:03.817358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.817849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.817979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.835316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:03.836545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.893355 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4233/8572] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:03.901274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.901595 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.901877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.920411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:03.922245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:03.930144 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4340/8573] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:03.934203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.943778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ad8b5-bd8b-4132-a0b7-a204969164f5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.948339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.949025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.949313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.949594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.950309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:24:03.950620 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.952216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:03.963540 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4234/8574] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:24:03.967752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:03.977779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0c4e-dfb2-469c-89d7-29530ae3847a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:03.982764 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:03.983505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:03.984495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:03.984836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:03.985665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:03.987634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.012795 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4341/8575] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:24:03 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:24:04.017661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:04.027531 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c829c-5498-4e23-a442-6d8d0ae86fa3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:04.083317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:04.083992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.084279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.084600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.085287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:04.087197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.107650 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4235/8576] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:24:04 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:24:04.112002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:04.123447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75867d52-9bc3-47a6-a494-a1fe9ffeec70 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:04.128153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:04.128851 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.129134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.129411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.130128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:04.131709 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.142674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4342/8577] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:24:04.147371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:04.158465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68e2b3-2886-4ff8-9df0-cdc3f8779805 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:04.163180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:04.163860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.164144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.164417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.165418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:04.166993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57019e-5f78-47a6-a585-eaecc0ec48be admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.176735 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4236/8578] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:24:04.181133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:04.191147 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0599-512b-4777-afaa-a12eed6fd839 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:04.195734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:04.196684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.196971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.197253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] PATH_INFO: `/v3/projects/7647e168474a45789031750d07df5429/users/4ad346194bea43d482ffa0722ca892f3/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.211542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7647e168474a45789031750d07df5429, user_id=4ad346194bea43d482ffa0722ca892f3, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:04.214221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.227389 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4343/8579] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:24:04 2022] PUT /identity/v3/projects/7647e168474a45789031750d07df5429/users/4ad346194bea43d482ffa0722ca892f3/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:04.237735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4af9-c6df-435a-ab25-a71682323c67 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.238027 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4af9-c6df-435a-ab25-a71682323c67 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.238305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4af9-c6df-435a-ab25-a71682323c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.263628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-caaa4af9-c6df-435a-ab25-a71682323c67 None None] MFA Rules not processed for user `4ad346194bea43d482ffa0722ca892f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:04.265362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-caaa4af9-c6df-435a-ab25-a71682323c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:04.327219 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4237/8580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:04.338629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:04.340282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:04.400207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83994a-cd59-46f5-9759-f1e5d8ac6910 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:04.403856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:04.404536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:04.404824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:04.405107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:04.413468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:04.415167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:04.423863 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4344/8581] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:05.762963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e34b-3dbe-4aba-9798-c677449921fe None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:05.763458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e34b-3dbe-4aba-9798-c677449921fe None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:05.763578 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480e34b-3dbe-4aba-9798-c677449921fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:05.783338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2480e34b-3dbe-4aba-9798-c677449921fe None None] MFA Rules not processed for user `4ad346194bea43d482ffa0722ca892f3`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:05.784838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2480e34b-3dbe-4aba-9798-c677449921fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:05.792348 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4238/8582] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:08.501704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:08.503594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:08.632527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405a171-821c-4c3a-b445-d6f02370a5a9 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:08.638985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:08.639697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:08.639993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:08.640613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:08.642931 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:08.662184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:08.663937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:08.679623 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4345/8583] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:23.665382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b24c-3f7e-40c2-9870-36a3edd312ac None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:23.665875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b24c-3f7e-40c2-9870-36a3edd312ac None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:23.665978 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b24c-3f7e-40c2-9870-36a3edd312ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:23.683849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-dd68b24c-3f7e-40c2-9870-36a3edd312ac None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:23.685068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dd68b24c-3f7e-40c2-9870-36a3edd312ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:23.738325 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4239/8584] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:24:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:23.783069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:23.784526 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:23.852696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81923a5-1e3d-4c7e-8bac-4ceb8cfafe9d service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:23.857598 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:23.858733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:23.859015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:23.859294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:23.867136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:23.868738 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:23.877052 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4346/8585] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:24.353817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b7ea9-996d-4757-bea1-2182c7771466 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:24.354115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b7ea9-996d-4757-bea1-2182c7771466 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:24.354395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b7ea9-996d-4757-bea1-2182c7771466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:24.371859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7d9b7ea9-996d-4757-bea1-2182c7771466 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:24.373071 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7d9b7ea9-996d-4757-bea1-2182c7771466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:24.380554 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4240/8586] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:24.394234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:24.409307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961e2e0-0d12-4843-87d1-9034d49009da service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:24.414712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:24.415362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:24.415649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:24.415929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:24.424776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:24.426789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:24.435529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4347/8587] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:24:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:24.621111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899944-30dd-47e6-847c-45309824c34a None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:24.621407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899944-30dd-47e6-847c-45309824c34a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:24.621691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899944-30dd-47e6-847c-45309824c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:24.641382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-24899944-30dd-47e6-847c-45309824c34a None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:24.642589 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-24899944-30dd-47e6-847c-45309824c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:24.649815 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4241/8588] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:24:24.661970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:24.675030 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97552-dcb4-4b35-b235-28e71486f1c9 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:24.680074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:24.680742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:24.681037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:24.681316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:24.690019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:24.691641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:24.699841 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4348/8589] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:24:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:25.008956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:25.009415 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:25.009508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:25.027504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:25.028716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:25.036147 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4242/8590] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:25.049070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:25.062563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c090-a5b9-41c3-b322-db4524ca9e77 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:25.067658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:25.068294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:25.068614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:25.068895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:25.076756 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:25.078331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40743c28-58b7-4fcf-a748-f33c440918b9 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:25.086158 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4349/8591] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:27.099958 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:27.161095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdcac-844b-45a8-b222-3f656a488c36 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:27.165942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:27.166806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:27.167095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:27.167374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] PATH_INFO: `/v3/users/4ad346194bea43d482ffa0722ca892f3` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:27.168614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad346194bea43d482ffa0722ca892f3)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:27.170530 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:27.214089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad346194bea43d482ffa0722ca892f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.225365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad346194bea43d482ffa0722ca892f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.226045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad346194bea43d482ffa0722ca892f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.233031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad346194bea43d482ffa0722ca892f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.239722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad346194bea43d482ffa0722ca892f3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.245681 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4243/8592] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:24:27 2022] DELETE /identity/v3/users/4ad346194bea43d482ffa0722ca892f3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:24:27.250929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:27.251408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:27.251507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:27.269297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:24:27.270497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:27.326644 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4350/8593] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:24:27.336426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:27.337865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:27.396133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00453c80-b0de-4c7a-8486-ddfa01906750 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:27.399811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:27.400471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:27.400769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:27.401050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:27.410110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:27.411536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:27.421611 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4244/8594] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:27.586992 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:27.588497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:27.600321 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae1564-9b61-438f-be3b-fa4de233a032 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:27.605647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:27.606518 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:27.606803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:27.607079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] PATH_INFO: `/v3/projects/7647e168474a45789031750d07df5429` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:27.608881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7647e168474a45789031750d07df5429)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:27.610792 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:27.658313 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7647e168474a45789031750d07df5429', 'request_id': 'req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.668355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7647e168474a45789031750d07df5429', 'request_id': 'req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.676563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7647e168474a45789031750d07df5429', 'request_id': 'req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.686736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] The token cache is being invalidate because project 7647e168474a45789031750d07df5429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:24:27.687029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.687700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:24:27.689511 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4351/8595] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:24:27 2022] DELETE /identity/v3/projects/7647e168474a45789031750d07df5429 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:24:47.760967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:47.772556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3328a-af6e-4add-a580-aeb4e0f31248 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:47.824229 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:47.825040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:47.825330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:47.825640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:47.827535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:47.831490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:47.832957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:47.886272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:47.887701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:47.896915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4245/8596] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:24:47.920280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd4-18b5-4ff2-9430-def1087d3aa5 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:47.925875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:47.926528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:47.926810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:47.927083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:47.928891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:47.942910 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:47.944496 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:47.956950 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4352/8597] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:24:55.284993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:55.302679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e91e-65c1-4799-a7e7-136bc2777c21 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:55.313945 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:55.315160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:55.315598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:55.316104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:55.318828 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:55.356854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:55.359341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a3c5b-6140-48bc-afcb-5077a11ada56 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:55.372872 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4246/8598] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:24:57.647859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:24:57.649410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:57.663795 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5506a2-5b1d-4bca-8736-3ff9adc59502 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:24:57.667412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:24:57.668056 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:24:57.668343 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:24:57.668656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:24:57.670369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:24:57.732789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:24:57.734227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:24:57.744509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4353/8599] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:25:01.030044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94de1a-5552-4683-ba87-300fa81e2eb8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:25:01.031028 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94de1a-5552-4683-ba87-300fa81e2eb8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:25:01.031131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94de1a-5552-4683-ba87-300fa81e2eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:25:01.054858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-fc94de1a-5552-4683-ba87-300fa81e2eb8 None None] MFA Rules not processed for user `c87f4a9a2f5a4c9d831ca26b8bc91f17`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:25:01.056816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fc94de1a-5552-4683-ba87-300fa81e2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:25:01.069627 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4247/8600] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:25:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:25:49.845772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:25:49.857791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde809b7-3a7a-4c7b-8655-b5d12fcb0d55 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:25:49.862332 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:25:49.863042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:25:49.863504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:25:49.863905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:25:49.865740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:25:49.878733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:25:49.880167 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64945d-3564-46e7-ba2d-c775642626a5 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:25:49.890652 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4354/8601] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:25:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:25:50.024429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:25:50.025045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:25:50.025045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:25:50.026892 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4248/8602] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:25:50.032172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41510-0b22-4f05-91ce-bd5756be1785 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:25:50.032517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41510-0b22-4f05-91ce-bd5756be1785 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:25:50.032803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41510-0b22-4f05-91ce-bd5756be1785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:25:50.051278 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9dc41510-0b22-4f05-91ce-bd5756be1785 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:25:50.052512 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9dc41510-0b22-4f05-91ce-bd5756be1785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:25:50.061157 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4355/8603] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:25:50.080865 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:25:50.082637 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:25:50.103358 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c9c89-d640-485c-b4a7-fc3db29486d5 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:25:50.109073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:25:50.109781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:25:50.110072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:25:50.110355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:25:50.119246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:25:50.120866 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:25:50.130549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4249/8604] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:26:07.590142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08dab-5118-4471-a728-0247168d53ae None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:26:07.590651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08dab-5118-4471-a728-0247168d53ae None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:26:07.590761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08dab-5118-4471-a728-0247168d53ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:26:07.611845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-72d08dab-5118-4471-a728-0247168d53ae None None] MFA Rules not processed for user `c87f4a9a2f5a4c9d831ca26b8bc91f17`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:26:07.613148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-72d08dab-5118-4471-a728-0247168d53ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:26:07.620525 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4356/8605] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:26:07.964130 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:26:07.965815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:26:07.981463 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bef528-a817-41c2-9e09-63f7d3a82ad8 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:26:07.985680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:26:07.986571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:26:07.987009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:26:07.987450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:26:07.989465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:26:08.002490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:26:08.004064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:26:08.015759 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4250/8606] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:26:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:26:53.241520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d08dab-5118-4471-a728-0247168d53ae None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:26:53.253826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d08dab-5118-4471-a728-0247168d53ae None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:26:53.257474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:26:53.258122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:26:53.258412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:26:53.258697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:26:53.260529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:26:53.330755 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:26:53.332198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:26:53.346113 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4357/8607] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:26:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:26:54.445544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:26:54.457291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8497d1-844a-4a5e-b193-f84aca0f829d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:26:54.460961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:26:54.461633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:26:54.461914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:26:54.462189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:26:54.463951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:26:54.480238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:26:54.481739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:26:54.494825 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4251/8608] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:27:49.239589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:49.250971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0ab5-1c16-487d-aba5-35c663efb31a service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:49.255333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:49.256692 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:49.257352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:49.258091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:49.260358 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:49.273884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:49.275691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722277b-c072-4151-9095-1b77778b720d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:49.290658 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4358/8609] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:27:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:27:56.387132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:56.388808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:56.452923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2c1e9-4cb5-4bb0-8adb-b3aec00e5424 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:56.458021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:56.458896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:56.459177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:56.459453 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] PATH_INFO: `/v3/users/c87f4a9a2f5a4c9d831ca26b8bc91f17` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:56.460659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87f4a9a2f5a4c9d831ca26b8bc91f17)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:56.462573 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:56.506344 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87f4a9a2f5a4c9d831ca26b8bc91f17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.517684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87f4a9a2f5a4c9d831ca26b8bc91f17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.518350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87f4a9a2f5a4c9d831ca26b8bc91f17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.525410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87f4a9a2f5a4c9d831ca26b8bc91f17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.532261 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87f4a9a2f5a4c9d831ca26b8bc91f17'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.538994 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4252/8610] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:27:56 2022] DELETE /identity/v3/users/c87f4a9a2f5a4c9d831ca26b8bc91f17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:27:56.543578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fccb-100c-4a66-a962-b888712622fe None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:56.544092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fccb-100c-4a66-a962-b888712622fe None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:56.544190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768fccb-100c-4a66-a962-b888712622fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:56.560891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2768fccb-100c-4a66-a962-b888712622fe None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:27:56.562089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2768fccb-100c-4a66-a962-b888712622fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:56.623337 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4359/8611] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:27:56.634430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:56.635370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:56.694006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb8c1-cc83-48cd-a81a-a484bcac6d75 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:56.697773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:56.698423 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:56.698711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:56.698991 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:56.708750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:56.710178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:56.720299 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4253/8612] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:27:56.888255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768fccb-100c-4a66-a962-b888712622fe None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:56.889731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2768fccb-100c-4a66-a962-b888712622fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:56.902507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768fccb-100c-4a66-a962-b888712622fe None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:56.907405 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:56.908609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:56.909079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:56.909437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] PATH_INFO: `/v3/projects/8c67d04af96d45f995da597f3f678014` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:56.910707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c67d04af96d45f995da597f3f678014)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:56.912693 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:56.960340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c67d04af96d45f995da597f3f678014', 'request_id': 'req-24682a9f-08ff-4671-9674-1076b1fafebd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.966554 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c67d04af96d45f995da597f3f678014', 'request_id': 'req-24682a9f-08ff-4671-9674-1076b1fafebd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.975298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c67d04af96d45f995da597f3f678014', 'request_id': 'req-24682a9f-08ff-4671-9674-1076b1fafebd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.986867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] The token cache is being invalidate because project 8c67d04af96d45f995da597f3f678014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:27:56.987158 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.988346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:56.990310 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4360/8613] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:27:56 2022] DELETE /identity/v3/projects/8c67d04af96d45f995da597f3f678014 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:27:56.994060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:57.005366 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c774-f7d8-46a3-a1b6-09266cc7973b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:57.063488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:57.064441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:57.064834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:57.065202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] PATH_INFO: `/v3/users/2f4699b061734ae6b846fbb238a45b29` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:57.067681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4699b061734ae6b846fbb238a45b29)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:57.070016 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:57.115293 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4699b061734ae6b846fbb238a45b29'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.126590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4699b061734ae6b846fbb238a45b29'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.127257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4699b061734ae6b846fbb238a45b29'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.134256 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4699b061734ae6b846fbb238a45b29'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.140979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4699b061734ae6b846fbb238a45b29'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.146692 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4254/8614] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:27:56 2022] DELETE /identity/v3/users/2f4699b061734ae6b846fbb238a45b29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:27:57.317200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:27:57.318711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:27:57.334832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24682a9f-08ff-4671-9674-1076b1fafebd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:27:57.389786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:27:57.390645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:27:57.390929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:27:57.391205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] PATH_INFO: `/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:27:57.392362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce69b144575d48ca9fdf5f7a55a2f43a)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:27:57.394310 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:27:57.438473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce69b144575d48ca9fdf5f7a55a2f43a', 'request_id': 'req-484b8be5-ed51-4736-a017-b603f5331f13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.444691 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce69b144575d48ca9fdf5f7a55a2f43a', 'request_id': 'req-484b8be5-ed51-4736-a017-b603f5331f13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.452907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce69b144575d48ca9fdf5f7a55a2f43a', 'request_id': 'req-484b8be5-ed51-4736-a017-b603f5331f13'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.463487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] The token cache is being invalidate because project ce69b144575d48ca9fdf5f7a55a2f43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:27:57.463776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.464408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:27:57.466007 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4361/8615] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:27:57 2022] DELETE /identity/v3/projects/ce69b144575d48ca9fdf5f7a55a2f43a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:28:39.698954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:28:39.700470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:28:39.774412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86accc-5323-470a-8fea-6511f8576007 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:28:39.839716 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:28:39.840375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:28:39.840693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:28:39.840974 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:28:39.842949 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:28:39.900551 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:28:39.902341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:28:39.911522 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4255/8616] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:28:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:29:54.823712 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:29:54.825162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:29:54.903970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8be5-ed51-4736-a017-b603f5331f13 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:29:54.909117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:29:54.910041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:29:54.910333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:29:54.910620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:29:54.912385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:29:54.926636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:29:54.928208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:29:54.940255 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4362/8617] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:29:56.446937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:29:56.448365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:29:56.465032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abbd81-4bb8-47f0-afb0-3d2f1372a09a service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:29:56.470806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:29:56.471461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:29:56.471750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:29:56.472031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:29:56.473875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:29:56.487684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:29:56.489782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:29:56.501996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4256/8618] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:29:59.114569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:29:59.127552 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163dd3-b39e-451c-bee7-8e9eacb1ff8e service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:29:59.133306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:29:59.133935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:29:59.134221 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:29:59.134497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:29:59.136228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:29:59.149455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:29:59.151004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:29:59.163001 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4363/8619] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:29:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:02.898285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:02.899796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:02.964848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda847d6-2975-4bea-b72a-131eb8d659e8 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:02.968397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:02.969064 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:02.969345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:02.969619 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:02.971314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:03.032031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:03.033486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:03.052407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4257/8620] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:09.384141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:09.387291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:09.402515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f84e-8deb-4cbb-b6db-0739e28dda34 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:09.407397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:09.408348 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:09.408749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:09.409099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] PATH_INFO: `/v3/users/4cb67e8ec9b44d6f89640b4ccabd1987` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:09.410637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb67e8ec9b44d6f89640b4ccabd1987)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:09.412679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:09.464066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb67e8ec9b44d6f89640b4ccabd1987'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.471143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb67e8ec9b44d6f89640b4ccabd1987'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.472424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb67e8ec9b44d6f89640b4ccabd1987'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.473091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb67e8ec9b44d6f89640b4ccabd1987'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.480562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb67e8ec9b44d6f89640b4ccabd1987'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.498348 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4364/8621] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:30:09 2022] DELETE /identity/v3/users/4cb67e8ec9b44d6f89640b4ccabd1987 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:30:09.673622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:09.684853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7560fb2-dccc-4940-bcee-77abe39d7957 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:09.744581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:09.745451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:09.745740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:09.746019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] PATH_INFO: `/v3/projects/0ac7776ae2fb45cfa015c4056f0ab4a0` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:09.747197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac7776ae2fb45cfa015c4056f0ab4a0)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:09.749148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:09.793426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'request_id': 'req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.799375 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'request_id': 'req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.805153 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'request_id': 'req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.816980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] The token cache is being invalidate because project 0ac7776ae2fb45cfa015c4056f0ab4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:30:09.817209 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.818477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.820052 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4258/8622] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:30:09 2022] DELETE /identity/v3/projects/0ac7776ae2fb45cfa015c4056f0ab4a0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:30:09.824070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:09.825521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:09.838710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd2bdf-ea3c-4bcf-839e-c1fe25db58aa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:09.893469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:09.894336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:09.894621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:09.894901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] PATH_INFO: `/v3/users/f7869aeb89eb486c8d78cf4a7d1a6f85` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:09.896127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7869aeb89eb486c8d78cf4a7d1a6f85)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:09.898098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:09.946173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7869aeb89eb486c8d78cf4a7d1a6f85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.952715 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7869aeb89eb486c8d78cf4a7d1a6f85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.953333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7869aeb89eb486c8d78cf4a7d1a6f85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.953934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7869aeb89eb486c8d78cf4a7d1a6f85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.960615 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ad2ffdbc-19d2-4898-afbc-91c96f4638fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7869aeb89eb486c8d78cf4a7d1a6f85'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:09.977254 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4365/8623] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:30:09 2022] DELETE /identity/v3/users/f7869aeb89eb486c8d78cf4a7d1a6f85 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:30:10.153610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.155192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:10.171348 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae460-ab0c-4e49-b2f9-7d245b02dbaf admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.231631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.232418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.232746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.233021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] PATH_INFO: `/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.234193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24d54a3f4d64e24b23d5626d77e90dd)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.236082 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.281650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24d54a3f4d64e24b23d5626d77e90dd', 'request_id': 'req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:10.288882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24d54a3f4d64e24b23d5626d77e90dd', 'request_id': 'req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:10.294458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24d54a3f4d64e24b23d5626d77e90dd', 'request_id': 'req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:10.306938 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] The token cache is being invalidate because project f24d54a3f4d64e24b23d5626d77e90dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:30:10.307233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:10.307981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-2da513b9-ee9c-406d-b3c5-bf57c8ebfd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:30:10.309697 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4259/8624] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:30:10 2022] DELETE /identity/v3/projects/f24d54a3f4d64e24b23d5626d77e90dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:30:10.314914 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.315435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.315987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.338767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:10.339972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:10.396839 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4366/8625] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:30:10.405269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.405782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.406336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.425513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:10.426697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:10.434555 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4260/8626] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:30:10.438644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.448224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16749367-934d-47d8-8823-ade8dc7471b1 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.452815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.453522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.453809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.454084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.454799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:30:10.455112 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.456716 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.468882 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4367/8627] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:30:10.472973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.482829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3f27-b862-43d1-bf4b-1af838bcd59d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.487787 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.488432 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.488748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.489024 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.489793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.491684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.529633 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4261/8628] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:30:10 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:30:10.530805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.541429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b15a-90b3-4200-b48c-568b8fb92c5b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.594626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.595293 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.595587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.595847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.596626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.598549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.617941 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4368/8629] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:30:10 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:30:10.622197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.632834 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7cbae-2f26-49f5-bc2b-f7a7413cba6f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.637449 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.638110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.638395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.638676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.639422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.641067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.651292 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4262/8630] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:30:10.655153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.666136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54c57-4837-42db-a88d-0626039af862 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.671903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.672631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.672913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.673217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.673952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.675658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864aa8e-b04f-4fcf-9778-741a3eba4e08 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.687058 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4369/8631] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:30:10.691385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.703456 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c2d1-c3c3-41be-8b9e-687996f98b14 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.709074 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.709955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.710237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.710512 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] PATH_INFO: `/v3/projects/d612578d899f4a889190a04840ffa2a7/users/9390a098b4d846a2b7dd2dad99d00d76/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.725610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d612578d899f4a889190a04840ffa2a7, user_id=9390a098b4d846a2b7dd2dad99d00d76, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.728243 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.741038 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4263/8632] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:30:10 2022] PUT /identity/v3/projects/d612578d899f4a889190a04840ffa2a7/users/9390a098b4d846a2b7dd2dad99d00d76/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:30:10.745966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0cc-bc51-4c68-8ddf-c3610a75d066 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.746280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0cc-bc51-4c68-8ddf-c3610a75d066 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.746562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0cc-bc51-4c68-8ddf-c3610a75d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.764521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-815ed0cc-bc51-4c68-8ddf-c3610a75d066 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:10.765752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-815ed0cc-bc51-4c68-8ddf-c3610a75d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:10.821999 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4370/8633] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:30:10.831567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:10.833918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:10.891355 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d433c0-742b-4f25-922f-591980fc62b4 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:10.895080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:10.896373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:10.896692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:10.896996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:10.906115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:10.907570 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:10.917115 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4264/8634] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:15.005761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.006231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.006422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.055938 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:15.058317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:15.138826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4371/8635] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:30:15.143402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.155788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f440ac-e116-4404-8e50-2f5ae929daf7 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.165014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.165705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.165995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.166272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.166961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.169092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.203889 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4265/8636] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:30:15 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:30:15.208073 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.221168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038617-2ee9-4aeb-8a35-739fa26e552d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.282390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.283090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.283380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.283664 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.284372 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.287307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.312000 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4372/8637] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:30:15 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:30:15.315926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.327429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cadf0-0f62-4053-8f3d-4e78b20abf53 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.333903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.334868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.335407 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.335751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.336579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.338260 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.352096 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4266/8638] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:30:15.356656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.367362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a387d0c-1b90-43ef-a035-9ca9daba5226 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.372719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.373564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.373845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.374150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] PATH_INFO: `/v3/projects/05864c76c92c49a7a9cfea6070542475/users/626279b416714b30acaf6ef2a96a3547/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.391963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05864c76c92c49a7a9cfea6070542475, user_id=626279b416714b30acaf6ef2a96a3547, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.394704 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.411364 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4373/8639] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:30:15 2022] PUT /identity/v3/projects/05864c76c92c49a7a9cfea6070542475/users/626279b416714b30acaf6ef2a96a3547/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:30:15.415342 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.426352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900c74-393e-4769-a5b7-822e5d14b792 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.506065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.506797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.507084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.507371 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.508106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.509795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793dfae-5e80-4b6d-9cf9-96db87764079 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.519938 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4267/8640] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:30:15.525421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:15.545380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb6b0c-bb82-4089-a468-9c5fadd99406 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:15.550229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:15.551121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:15.551407 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:15.551685 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] PATH_INFO: `/v3/projects/05864c76c92c49a7a9cfea6070542475/users/626279b416714b30acaf6ef2a96a3547/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:15.553724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05864c76c92c49a7a9cfea6070542475, user_id=626279b416714b30acaf6ef2a96a3547, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:15.556361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:15.566931 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4374/8641] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:30:15 2022] PUT /identity/v3/projects/05864c76c92c49a7a9cfea6070542475/users/626279b416714b30acaf6ef2a96a3547/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:30:20.614326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1135-5486-4150-b004-05f7cd5f4f56 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:20.615376 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1135-5486-4150-b004-05f7cd5f4f56 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:20.615478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1135-5486-4150-b004-05f7cd5f4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:20.646748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1bfd1135-5486-4150-b004-05f7cd5f4f56 None None] MFA Rules not processed for user `626279b416714b30acaf6ef2a96a3547`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:20.649077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1bfd1135-5486-4150-b004-05f7cd5f4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:20.730258 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4268/8642] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:30:20.744553 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:20.747089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:20.834177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e2ab1-1dc4-4fab-aa7b-8256a232473f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:20.838110 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:20.838763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:20.839044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:20.839316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:20.897182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:20.898648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:20.908440 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4375/8643] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:25.812163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:25.812641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:25.812756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:25.830257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:25.831437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:25.838913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4269/8644] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:30:26.486456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:26.487892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:26.560356 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f441cc-774e-4219-988b-bb470dfb4f92 service glance] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:26.565436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:26.566086 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:26.566370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:26.566649 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:26.569076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:26.582491 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:26.584747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:26.596875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4376/8645] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:29.000528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:29.002768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:29.109444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6972d-3a83-4419-ab54-6ec747ddea43 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:29.115050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:29.116250 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:29.116574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:29.116855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:29.118681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:29.135101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:29.136946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ab4b6-bb91-470c-ae26-a3cc8e913a82 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:29.152060 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4270/8646] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:37.724067 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:30:37.739824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc876b-af40-450d-8e80-8195017fa49e service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:30:37.746126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:30:37.746791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:37.747066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:37.747345 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:37.749137 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:37.764519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:30:37.766298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6152-3c0d-4aee-a702-2228eaf3b080 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:30:37.779658 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4377/8647] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:30:48.298933 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:30:48.299479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:30:48.299581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:30:48.316979 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:30:48.318187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:30:48.325561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4271/8648] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:31:00.537646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465220-4904-4c27-b239-2a0ccfbec590 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:00.538134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465220-4904-4c27-b239-2a0ccfbec590 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:00.538235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465220-4904-4c27-b239-2a0ccfbec590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:00.593961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-58465220-4904-4c27-b239-2a0ccfbec590 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:31:00.595162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-58465220-4904-4c27-b239-2a0ccfbec590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:00.657112 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4378/8649] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:31:00.706271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:31:00.707679 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:00.797369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab3046-1ce4-4011-a0ca-e8c721b42313 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:31:00.802382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:31:00.803032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:00.803318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:00.803594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:00.812577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:31:00.814143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d8615-b2b9-42dd-8c99-72853a1b342d service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:31:00.822017 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4272/8650] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:02.087668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:02.088166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:02.088272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:02.105277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:31:02.106454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:02.113219 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4379/8651] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:31:54.204606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe311-7845-442b-ad7c-0a8996599fa3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:54.205087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe311-7845-442b-ad7c-0a8996599fa3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:54.205187 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe311-7845-442b-ad7c-0a8996599fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:54.223126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0b5fe311-7845-442b-ad7c-0a8996599fa3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:31:54.224318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0b5fe311-7845-442b-ad7c-0a8996599fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:54.231520 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4273/8652] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:31:54.243417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:31:54.257462 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24679b-6c6c-40e7-99d9-9a34a2ec3807 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:31:54.262861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:31:54.263500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:54.263786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:54.264064 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:54.271986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:31:54.273546 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:31:54.282115 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4380/8653] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:58.257327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:58.257801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:58.258022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:58.276759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:31:58.277973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:58.284913 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4274/8654] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:31:58.320402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:31:58.321824 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:58.401717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592cc5-21db-4073-8779-a162bc9f1c5d service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:31:58.405315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:31:58.405955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:58.406239 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:58.406516 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:58.408977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:58.425544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:31:58.426991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:31:58.441700 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4381/8655] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:31:58.733019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:31:58.790408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667db9a6-d673-4bdd-b197-55f0167d04b8 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:31:58.794722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:31:58.795388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:58.795675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:58.795957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:58.797811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:58.811065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:31:58.812537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:31:58.824558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4275/8656] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:31:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:31:59.263361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:31:59.264745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:59.278802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df16b-ed8c-489a-a52b-d5333c20bae8 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:31:59.282440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:31:59.283085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:31:59.283398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:31:59.283696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:31:59.285440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:31:59.304479 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:31:59.305965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:31:59.320989 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4382/8657] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:32:10.047878 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:32:10.059689 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70192b45-67ba-4fdb-aeae-c11909b458f6 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:32:10.063582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:32:10.064274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:32:10.064576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:32:10.064857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:32:10.074192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:32:10.075628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:32:10.084925 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4276/8658] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:32:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:32:12.007235 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:32:12.008705 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:32:12.041454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921502-4fad-4a36-b2ce-3ebf26b0e467 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:32:12.047640 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:32:12.048287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:32:12.048610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:32:12.048898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:32:12.050636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:32:12.065625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:32:12.067213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7cd36-f305-4a30-bb9a-7c6f9151dc6c service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:32:12.080518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4383/8659] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:32:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:33:04.507672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:33:04.529116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d322c-88ca-4293-b83a-11119d9ffe42 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:33:04.532799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:33:04.533448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:33:04.533735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:33:04.534022 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:33:04.535809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:33:04.569913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:33:04.571362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:33:04.581610 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4277/8660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:33:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:34:23.051961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d2cb-512f-4636-b07c-370962309403 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:34:23.052583 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d2cb-512f-4636-b07c-370962309403 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:34:23.052689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140d2cb-512f-4636-b07c-370962309403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:34:23.070197 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5140d2cb-512f-4636-b07c-370962309403 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:34:23.071421 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5140d2cb-512f-4636-b07c-370962309403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:34:23.092822 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4384/8661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:34:23.438005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:34:23.452860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d05e3-46bc-4630-bcb2-408c478e2f2d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:34:23.457937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:34:23.458618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:34:23.458929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:34:23.459208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:34:23.460997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:34:23.473314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:34:23.474732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:34:23.485475 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4278/8662] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:34:57.812166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140d2cb-512f-4636-b07c-370962309403 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:34:57.834825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140d2cb-512f-4636-b07c-370962309403 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:34:57.840987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:34:57.841648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:34:57.841940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:34:57.842223 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:34:57.844124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:34:57.869981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:34:57.871582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:34:57.884107 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4385/8663] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:34:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:34:59.457542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:34:59.459034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:34:59.480996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17fc6e-8761-42cc-9ede-eaafca7f02ac service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:34:59.487167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:34:59.488019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:34:59.488397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:34:59.488723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:34:59.490496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:34:59.506330 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:34:59.507909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5182ff-914f-4790-9dca-01123ff1d8ce service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:34:59.522362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4279/8664] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:34:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:36:28.293127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:36:28.294770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:36:28.309808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604277d5-49db-4e08-881f-877c13a95428 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:36:28.313414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64e876b0e0844090aa652c98af67ab8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:36:28.314047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:36:28.314330 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:36:28.314606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:36:28.323335 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:36:28.324893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:36:28.333548 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4386/8665] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:36:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:36:30.957269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:36:30.957847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:36:30.957847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:36:30.979829 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] MFA Rules not processed for user `9390a098b4d846a2b7dd2dad99d00d76`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:36:30.981048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:36:30.987914 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4280/8666] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:36:31.733364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:36:31.747224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e1331-9208-4bbb-ab1e-c5969529b7e3 service cinder] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:36:31.752260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:36:31.752942 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:36:31.753231 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:36:31.753508 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:36:31.764720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:36:31.766291 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:36:31.779709 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4387/8667] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:36:34.140364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:36:34.170700 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879b82d-1801-4357-a2c6-b1154f2a6160 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:36:34.176670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:36:34.177446 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:36:34.177802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:36:34.178155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:36:34.192669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:36:34.194421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:36:34.214470 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4281/8668] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:36:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:36:41.705276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:36:41.722395 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf830-e1ae-4468-8538-99e016a6ded6 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:36:41.727985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:36:41.729166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:36:41.729460 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:36:41.729736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:36:41.741161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:36:41.742760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:36:41.756890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4388/8669] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:36:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:38:07.160295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:38:07.172759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83faa7-7b4e-4bd6-953d-94ab41bbb1f9 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:38:07.176586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:38:07.177253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:38:07.177554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:38:07.178399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:38:07.187969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:38:07.189466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:38:07.199546 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4282/8670] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:38:38.592533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:38:38.607810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc2142-4ab7-46be-bba5-c6d4384f29c4 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:38:38.614422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:38:38.615081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:38:38.615371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:38:38.615655 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:38:38.628807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:38:38.630400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:38:38.644129 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4389/8671] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:38:38.774722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:38:38.785802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec364-4185-4404-beaa-306155ddb5d6 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:38:38.790156 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:38:38.790820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:38:38.791106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:38:38.791385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:38:38.805520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:38:38.806969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:38:38.821043 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4283/8672] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:38:40.015725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:38:40.027297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066e012-9bd5-4976-b1c5-3c2f28764b50 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:38:40.031090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:38:40.031858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:38:40.032173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:38:40.032550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:38:40.046322 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:38:40.047740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:38:40.061629 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4390/8673] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:21.682882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:21.693860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a6be2-9ea3-48a4-9bf1-8a1a0306e40d service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:21.698176 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:21.698875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:21.699161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:21.699441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:21.768651 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:21.770079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:21.779500 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4284/8674] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:28.311628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:28.323456 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f66f-0ea2-4e1f-89bc-577c9c1e0be0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:28.328284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:28.329198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:28.329489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:28.329772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] PATH_INFO: `/v3/users/9390a098b4d846a2b7dd2dad99d00d76` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:28.330971 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9390a098b4d846a2b7dd2dad99d00d76)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:28.333036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:28.381935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9390a098b4d846a2b7dd2dad99d00d76'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.390290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9390a098b4d846a2b7dd2dad99d00d76'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.391017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9390a098b4d846a2b7dd2dad99d00d76'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.392157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9390a098b4d846a2b7dd2dad99d00d76'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.400832 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9390a098b4d846a2b7dd2dad99d00d76'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.417945 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4391/8675] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:39:28 2022] DELETE /identity/v3/users/9390a098b4d846a2b7dd2dad99d00d76 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:28.600628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:28.610729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105ae4d-2fcd-4a3e-81dd-8a9918246c40 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:28.672761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:28.673630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:28.673916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:28.674197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] PATH_INFO: `/v3/projects/d612578d899f4a889190a04840ffa2a7` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:28.675475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d612578d899f4a889190a04840ffa2a7)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:28.677683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:28.723491 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd612578d899f4a889190a04840ffa2a7', 'request_id': 'req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.729918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd612578d899f4a889190a04840ffa2a7', 'request_id': 'req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.735623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd612578d899f4a889190a04840ffa2a7', 'request_id': 'req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.760504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] The token cache is being invalidate because project d612578d899f4a889190a04840ffa2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:39:28.760788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.761419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.762965 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4285/8676] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:39:28 2022] DELETE /identity/v3/projects/d612578d899f4a889190a04840ffa2a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:28.766932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:28.768429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:28.781752 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baaa816-d39d-4483-97a2-de6c54b6a940 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:28.837632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:28.838519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:28.838803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:28.839083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] PATH_INFO: `/v3/users/626279b416714b30acaf6ef2a96a3547` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:28.840312 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626279b416714b30acaf6ef2a96a3547)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:28.843668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:28.889917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626279b416714b30acaf6ef2a96a3547'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.897484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626279b416714b30acaf6ef2a96a3547'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.898078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626279b416714b30acaf6ef2a96a3547'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.898679 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626279b416714b30acaf6ef2a96a3547'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.905440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-da5c0ad2-02dc-40e2-a2b9-12ae5ed35549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626279b416714b30acaf6ef2a96a3547'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:28.922514 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4392/8677] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:39:28 2022] DELETE /identity/v3/users/626279b416714b30acaf6ef2a96a3547 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:29.088820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:29.090390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:29.103750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ba59e-e66d-4e75-a2d8-148e4d6e80f2 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:29.158888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:29.159756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:29.160043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:29.160326 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] PATH_INFO: `/v3/projects/05864c76c92c49a7a9cfea6070542475` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:29.161549 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05864c76c92c49a7a9cfea6070542475)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:29.163498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:29.207993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05864c76c92c49a7a9cfea6070542475', 'request_id': 'req-a97e5264-8277-4f32-8c78-f29d31d8386e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:29.214547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05864c76c92c49a7a9cfea6070542475', 'request_id': 'req-a97e5264-8277-4f32-8c78-f29d31d8386e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:29.219849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05864c76c92c49a7a9cfea6070542475', 'request_id': 'req-a97e5264-8277-4f32-8c78-f29d31d8386e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:29.232125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] The token cache is being invalidate because project 05864c76c92c49a7a9cfea6070542475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:39:29.232411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:29.233087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-a97e5264-8277-4f32-8c78-f29d31d8386e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:29.234620 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4286/8678] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:39:29 2022] DELETE /identity/v3/projects/05864c76c92c49a7a9cfea6070542475 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:38.953815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:38.954424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:38.954424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.009179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:39.010385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:39.066248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4393/8679] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:39.076934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.077509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.077509 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.095841 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:39.097061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:39.104834 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4287/8680] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:39.109966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.119543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1927-39a2-475b-98a6-838854022b7c None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.124163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.124846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.125133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.125413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.126121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:39:39.126429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.128052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.139079 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4394/8681] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:39:39.155311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.164316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b0cc-822e-47cf-b621-8c3f58993d01 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.169747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.170388 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.170697 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.170971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.171650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.173555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.197948 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4288/8682] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:39:39.202513 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.212762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea187a4a-28f9-44b0-9a5c-b881cbc59eea admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.265973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.266634 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.266916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.267193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.267875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.269805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.289427 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4395/8683] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:39:39.293338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.303670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac111ce-f7d4-42a9-bd87-650b7744d5ef admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.308579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.309341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.309629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.309899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.310617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.312199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.322467 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4289/8684] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:39:39.326926 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.336751 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34775681-bca4-4345-88ff-753630e29c9e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.342017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.342670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.342955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.343232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.343952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.345573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cfc90-19a5-4499-ab6b-f83073534a04 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.355424 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4396/8685] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:39:39.359398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.369124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c07050-f600-4fa9-94d5-6612a91437fb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.373715 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.374585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.374869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.375142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] PATH_INFO: `/v3/projects/418951f01874458e878a1db4c046e79f/users/93772fc5e1f1440e9e1134c492ba9a16/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.389803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418951f01874458e878a1db4c046e79f, user_id=93772fc5e1f1440e9e1134c492ba9a16, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.392535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.406565 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4290/8686] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:39:39 2022] PUT /identity/v3/projects/418951f01874458e878a1db4c046e79f/users/93772fc5e1f1440e9e1134c492ba9a16/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:39.422230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.422529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.422866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.454021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] MFA Rules not processed for user `93772fc5e1f1440e9e1134c492ba9a16`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:39.456420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:39.526663 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4397/8687] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:39.531755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.593044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee482-6815-4304-9270-50b5540e7205 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.597744 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.598405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.598721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.598999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.599685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.601623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.626289 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4291/8688] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:39:39.630361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.641631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc50f3f-bd68-4326-8b3b-06af08ea13ac None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.695480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.696145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.696435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.696754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.697444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.699361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.721409 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4398/8689] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:39:39.722565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.733035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c0e6-3b59-4aae-85dd-2a8fccf429a7 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.737984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.738650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.738934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.739216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.739937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.741565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.753833 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4292/8690] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:39:39.757902 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.768385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5cfa4-5dea-4403-9bb2-303cf12763a7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.773121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.774001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.774283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.774559 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] PATH_INFO: `/v3/projects/6c6ddf25a4ea467abc05869d42055282/users/acfcfa1246b347e983e7a78786b705e2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.788940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6ddf25a4ea467abc05869d42055282, user_id=acfcfa1246b347e983e7a78786b705e2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.791684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.803977 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4399/8691] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:39:39 2022] PUT /identity/v3/projects/6c6ddf25a4ea467abc05869d42055282/users/acfcfa1246b347e983e7a78786b705e2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:39:39.807954 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.818341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6e4d-b885-4d58-87a8-5a811e6b624d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.873316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.873976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.874264 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.874543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.875253 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.876946 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3b13b-869c-4558-9dda-42ce9a5990bb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.886545 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4293/8692] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:39:39.890801 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:39.901127 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb0095-6d28-4983-942a-df33628c6d0e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:39.906373 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:39.907250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.907535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.907810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] PATH_INFO: `/v3/projects/6c6ddf25a4ea467abc05869d42055282/users/acfcfa1246b347e983e7a78786b705e2/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.909827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6ddf25a4ea467abc05869d42055282, user_id=acfcfa1246b347e983e7a78786b705e2, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:39.912440 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3405c-3c3a-47c4-9a78-2597c078a48a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:39.925856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4400/8693] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:39:39 2022] PUT /identity/v3/projects/6c6ddf25a4ea467abc05869d42055282/users/acfcfa1246b347e983e7a78786b705e2/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:39.938628 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:39.938927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:39.939206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:39.968188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] MFA Rules not processed for user `acfcfa1246b347e983e7a78786b705e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:39.969919 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:40.044954 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4294/8694] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:40.058093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:40.058621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:40.058621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:40.076707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] MFA Rules not processed for user `93772fc5e1f1440e9e1134c492ba9a16`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:40.077893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:40.130555 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4401/8695] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:40.142964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:40.144368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:40.229271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a118-70cc-4296-9b52-89f38babea19 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:40.234781 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:40.235419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:40.235702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:40.235975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:40.243525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:40.245136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152ebb-e4d7-468d-a525-68782b738c31 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:40.253858 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4295/8696] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:54.191292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:54.192925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:54.211694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be65a-a5af-4af0-9c35-fd81fd67046a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:54.217266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:54.217907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.218220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.218503 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.226537 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:54.228113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:54.237884 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4402/8697] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:54.252042 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3541-c65f-4827-a87a-40a6a8e6080d None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.252441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3541-c65f-4827-a87a-40a6a8e6080d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.252655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3541-c65f-4827-a87a-40a6a8e6080d None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.254430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4296/8698] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:39:54.258907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:39:54.272141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:54.280134 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e997d-989d-428b-aed7-15d8c5bc3748 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:54.284754 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acfcfa1246b347e983e7a78786b705e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c6ddf25a4ea467abc05869d42055282', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:54.285589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.285878 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.286170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] PATH_INFO: `/v3/projects/6c6ddf25a4ea467abc05869d42055282` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.287371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c6ddf25a4ea467abc05869d42055282)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:54.289180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:54.291124 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4403/8699] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:39:54 2022] GET /identity/v3/projects/6c6ddf25a4ea467abc05869d42055282 => generated 391 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:39:54.437188 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374932f8-750c-455f-bbc8-74fa79a771a5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.437476 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374932f8-750c-455f-bbc8-74fa79a771a5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.437784 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374932f8-750c-455f-bbc8-74fa79a771a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.473884 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-374932f8-750c-455f-bbc8-74fa79a771a5 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:54.475105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-374932f8-750c-455f-bbc8-74fa79a771a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:54.525721 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4297/8700] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Apr 2 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:54.531601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:54.541135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d471-fae9-47ec-afed-19b4991c0e6f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:54.545475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:54.546107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.546397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.546680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.548435 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:54.560689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:54.562113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:54.572205 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4404/8701] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:54.721438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890f66-a424-4189-8b6f-763776e572b1 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.721733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890f66-a424-4189-8b6f-763776e572b1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.722043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890f66-a424-4189-8b6f-763776e572b1 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.723836 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4298/8702] 10.222.0.18 () {54 vars in 912 bytes} [Sat Apr 2 21:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:39:54.728529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] Authenticating service token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 02 21:39:54.744739 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:54.753969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750b467-1355-4d9a-aea9-4460b7f6db9b service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:54.759016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acfcfa1246b347e983e7a78786b705e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c6ddf25a4ea467abc05869d42055282', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:54.760044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.760370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.760687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] PATH_INFO: `/v3/projects/6c6ddf25a4ea467abc05869d42055282` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.761912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c6ddf25a4ea467abc05869d42055282)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:54.763733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:54.765521 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4405/8703] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Apr 2 21:39:54 2022] GET /identity/v3/projects/6c6ddf25a4ea467abc05869d42055282 => generated 391 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:39:54.911935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.912251 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.912556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.931658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:54.932899 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:54.939379 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4299/8704] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Apr 2 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:54.945123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:54.955240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be60c7-fd00-4ec9-9b82-cd766af595e8 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:54.958916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:54.959549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:54.959841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:54.960122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:54.961951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:54.974563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:54.975961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:54.985980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4406/8705] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:57.528135 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:57.529553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:57.618428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bfa3c-38ba-4b56-bde0-8f572af32e8f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:57.623745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c408564-8f23-45ae-a070-923234766fae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:57.624492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c408564-8f23-45ae-a070-923234766fae service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:57.624757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c408564-8f23-45ae-a070-923234766fae service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:57.625043 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c408564-8f23-45ae-a070-923234766fae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:57.626872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7c408564-8f23-45ae-a070-923234766fae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:57.641161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c408564-8f23-45ae-a070-923234766fae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:57.642750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c408564-8f23-45ae-a070-923234766fae service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:57.655871 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4300/8706] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:58.720912 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:58.781696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df9c1-df7b-4e01-8c60-d2fdbea4e142 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:58.786194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:58.787054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:58.787333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:58.787606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] PATH_INFO: `/v3/users/93772fc5e1f1440e9e1134c492ba9a16` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:58.788884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93772fc5e1f1440e9e1134c492ba9a16)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:58.790786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:58.836864 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93772fc5e1f1440e9e1134c492ba9a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:58.844333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93772fc5e1f1440e9e1134c492ba9a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:58.845009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93772fc5e1f1440e9e1134c492ba9a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:58.845641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93772fc5e1f1440e9e1134c492ba9a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:58.852702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93772fc5e1f1440e9e1134c492ba9a16'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:58.869802 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4407/8707] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:39:58 2022] DELETE /identity/v3/users/93772fc5e1f1440e9e1134c492ba9a16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:58.874971 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:58.875422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:58.875569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:58.892766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:58.893987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:58.951134 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4301/8708] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:58.960737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:58.962161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:59.016063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e11baf-ba0c-4384-bdb8-1b5cc48a9d65 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:59.019694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:59.020338 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.020654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.020934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.029845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:59.031267 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:59.040556 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4408/8709] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:39:59.206105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:59.207544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:59.219853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e7cb9-de0b-467b-afd3-091037d30c5b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:59.224900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:59.225769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.226058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.226341 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] PATH_INFO: `/v3/projects/418951f01874458e878a1db4c046e79f` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.227563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418951f01874458e878a1db4c046e79f)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:59.229584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:59.274764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418951f01874458e878a1db4c046e79f', 'request_id': 'req-cd6f8399-fb84-46b6-82fa-bd3affb13e81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.281150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418951f01874458e878a1db4c046e79f', 'request_id': 'req-cd6f8399-fb84-46b6-82fa-bd3affb13e81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.286433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418951f01874458e878a1db4c046e79f', 'request_id': 'req-cd6f8399-fb84-46b6-82fa-bd3affb13e81'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.298980 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] The token cache is being invalidate because project 418951f01874458e878a1db4c046e79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:39:59.299275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.299906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.301566 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4302/8710] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:39:59 2022] DELETE /identity/v3/projects/418951f01874458e878a1db4c046e79f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:59.305675 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:59.315256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0a1e-7c0a-4427-8fc3-a25e8f974a8d service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:59.369107 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:59.369973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.370259 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.370540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] PATH_INFO: `/v3/users/acfcfa1246b347e983e7a78786b705e2` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.371725 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfcfa1246b347e983e7a78786b705e2)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:59.373678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:59.416214 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfcfa1246b347e983e7a78786b705e2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.423976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfcfa1246b347e983e7a78786b705e2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.424665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfcfa1246b347e983e7a78786b705e2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.425303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfcfa1246b347e983e7a78786b705e2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.431960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-8dc344cb-ef43-4b69-8fe7-ba08053edcd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfcfa1246b347e983e7a78786b705e2'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.448358 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4409/8711] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:39:59 2022] DELETE /identity/v3/users/acfcfa1246b347e983e7a78786b705e2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:59.716177 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:39:59.717682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:59.731103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f8399-fb84-46b6-82fa-bd3affb13e81 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:39:59.789180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:39:59.790021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.790305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.790580 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] PATH_INFO: `/v3/projects/6c6ddf25a4ea467abc05869d42055282` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.791746 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6ddf25a4ea467abc05869d42055282)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:39:59.793662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:39:59.838926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6ddf25a4ea467abc05869d42055282', 'request_id': 'req-aefe4361-8802-4e8c-99a9-fc1538730e52'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.845501 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6ddf25a4ea467abc05869d42055282', 'request_id': 'req-aefe4361-8802-4e8c-99a9-fc1538730e52'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.850957 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6ddf25a4ea467abc05869d42055282', 'request_id': 'req-aefe4361-8802-4e8c-99a9-fc1538730e52'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.863017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] The token cache is being invalidate because project 6c6ddf25a4ea467abc05869d42055282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:39:59.863305 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.863961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-aefe4361-8802-4e8c-99a9-fc1538730e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:39:59.865572 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4303/8712] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:39:59 2022] DELETE /identity/v3/projects/6c6ddf25a4ea467abc05869d42055282 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:39:59.871935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.872427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.872601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.890374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:59.891601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:59.950674 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4410/8713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:59.959033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:39:59.959513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:39:59.959640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:39:59.977990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:39:59.979186 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:39:59.987141 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4304/8714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:39:59.991464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.001656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69159-e213-4b9d-a686-fb6ece4e4650 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.006531 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.007179 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.007463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.007740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.008476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:40:00.008807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.010411 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.022217 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4411/8715] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:40:00.026596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.036556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761c987-2278-4715-ba9e-7c698a86e342 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.041567 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.042231 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.042520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.042801 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.043662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.045888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.071333 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4305/8716] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:40:00 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:40:00.076153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.085935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ef393-75b1-4beb-8449-dce12eed52ab admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.139736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.140320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.140633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.140908 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.141571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.143461 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.162498 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4412/8717] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:40:00 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:40:00.166994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.178045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe756-3284-4b5c-94be-6e20d2c3650b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.183193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.184473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.184778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.185057 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.188751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.188751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.203746 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4306/8718] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:40:00.205152 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.215228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3115-37d6-400e-af76-c13cc5ba6c67 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.219810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.220485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.220774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.221051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.221820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.223414 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061146-6bd9-4059-ac9d-3dd3ec8d2dc1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.233550 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4413/8719] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:40:00.237694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.248346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fa41-07a9-405a-9622-ac8160e381a1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.253051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.253927 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.254211 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.254490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] PATH_INFO: `/v3/projects/efe9ec8143784104a9a9b2ecd97615da/users/583f2e33282f483e9b97db0ac6e42226/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.268607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe9ec8143784104a9a9b2ecd97615da, user_id=583f2e33282f483e9b97db0ac6e42226, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.271237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.283911 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4307/8720] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:40:00 2022] PUT /identity/v3/projects/efe9ec8143784104a9a9b2ecd97615da/users/583f2e33282f483e9b97db0ac6e42226/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:40:00.288969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cc1b-643e-40bc-92dc-e88e527f0ff2 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.289346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cc1b-643e-40bc-92dc-e88e527f0ff2 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.289633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cc1b-643e-40bc-92dc-e88e527f0ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.308299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8cd7cc1b-643e-40bc-92dc-e88e527f0ff2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:00.310170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8cd7cc1b-643e-40bc-92dc-e88e527f0ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:00.368935 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4414/8721] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:00.379090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:00.380843 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:00.436115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d144-723c-4023-a424-30d08af8125c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:00.439846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:00.440523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:00.440812 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:00.441089 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:00.450430 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:00.451860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1903c8d-9be3-4ed7-9f57-d34d2cf4787e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:00.461570 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4308/8722] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:01.036825 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:01.037341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:01.037451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:01.062786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] MFA Rules not processed for user `583f2e33282f483e9b97db0ac6e42226`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:01.063985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:01.134729 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4415/8723] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:01.146909 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:01.147445 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:01.147542 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:01.165106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] MFA Rules not processed for user `583f2e33282f483e9b97db0ac6e42226`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:01.166321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:01.173874 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4309/8724] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:01.186066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:01.188308 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:01.264560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22296a9-4b05-4f64-94e4-a81284350573 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:01.269943 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:01.270586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:01.270869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:01.271143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:01.278665 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:01.280254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:01.288799 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4416/8725] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:40:05.461606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:05.463000 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:05.534892 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be886679-de42-4cd0-8c1d-a2b2875da5bc None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:05.539745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:05.540398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:05.540706 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:05.540981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:05.542751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:05.556391 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:05.558040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125595e3-2e01-4092-a2f4-2917b8e91441 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:05.570181 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4310/8726] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:11.336814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:11.338227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:11.361951 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec46e19-e9c8-4c9d-9918-21377a240617 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:11.365656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:11.366303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:11.366592 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:11.366877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:11.368680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:11.381276 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:11.382724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1580c-f148-4294-8886-dbfab9c1779e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:11.393719 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4417/8727] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:11.488728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859519-645b-4d8f-86a8-d14acd766890 None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:11.489317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859519-645b-4d8f-86a8-d14acd766890 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:11.489317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33859519-645b-4d8f-86a8-d14acd766890 None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:11.491136 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4311/8728] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:40:11.496194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:11.496562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:11.496848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:11.532666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:11.533859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:11.542529 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4418/8729] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:11.564040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859519-645b-4d8f-86a8-d14acd766890 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:11.579984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33859519-645b-4d8f-86a8-d14acd766890 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:11.585050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:11.585687 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:11.585976 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:11.586254 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:11.594488 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:11.596046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:11.605665 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4312/8730] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:11.758957 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:11.768229 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b823-0d04-4015-9bbf-094a4c404860 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:11.771840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:11.772507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:11.772799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:11.773080 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:11.774857 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:11.790247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:11.791680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:11.805575 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4419/8731] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:53.257613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:53.279114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7777-7f8d-41eb-a4e8-58ad7eae53e8 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:53.284213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:53.285235 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.285523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.285782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] PATH_INFO: `/v3/users/583f2e33282f483e9b97db0ac6e42226` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.286969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583f2e33282f483e9b97db0ac6e42226)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:53.288903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:53.335888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583f2e33282f483e9b97db0ac6e42226'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.348384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583f2e33282f483e9b97db0ac6e42226'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.349092 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583f2e33282f483e9b97db0ac6e42226'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.356639 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583f2e33282f483e9b97db0ac6e42226'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.364473 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-fab68dcb-9595-45d1-b0e5-dda932f63138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583f2e33282f483e9b97db0ac6e42226'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.370426 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4313/8732] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:40:53 2022] DELETE /identity/v3/users/583f2e33282f483e9b97db0ac6e42226 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:40:53.545091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:53.556002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da1ffa-2cd3-4187-90d1-f3dc6ad8ce68 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:53.616972 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:53.617847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.618159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.618436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] PATH_INFO: `/v3/projects/efe9ec8143784104a9a9b2ecd97615da` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.619637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe9ec8143784104a9a9b2ecd97615da)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:53.621647 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:53.668385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe9ec8143784104a9a9b2ecd97615da', 'request_id': 'req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.675061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe9ec8143784104a9a9b2ecd97615da', 'request_id': 'req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.681955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe9ec8143784104a9a9b2ecd97615da', 'request_id': 'req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.693666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] The token cache is being invalidate because project efe9ec8143784104a9a9b2ecd97615da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:40:53.693953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.694607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d21d0cd3-6878-4547-a0b6-11bdd22adfa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:40:53.696160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4420/8733] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:40:53 2022] DELETE /identity/v3/projects/efe9ec8143784104a9a9b2ecd97615da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:40:53.701968 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.702285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.702557 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.722381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:53.723600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:53.784882 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4314/8734] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:53.792600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.792839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.793155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.812075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:53.813309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:53.821255 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4421/8735] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:53.825464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:53.835335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56d2d7-1ff8-4d58-9c6e-d7e0557e4061 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:53.839883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:53.840575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.840864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.841147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.842461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:40:53.842691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:53.844283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:53.855578 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4315/8736] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:40:53.860415 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:53.869579 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6af7f-f084-469b-9abe-e07b27279569 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:53.874236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:53.874882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.875169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.875453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.876135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:53.878045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:53.911718 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4422/8737] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:40:53 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:40:53.915823 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:53.926654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb11979-ff97-4b86-9921-21f3c56ec80f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:53.981587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:53.982278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:53.983336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:53.983815 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:53.984898 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:53.986951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:54.008832 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4316/8738] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:40:53 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:40:54.010015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:54.020238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1467a92-0316-402c-b668-874666a4cbac admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:54.024791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:54.025441 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.025723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.025999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.026710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:54.028341 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:54.038291 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4423/8739] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:40:54.041910 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:54.052758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037dc9-fdbd-433c-a615-2ed89e50d732 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:54.057370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:54.058019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.058304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.058581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.059323 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:54.060966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4dbf-5f0c-4a6c-a2a5-0a482a09d407 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:54.070683 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4317/8740] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:40:54.074726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:54.084574 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb32d61-31d6-41a5-8099-ef8dc5459abd admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:54.089172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:54.090036 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.090317 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.090591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] PATH_INFO: `/v3/projects/eec749d6a2ca48f7b17c3d2aaa3f5c67/users/036baf67847140d8842f877f1e42ea32/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.104953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec749d6a2ca48f7b17c3d2aaa3f5c67, user_id=036baf67847140d8842f877f1e42ea32, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:54.108145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:54.121165 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4424/8741] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:40:54 2022] PUT /identity/v3/projects/eec749d6a2ca48f7b17c3d2aaa3f5c67/users/036baf67847140d8842f877f1e42ea32/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:40:54.126346 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb084-ba95-4734-aa8e-7fedb8311a42 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.126664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb084-ba95-4734-aa8e-7fedb8311a42 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.126948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb084-ba95-4734-aa8e-7fedb8311a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.144917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-8f2fb084-ba95-4734-aa8e-7fedb8311a42 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:54.146099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8f2fb084-ba95-4734-aa8e-7fedb8311a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:54.204549 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4318/8742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:40:54.214243 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:54.215934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:54.272388 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deca13-17c7-4b41-95d3-85e8fe426433 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:54.276114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:54.276784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.277070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.277347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.287206 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:54.288700 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e71df-a89e-4fb2-b74e-2e8e3439ec5e service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:54.298449 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4425/8743] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:54.871587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.872124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.872228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.899719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] MFA Rules not processed for user `036baf67847140d8842f877f1e42ea32`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:54.901104 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:54.965233 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4319/8744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:54.975626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6d16-f665-418e-86c5-eb99b02b2c0a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:54.976165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6d16-f665-418e-86c5-eb99b02b2c0a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:54.976292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc6d16-f665-418e-86c5-eb99b02b2c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:54.993614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-27dc6d16-f665-418e-86c5-eb99b02b2c0a None None] MFA Rules not processed for user `036baf67847140d8842f877f1e42ea32`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:54.994828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-27dc6d16-f665-418e-86c5-eb99b02b2c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:55.002869 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4426/8745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:40:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:55.014955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:55.017011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:55.100050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb80fdf-0efb-47d3-926f-6d3cb96be486 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:55.105588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:55.106240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:55.106534 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:55.106814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:55.115538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:55.117165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:55.126713 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4320/8746] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:40:55.966631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39540897-5466-412f-a3d0-337ec27de2be None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:55.966994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39540897-5466-412f-a3d0-337ec27de2be None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:55.967275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39540897-5466-412f-a3d0-337ec27de2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:55.986084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-39540897-5466-412f-a3d0-337ec27de2be None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:40:55.987289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-39540897-5466-412f-a3d0-337ec27de2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:56.050615 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4427/8747] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:40:56.061947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:40:56.063360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:40:56.080034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca935-cea1-4139-87aa-02a4c15eb584 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:40:56.085103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:40:56.085747 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:40:56.086035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:40:56.086316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:40:56.095054 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:40:56.096660 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c02be-7767-45c1-823c-207a97c301ba service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:40:56.106310 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4321/8748] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:40:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:41:07.789254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:07.789877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:07.789877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:07.791681 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4428/8749] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:41:07.797583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a948-5d42-4790-a73f-1797c6ff9519 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:07.798037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a948-5d42-4790-a73f-1797c6ff9519 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:07.798141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214a948-5d42-4790-a73f-1797c6ff9519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:07.827129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-2214a948-5d42-4790-a73f-1797c6ff9519 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:41:07.828373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-2214a948-5d42-4790-a73f-1797c6ff9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:07.837198 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4322/8750] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:41:07.857949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:41:07.859688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:07.878493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16ff38-466b-4256-b525-1032cb618af4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:41:07.884089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:41:07.884778 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:07.885068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:07.885349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:07.894420 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:41:07.895986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:41:07.906010 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4429/8751] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:41:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:41:08.110060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3657d8-de5c-4240-aaea-3911a359e853 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:08.110354 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3657d8-de5c-4240-aaea-3911a359e853 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:08.110636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3657d8-de5c-4240-aaea-3911a359e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:08.128872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-cd3657d8-de5c-4240-aaea-3911a359e853 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:41:08.130062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-cd3657d8-de5c-4240-aaea-3911a359e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:08.139250 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4323/8752] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:41:08.150285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:41:08.162964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804ff85-f093-4fda-b37f-3cacf67bd8df service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:41:08.167940 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:41:08.168635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:08.168920 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:08.169463 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:08.177865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:41:08.179424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:41:08.189590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4430/8753] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:41:41.327701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:41.328278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:41.328278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:41.346244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] MFA Rules not processed for user `036baf67847140d8842f877f1e42ea32`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:41:41.347562 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:41.355287 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4324/8754] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:41:43.106892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:41:43.109091 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:43.128670 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165be8-9d79-4a8f-806b-3d8e9a802839 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:41:43.135177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:41:43.135922 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:43.136492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:43.136841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:43.140811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:43.157919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:41:43.159800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97287d-8917-44a1-b43e-491373ea140e service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:41:43.174211 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4431/8755] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:41:43.683929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:41:43.706598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1873c4b-e4e2-43ae-afa8-7faf8d6ab52d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:41:43.714037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:41:43.715729 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:43.716662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:43.717607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:43.720694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:43.744271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:41:43.747444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de72d-cd8b-4b76-849c-940e6e0824b1 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:41:43.765229 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4325/8756] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:41:54.191735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa669b1-b281-469d-9712-8fb871395b2d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:54.192298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa669b1-b281-469d-9712-8fb871395b2d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:54.192298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa669b1-b281-469d-9712-8fb871395b2d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:54.194288 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4432/8757] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:41:54.199472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:54.199950 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:54.200060 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:54.219738 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:41:54.221278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:41:54.232387 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4326/8758] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:41:54.252207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa669b1-b281-469d-9712-8fb871395b2d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:41:54.268965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa669b1-b281-469d-9712-8fb871395b2d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:41:54.273966 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:41:54.274607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:41:54.274909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:41:54.275169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:41:54.284852 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:41:54.286439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:41:54.296590 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4433/8759] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:42:31.094782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.105464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59513-869d-4f27-be86-92304a4e28a4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.110126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.111055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.111255 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.111524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] PATH_INFO: `/v3/users/036baf67847140d8842f877f1e42ea32` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.112758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036baf67847140d8842f877f1e42ea32)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.114667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.159193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036baf67847140d8842f877f1e42ea32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.170650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036baf67847140d8842f877f1e42ea32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.171319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036baf67847140d8842f877f1e42ea32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.178122 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036baf67847140d8842f877f1e42ea32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.184876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-c39096ed-f2e3-42b8-b689-c5fa384a2157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036baf67847140d8842f877f1e42ea32'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.190594 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4327/8760] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:42:31 2022] DELETE /identity/v3/users/036baf67847140d8842f877f1e42ea32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:42:31.363550 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.376644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4807e3-cae4-44dc-8cb9-b78c7940d532 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.432969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.433859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.434119 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.434398 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] PATH_INFO: `/v3/projects/eec749d6a2ca48f7b17c3d2aaa3f5c67` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.436108 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec749d6a2ca48f7b17c3d2aaa3f5c67)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.438031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.483602 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'request_id': 'req-c8cbc898-2427-46fa-8468-fef90de2c21d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.490224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'request_id': 'req-c8cbc898-2427-46fa-8468-fef90de2c21d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.498300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'request_id': 'req-c8cbc898-2427-46fa-8468-fef90de2c21d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.508557 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] The token cache is being invalidate because project eec749d6a2ca48f7b17c3d2aaa3f5c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:42:31.508849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.509490 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-c8cbc898-2427-46fa-8468-fef90de2c21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:42:31.511034 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4434/8761] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:42:31 2022] DELETE /identity/v3/projects/eec749d6a2ca48f7b17c3d2aaa3f5c67 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:42:31.517017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.517308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.517584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.535309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:31.536533 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:31.593467 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4328/8762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:31.601489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.601784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.602066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.620597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:31.621805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:31.630384 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4435/8763] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:31.634513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.644732 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796ad0-f34b-4f37-b5f7-b03c2208f8db None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.649311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.649961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.650248 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.650527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] PATH_INFO: `/v3/domains` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.651245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:42:31.651554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.653232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.665145 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4329/8764] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 02 21:42:31.669578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.678770 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669d68-0762-432c-9069-47bca4c7ff0f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.683436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.684084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.684371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.684721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] PATH_INFO: `/v3/projects` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.685408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.687306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.712021 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4436/8765] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:42:31 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:42:31.716661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.726951 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792366-e981-4b99-855a-235ba85e99db admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.780809 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.781381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.781666 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.781941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] PATH_INFO: `/v3/users` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.782621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.784545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.804163 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4330/8766] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:42:31 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:42:31.808386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.819070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fb277-c602-4784-b200-c8476ac13116 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.823678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.824331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.824645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.824921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.825662 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.827241 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.837274 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4437/8767] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:42:31.841384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.851524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10561ab7-5a19-4772-9d6d-2f0f021f873e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.856132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.857336 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.857623 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.857929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.858647 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.860233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a51bff-facb-4d87-92f1-fcd487e95a30 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.869929 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4331/8768] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:42:31.874519 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:31.884401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fa0b-08d9-4d8d-92bf-a06690b9ba55 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:31.889861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:31.890744 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.891033 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.891316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] PATH_INFO: `/v3/projects/5f212cc8d96745d2aa089c88769ffc87/users/baf3a527e28d43388872b4dba718d940/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.907391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f212cc8d96745d2aa089c88769ffc87, user_id=baf3a527e28d43388872b4dba718d940, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:31.910149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:31.922891 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4438/8769] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:42:31 2022] PUT /identity/v3/projects/5f212cc8d96745d2aa089c88769ffc87/users/baf3a527e28d43388872b4dba718d940/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:42:31.927904 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fed23-30ab-42be-a68f-452d5de38ed9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:31.928198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fed23-30ab-42be-a68f-452d5de38ed9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:31.928497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fed23-30ab-42be-a68f-452d5de38ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:31.947225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7a4fed23-30ab-42be-a68f-452d5de38ed9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:31.948426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7a4fed23-30ab-42be-a68f-452d5de38ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:32.006430 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4332/8770] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:32.016585 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:32.018272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:32.082198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c53a7d-2059-4975-94a2-a7a6a07ad0a3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:32.085803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:32.086439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:32.086726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:32.087005 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:32.095893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:32.097352 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:32.106851 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4439/8771] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:42:35.949221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df7678-a40b-4aec-9113-cfaf4d4e1de1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:35.949788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df7678-a40b-4aec-9113-cfaf4d4e1de1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:35.949788 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df7678-a40b-4aec-9113-cfaf4d4e1de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:35.978574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e2df7678-a40b-4aec-9113-cfaf4d4e1de1 None None] MFA Rules not processed for user `baf3a527e28d43388872b4dba718d940`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:35.979926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e2df7678-a40b-4aec-9113-cfaf4d4e1de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:36.050829 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4333/8772] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:36.063354 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:36.064840 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:36.142594 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af9341-4d33-42f8-b1d1-69659f02abf0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:36.148774 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:36.149447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:36.149733 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:36.150014 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:36.159085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:36.160720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe36c-ba51-4111-b8c2-68ce72492425 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:36.170175 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4440/8773] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:42:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:42:37.845837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89622a5-6121-42ca-b891-aa902334d78c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:37.846382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89622a5-6121-42ca-b891-aa902334d78c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:37.846486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89622a5-6121-42ca-b891-aa902334d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:37.866178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a89622a5-6121-42ca-b891-aa902334d78c None None] MFA Rules not processed for user `baf3a527e28d43388872b4dba718d940`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:37.867378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a89622a5-6121-42ca-b891-aa902334d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:37.880938 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4334/8774] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:52.299854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:52.300500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:52.300500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:52.302248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4441/8775] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:42:52.307179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:52.307688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:52.307996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:52.327422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:42:52.328603 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:52.390037 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4335/8776] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:42:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:42:52.409929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:42:52.411622 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:42:52.431434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bedebf-806e-4062-934f-ac756152ee1a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:42:52.436981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:42:52.437613 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:42:52.437895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:42:52.438172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:42:52.446639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:42:52.448210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441fc39-0257-4771-bdce-f0cbf2d20f92 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:42:52.459953 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4442/8777] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:42:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:43:11.533574 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:43:11.535079 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:11.577750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc7f2d-10eb-4e32-97e0-46978f55d7a3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:43:11.581435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:43:11.582083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:43:11.582370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:43:11.582652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:43:11.584410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:11.596748 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:43:11.598170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:43:11.608945 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4336/8778] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:43:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:43:30.001389 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:43:30.001911 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:43:30.002015 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:43:30.019488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] MFA Rules not processed for user `baf3a527e28d43388872b4dba718d940`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:43:30.020701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:30.027488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4443/8779] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:43:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:43:38.763380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:43:38.772067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976958b-9d9d-47d9-aa57-073a7cc10000 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:43:38.775674 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:43:38.776308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:43:38.776627 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:43:38.776905 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:43:38.779197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:38.796597 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:43:38.798192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:43:38.811962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4337/8780] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:43:41.463791 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:43:41.473844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81408d-5e63-4409-8e1a-834601388aa3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:43:41.477410 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:43:41.478042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:43:41.478327 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:43:41.478600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:43:41.480324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:41.496277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:43:41.498480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad602f-6af6-4504-9bd5-45e672289945 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:43:41.511654 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4444/8781] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:43:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:43:42.684471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:43:42.685959 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:42.702763 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23df1-5ccd-464d-9020-b82dedbfae9a service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:43:42.708741 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:43:42.709461 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:43:42.709877 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:43:42.710169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:43:42.711982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:43:42.727526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:43:42.729155 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d1d74-15b3-416e-b024-c79bc5d91fb5 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:43:42.744483 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4338/8782] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:43:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:44:09.339952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:09.340577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:09.340577 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:09.342916 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4445/8783] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:44:09.347894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708063-0945-47e5-8e26-599a9323a6e3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:09.348345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708063-0945-47e5-8e26-599a9323a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:09.348622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708063-0945-47e5-8e26-599a9323a6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:09.368267 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-aa708063-0945-47e5-8e26-599a9323a6e3 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:44:09.369571 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa708063-0945-47e5-8e26-599a9323a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:44:09.379443 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4339/8784] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:44:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:44:09.399257 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:44:09.401200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:44:09.421698 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bde70-b8a0-431f-b8ed-0869c8c76ad6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:44:09.427144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:44:09.427788 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:09.428076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:09.428357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:09.436836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:44:09.438363 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af88d75-beac-43d8-808c-d19004551276 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:44:09.448535 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4446/8785] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:44:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:44:22.076399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33badfe-48f6-4c99-9371-0ab657aa5810 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:22.076994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33badfe-48f6-4c99-9371-0ab657aa5810 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:22.076994 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33badfe-48f6-4c99-9371-0ab657aa5810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:22.095632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a33badfe-48f6-4c99-9371-0ab657aa5810 None None] MFA Rules not processed for user `baf3a527e28d43388872b4dba718d940`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:44:22.096876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a33badfe-48f6-4c99-9371-0ab657aa5810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:44:22.104184 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4340/8786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:44:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:44:36.043541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fff7e-93a5-45c0-8da4-3d322a25662d None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:36.044099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fff7e-93a5-45c0-8da4-3d322a25662d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:36.044099 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fff7e-93a5-45c0-8da4-3d322a25662d None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:36.046016 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4447/8787] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:44:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:44:36.051779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:36.052272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:36.052618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:36.071849 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:44:36.073406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:44:36.103891 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4341/8788] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:44:36.133202 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fff7e-93a5-45c0-8da4-3d322a25662d None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:44:36.150362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fff7e-93a5-45c0-8da4-3d322a25662d None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:44:36.157626 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:44:36.158283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:44:36.158564 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:44:36.158844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:44:36.168393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:44:36.170021 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:44:36.182048 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4448/8789] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:05.491650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:05.513073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e6237-58cd-46e9-ba04-96f621f7dd73 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:05.521421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:05.521755 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:05.522039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:05.522316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:05.524149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:05.555274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:05.556932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd337f6-8fa1-44a6-bff6-cda2a9d8e72f service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:05.570144 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4342/8790] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:07.447353 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:07.468362 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5261b-7caa-4f0c-a10c-41cc684c3ba8 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:07.473663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:07.474319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:07.474606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:07.474886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:07.476736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:07.493019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:07.494667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:07.507856 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4449/8791] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:18.467029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:18.467556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:18.468443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:18.487963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] MFA Rules not processed for user `baf3a527e28d43388872b4dba718d940`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:45:18.489226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:18.496800 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4343/8792] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:45:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:45:18.791416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:18.800765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c416-84c2-4703-9e3c-fdfcff87ddd9 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:18.804307 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:18.804999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:18.805286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:18.805570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:18.807339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:18.819002 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:18.820718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182e98a-43f7-4cf4-afd6-671442d880bb service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:18.831887 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4450/8793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:36.219365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:36.229067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b494-45fb-4389-b07b-427a5dd04784 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:36.232625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:36.233273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:36.233561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:36.233840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:36.237285 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:36.250207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:36.252150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb0d61-3981-4f2d-8dbb-39bb9ac6b158 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:36.263338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4344/8794] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:36.370950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd4bd-df50-4d95-8c89-56c1a529a1a8 None None] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:36.371905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd4bd-df50-4d95-8c89-56c1a529a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:36.371905 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd4bd-df50-4d95-8c89-56c1a529a1a8 None None] PATH_INFO: `/` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:36.373750 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4451/8795] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:45:36.379137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:36.379498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:36.379779 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:36.399876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:45:36.401111 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:36.409759 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4345/8796] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:45:36.429904 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bd4bd-df50-4d95-8c89-56c1a529a1a8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:36.446676 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bd4bd-df50-4d95-8c89-56c1a529a1a8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:36.451898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:36.452612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:36.452955 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:36.453277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:36.462711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:36.464314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:36.473906 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4452/8797] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:45:36.633339 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:45:36.642497 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ce221-3ae0-4ae0-a38d-8642c258a3e1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:45:36.646068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:45:36.646712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:45:36.647003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:45:36.647281 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:45:36.649058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:45:36.664536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:45:36.666006 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:45:36.680267 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4346/8798] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:45:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:25.145004 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.156657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fa869-0ec1-4d9b-9db8-0a272b5dd700 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.161732 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.162603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.162894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.163176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] PATH_INFO: `/v3/users/baf3a527e28d43388872b4dba718d940` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.164365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf3a527e28d43388872b4dba718d940)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.166325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.211913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf3a527e28d43388872b4dba718d940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.219068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf3a527e28d43388872b4dba718d940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.219688 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf3a527e28d43388872b4dba718d940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.220934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf3a527e28d43388872b4dba718d940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.227643 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-26bd5128-a688-4191-bee6-d5efff340648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf3a527e28d43388872b4dba718d940'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.244196 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4453/8799] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:46:25 2022] DELETE /identity/v3/users/baf3a527e28d43388872b4dba718d940 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:46:25.424870 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.435471 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836247f-7111-4ac7-a007-424c2394ae0b service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.491467 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.492318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.492649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.492943 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] PATH_INFO: `/v3/projects/5f212cc8d96745d2aa089c88769ffc87` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.494083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f212cc8d96745d2aa089c88769ffc87)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.495956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.544785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f212cc8d96745d2aa089c88769ffc87', 'request_id': 'req-1ea7311d-579d-489e-aeef-3dc20cc83d47'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.552172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f212cc8d96745d2aa089c88769ffc87', 'request_id': 'req-1ea7311d-579d-489e-aeef-3dc20cc83d47'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.557880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f212cc8d96745d2aa089c88769ffc87', 'request_id': 'req-1ea7311d-579d-489e-aeef-3dc20cc83d47'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.570768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] The token cache is being invalidate because project 5f212cc8d96745d2aa089c88769ffc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:46:25.571136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.571831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-1ea7311d-579d-489e-aeef-3dc20cc83d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:25.573598 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4347/8800] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:46:25 2022] DELETE /identity/v3/projects/5f212cc8d96745d2aa089c88769ffc87 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:46:25.578515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.578803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.579076 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.598887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:25.600106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:25.665050 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4454/8801] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:46:25.673384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.673610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.673890 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.694470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:25.695680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:25.703675 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4348/8802] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:46:25.708614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.718316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76264-6d65-4ca8-b531-49f43d45dbeb None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.722873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.723528 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.723817 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.724098 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.724848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:46:25.725168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.726761 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.737860 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4455/8803] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:46:25.741995 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.751029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88d7c-4e7d-44ee-9d9f-7cc0db7f7df2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.756159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.756832 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.757116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.757392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.758078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.759953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.787996 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4349/8804] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:46:25 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:46:25.789198 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.799588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab321c5d-3475-4caf-abe1-48d398e180e8 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.854525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.855190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.855477 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.855757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.856434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.858376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.878373 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4456/8805] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:46:25 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:46:25.882579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.893059 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea371772-c524-42d8-bd0d-53fd73aed3af admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.897648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.898309 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.898592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.898868 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.899587 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.901213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.912104 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4350/8806] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:46:25.915740 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.926896 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdda0-c117-4f94-bba8-58dc283bd7a0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.931573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.932234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.932558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.932844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.933565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.935155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c9ea0-71a0-4b41-a288-518829662744 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.944980 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4457/8807] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:46:25.948963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:25.959569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2649c3-fa82-47c2-80ac-a8423be2d2d1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:25.964277 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:25.965192 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:25.965480 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:25.965761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] PATH_INFO: `/v3/projects/262a1451abbf479da01623a8cb576601/users/33119dc511be4910b9d7ff2770dbd47b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:25.980695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262a1451abbf479da01623a8cb576601, user_id=33119dc511be4910b9d7ff2770dbd47b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:25.983481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:25.995639 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4351/8808] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:46:25 2022] PUT /identity/v3/projects/262a1451abbf479da01623a8cb576601/users/33119dc511be4910b9d7ff2770dbd47b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:46:26.000762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ebcb-2551-4fed-b4bf-d7c0e867aa5b None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:26.001062 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ebcb-2551-4fed-b4bf-d7c0e867aa5b None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:26.001350 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ebcb-2551-4fed-b4bf-d7c0e867aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:26.019412 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-2e62ebcb-2551-4fed-b4bf-d7c0e867aa5b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:26.020723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2e62ebcb-2551-4fed-b4bf-d7c0e867aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:26.077905 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4458/8809] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:26.088103 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:26.089888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:26.144972 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d458-acc3-434c-a94e-73eff61b7e54 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:26.148796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:26.150808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:26.151098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:26.151381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:26.161046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:26.162466 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a37c4-09cd-4910-bee3-9184b5852ff3 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:26.172114 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4352/8810] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:26.745449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:26.745986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:26.746101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:26.772611 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] MFA Rules not processed for user `33119dc511be4910b9d7ff2770dbd47b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:26.773842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:26.842644 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4459/8811] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:26.853553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:26.854101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:26.854101 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:26.871222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] MFA Rules not processed for user `33119dc511be4910b9d7ff2770dbd47b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:26.872417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:26.879705 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4353/8812] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:26.890731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:26.893149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:26.968303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c91b33-61c0-407e-8122-4cedb0fdcc53 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:26.974378 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:26.975023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:26.975311 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:26.975586 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:26.983039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:26.984644 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd6c6-0a32-49a5-a50a-a8a005196853 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:26.993171 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4460/8813] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:27.518368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:27.519772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:27.593670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add68d3-8455-4919-a986-97e15b6d3a3c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:27.599360 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:27.600014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:27.600300 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:27.600605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:27.602382 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:27.613447 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:27.615013 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:27.624561 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4354/8814] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:36.904262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:36.904827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:36.904930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:36.922247 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] MFA Rules not processed for user `33119dc511be4910b9d7ff2770dbd47b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:36.923556 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:36.931047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4461/8815] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:37.481121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:37.494590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db8eb-023a-4a29-aa62-1dc3f4edc226 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:37.499749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:37.500402 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:37.500724 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:37.501105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:37.503464 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:37.516433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:37.518837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:37.529618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4355/8816] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:44.762591 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:44.786070 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98e3f4-df94-47ff-a586-4655846797ef None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:44.792217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:44.792903 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:44.793187 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:44.793467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:44.795251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:44.811168 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:44.812959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:44.829394 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4462/8817] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:46:49.031157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:49.061429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47ade9-9b1b-4517-b99d-50a58eea19af service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:49.068401 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:49.069538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:49.070160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:49.070511 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:49.072770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:49.091400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:49.093167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:49.107431 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4356/8818] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:46:55.744814 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:55.756232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c9890-80d5-49f1-961c-ec097f0f32c9 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:55.760964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:55.761835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:55.762120 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:55.762394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] PATH_INFO: `/v3/users/33119dc511be4910b9d7ff2770dbd47b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:55.763600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33119dc511be4910b9d7ff2770dbd47b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:55.765569 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:55.808990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33119dc511be4910b9d7ff2770dbd47b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:55.816303 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33119dc511be4910b9d7ff2770dbd47b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:55.816968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33119dc511be4910b9d7ff2770dbd47b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:55.817632 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33119dc511be4910b9d7ff2770dbd47b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:55.824220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-d75b7cb9-c0bf-4212-a247-40bb1400e3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33119dc511be4910b9d7ff2770dbd47b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:55.841576 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4463/8819] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:46:55 2022] DELETE /identity/v3/users/33119dc511be4910b9d7ff2770dbd47b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:46:56.014802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.033012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671e0a-f2ed-4d46-8609-60ffc48ff749 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.095249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.096034 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.096316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.096629 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] PATH_INFO: `/v3/projects/262a1451abbf479da01623a8cb576601` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.097791 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262a1451abbf479da01623a8cb576601)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.099672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.143797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262a1451abbf479da01623a8cb576601', 'request_id': 'req-466cb15a-d0dc-42a6-b34f-2347ce11c087'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:56.150067 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262a1451abbf479da01623a8cb576601', 'request_id': 'req-466cb15a-d0dc-42a6-b34f-2347ce11c087'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:56.155359 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262a1451abbf479da01623a8cb576601', 'request_id': 'req-466cb15a-d0dc-42a6-b34f-2347ce11c087'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:56.167383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] The token cache is being invalidate because project 262a1451abbf479da01623a8cb576601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:46:56.167896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:56.168560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-466cb15a-d0dc-42a6-b34f-2347ce11c087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:46:56.170094 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4357/8820] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:46:56 2022] DELETE /identity/v3/projects/262a1451abbf479da01623a8cb576601 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:46:56.175599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.175887 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.176166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.193898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:56.195093 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:56.251421 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4464/8821] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:56.259912 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.260222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.260586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.279460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:56.280677 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:56.288961 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4358/8822] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:46:56.293275 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.302812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa3ee1-6d90-40fa-94c5-a72c0ec8e8e7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.307606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.307987 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.308272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.308578 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.309292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:46:56.309599 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.311212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.322919 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4465/8823] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:46:56.327189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.336883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4d38f-449c-4cab-93aa-35628d42fb1b None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.341443 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.342083 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.342364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.342638 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.343311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.345241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.369199 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4359/8824] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:46:56 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:46:56.373077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.383561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa567-c96d-44d8-aa1e-6931f85483a3 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.438808 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.439481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.439767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.440608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.441296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.443216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.463747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4466/8825] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:46:56 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:46:56.467859 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.477956 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2ea78-493c-4e80-b586-a64048a08087 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.482455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.483112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.483400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.483675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.484383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.486098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.496922 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4360/8826] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:46:56.500648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.511309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34370-5612-4fb2-a049-c53758d5b86a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.515952 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.516720 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.517010 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.517296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.518039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.520157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb4de2-cca5-45fd-9ce6-98ae26d9a80f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.530230 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4467/8827] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:46:56.534390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.544479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47d9d0-3f1b-479c-8bf2-841222644857 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.549141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.550062 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.550351 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.550667 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] PATH_INFO: `/v3/projects/ca04c374e4d7453e9e147ab0a77e6b91/users/4c49132cf42e41bf8a2b5575225c1a91/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.566985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca04c374e4d7453e9e147ab0a77e6b91, user_id=4c49132cf42e41bf8a2b5575225c1a91, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.569722 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.582503 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4361/8828] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:46:56 2022] PUT /identity/v3/projects/ca04c374e4d7453e9e147ab0a77e6b91/users/4c49132cf42e41bf8a2b5575225c1a91/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:46:56.592858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.593160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.593450 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.621132 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] MFA Rules not processed for user `4c49132cf42e41bf8a2b5575225c1a91`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:46:56.622297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:56.685366 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4468/8829] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:46:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:46:56.695669 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:46:56.697436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:46:56.752275 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de9f75-99cc-4df3-9a0b-cb05b24925f3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:46:56.756033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:46:56.756705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:46:56.756992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:46:56.757274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:46:56.765590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:46:56.767014 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a6860-474f-4ecc-940e-21a083ea450d service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:46:56.776263 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4362/8830] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:46:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:08.001529 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.062895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f81db8-0c39-4064-89c8-84e1c09aced5 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.067697 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.068605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.068894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.069173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] PATH_INFO: `/v3/users/4c49132cf42e41bf8a2b5575225c1a91` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.070365 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c49132cf42e41bf8a2b5575225c1a91)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.072290 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.116618 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c49132cf42e41bf8a2b5575225c1a91'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.125627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c49132cf42e41bf8a2b5575225c1a91'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.126444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c49132cf42e41bf8a2b5575225c1a91'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.127066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c49132cf42e41bf8a2b5575225c1a91'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.133728 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c49132cf42e41bf8a2b5575225c1a91'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.150661 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4469/8831] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:47:08 2022] DELETE /identity/v3/users/4c49132cf42e41bf8a2b5575225c1a91 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:08.155195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.155685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.155811 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.174526 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:08.175735 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:08.232423 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4363/8832] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:08.242061 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.243444 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:08.299306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27af7-b75f-4088-beb3-d71528dbe892 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.302897 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.303542 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.303827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.304101 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.313250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.315228 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae027-a9fe-4711-a96f-1dffa2a5d0ed service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.324601 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4470/8833] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:08.497450 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.499012 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:08.513728 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5272-9fca-44b7-9d53-93d766f41480 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.518659 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.519769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.520291 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.520800 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] PATH_INFO: `/v3/projects/ca04c374e4d7453e9e147ab0a77e6b91` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.523026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca04c374e4d7453e9e147ab0a77e6b91)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.525932 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.574374 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca04c374e4d7453e9e147ab0a77e6b91', 'request_id': 'req-8bf3b1c8-ab93-48d4-8159-71b0debc0075'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.580133 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca04c374e4d7453e9e147ab0a77e6b91', 'request_id': 'req-8bf3b1c8-ab93-48d4-8159-71b0debc0075'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.585523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca04c374e4d7453e9e147ab0a77e6b91', 'request_id': 'req-8bf3b1c8-ab93-48d4-8159-71b0debc0075'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.597569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] The token cache is being invalidate because project ca04c374e4d7453e9e147ab0a77e6b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:47:08.597847 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.599073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8bf3b1c8-ab93-48d4-8159-71b0debc0075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:08.600632 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4364/8834] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:47:08 2022] DELETE /identity/v3/projects/ca04c374e4d7453e9e147ab0a77e6b91 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:08.605876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.606171 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.606454 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.624227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:08.625468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:08.682489 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4471/8835] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:08.690015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.690311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.690592 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.709525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:08.710709 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:08.718558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4365/8836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:08.723262 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.732959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4786c5f-71dd-4bc2-9643-b661f8036cd8 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.738052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.738711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.739009 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.739274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.739990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:47:08.740302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.741948 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.754002 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4472/8837] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:47:08.758350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.767490 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81dee1e-6365-4abc-92a6-d4339b470ec2 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.772226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.772916 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.773203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.773479 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.774160 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.776096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.804526 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4366/8838] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:47:08 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:47:08.808680 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.819925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f1027-342e-47ab-b318-7aa7cb9e1adf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.876379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.877001 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.877928 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.878183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.878861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.880793 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.902517 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4473/8839] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:47:08 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:47:08.903672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.913875 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933cf2-04cc-4a20-bbd3-d4281d0df871 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.918688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.919340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.919624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.919984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.920658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.922241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.932887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4367/8840] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:47:08.936588 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.946899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20e25a-f1ad-4874-89ce-0d49b0ce3559 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.951467 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.952117 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.952401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.952710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.953424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:08.954995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b58354-465f-44f1-b12b-34d66cb1c0a1 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:08.965121 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4474/8841] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:47:08.969120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:08.979448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1331af-8921-4983-8079-9d6e3a43fa4e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:08.984179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:08.985096 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:08.985386 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:08.985665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] PATH_INFO: `/v3/projects/91605aa0a2a045609ec5e1ec3fa2f4b9/users/9ffe440c95fa45508e721d4807dd8786/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:08.999960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=91605aa0a2a045609ec5e1ec3fa2f4b9, user_id=9ffe440c95fa45508e721d4807dd8786, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:09.003136 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:09.015328 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4368/8842] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:47:08 2022] PUT /identity/v3/projects/91605aa0a2a045609ec5e1ec3fa2f4b9/users/9ffe440c95fa45508e721d4807dd8786/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:47:09.026538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:09.027055 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:09.027160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:09.053488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] MFA Rules not processed for user `9ffe440c95fa45508e721d4807dd8786`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:09.054717 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:09.122287 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4475/8843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:09.133046 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:09.134685 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:09.189317 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e131ebb-c155-4714-b94e-b6eb7b943cbb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:09.193475 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:09.194118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:09.194406 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:09.194688 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:09.202936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:09.204368 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fbf98-c692-42f9-b3db-33531518ad00 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:09.213940 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4369/8844] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:13.308374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:13.368090 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c571a56-7586-47b0-a049-30a5a76792e3 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:13.372724 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:13.373600 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:13.373889 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:13.374170 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] PATH_INFO: `/v3/users/9ffe440c95fa45508e721d4807dd8786` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:13.375366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffe440c95fa45508e721d4807dd8786)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:13.378164 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:13.421320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffe440c95fa45508e721d4807dd8786'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.428617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffe440c95fa45508e721d4807dd8786'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.429254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffe440c95fa45508e721d4807dd8786'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.429869 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffe440c95fa45508e721d4807dd8786'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.436678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffe440c95fa45508e721d4807dd8786'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.454680 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4476/8845] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:47:13 2022] DELETE /identity/v3/users/9ffe440c95fa45508e721d4807dd8786 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:13.459723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:13.460164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:13.460292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:13.480287 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:13.483055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:13.543043 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4370/8846] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:13.552570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:13.554142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:13.610032 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2437a-2f37-4d5e-bef8-9069d378196e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:13.613653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:13.614605 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:13.614888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:13.615163 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:13.624651 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:13.626094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f384174-9c2f-4ec4-b7c0-6b14bb1827d4 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:13.636518 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4477/8847] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:13.808378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:13.809907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:13.824279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0245f-3da9-44e4-8b4f-66d8c80c1d81 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:13.829206 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:13.830725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:13.831033 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:13.831313 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] PATH_INFO: `/v3/projects/91605aa0a2a045609ec5e1ec3fa2f4b9` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:13.832583 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91605aa0a2a045609ec5e1ec3fa2f4b9)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:13.834543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:13.881985 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91605aa0a2a045609ec5e1ec3fa2f4b9', 'request_id': 'req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.887961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91605aa0a2a045609ec5e1ec3fa2f4b9', 'request_id': 'req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.893273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91605aa0a2a045609ec5e1ec3fa2f4b9', 'request_id': 'req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.905107 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] The token cache is being invalidate because project 91605aa0a2a045609ec5e1ec3fa2f4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:47:13.905399 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.906018 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-ac6bcbbf-ea82-479d-98f0-af8a58d925c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:47:13.907713 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4371/8848] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:47:13 2022] DELETE /identity/v3/projects/91605aa0a2a045609ec5e1ec3fa2f4b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:13.913497 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:13.913789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:13.914069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:13.932205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:13.933536 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:13.991907 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4478/8849] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:13.999795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.000093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.000377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.018852 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:14.020056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:14.028478 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4372/8850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:14.032561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.042860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0a2a8-ce51-4b5f-9ccf-c6a2576280d4 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.047442 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.048097 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.048384 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.048706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.049423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:47:14.049736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.051391 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.062564 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4479/8851] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:47:14.066778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.075816 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f7060-70e2-4418-9603-d7ea1c56807f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.080926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.081565 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.081846 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.082118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.082793 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.084696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.109775 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4373/8852] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:47:14 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:47:14.113227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.123225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7e9e-79e3-44aa-9d30-8ad8a0dda7bf admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.177334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.177990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.178273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.178548 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.179226 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.181165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.199133 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4480/8853] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:47:14 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:47:14.203242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.214134 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12abc6-dd16-4f89-8c47-4ae84b2056a3 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.218776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.219465 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.219753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.220112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.221474 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.223093 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.233273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4374/8854] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:47:14.237142 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.246809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772d45-e333-4c9c-9103-8d137d2d66fa admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.251521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.252699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.252981 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.253254 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.253958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.255523 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda631c7-aa96-447d-9583-d5bf7d1e93b9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.265100 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4481/8855] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:47:14.269613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.279499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938715-ef15-4730-85a0-c47bf788bc68 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.284163 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.285065 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.285362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.285645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] PATH_INFO: `/v3/projects/fd583fa9f14e418e850937a746252b93/users/724e735d54f244ab9c2fef0c55a185bb/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.301292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd583fa9f14e418e850937a746252b93, user_id=724e735d54f244ab9c2fef0c55a185bb, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.303977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.317262 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4375/8856] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:47:14 2022] PUT /identity/v3/projects/fd583fa9f14e418e850937a746252b93/users/724e735d54f244ab9c2fef0c55a185bb/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:14.322320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16fe4-9ce3-4d26-a5df-fff1d64b940d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.322784 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16fe4-9ce3-4d26-a5df-fff1d64b940d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.322923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16fe4-9ce3-4d26-a5df-fff1d64b940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.340841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-dfd16fe4-9ce3-4d26-a5df-fff1d64b940d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:14.342045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-dfd16fe4-9ce3-4d26-a5df-fff1d64b940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:14.399243 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4482/8857] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:14.408734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:14.410437 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:14.469015 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f276-a89a-4b90-91d2-677147d8526f admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:14.472772 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:14.473425 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:14.473713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:14.473993 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:14.483216 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:14.484694 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:14.494339 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4376/8858] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:18.882941 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:18.883494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:18.883494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:18.916646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] MFA Rules not processed for user `724e735d54f244ab9c2fef0c55a185bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:18.918182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:18.987088 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4483/8859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:18.991713 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.001607 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466ff8-af56-4172-8ea6-f63dbb9c6c06 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.007078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.007848 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.008240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.008631 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.009390 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.011383 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.042153 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4377/8860] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:47:18 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:47:19.043937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.055891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2a866-2ce4-4117-8790-a6d063540813 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.115560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.116251 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.116575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.116862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.117558 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.119514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.143998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4484/8861] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:47:19 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:47:19.145282 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.156075 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db356b-a506-4de9-8c14-8e238914823c admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.161547 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.162226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.162517 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.162796 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.163558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.165220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.177004 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4378/8862] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:47:19.181060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.191757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb3f8-da2b-43da-96e3-03306ba54732 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.196648 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.197563 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.197849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.198130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] PATH_INFO: `/v3/projects/589968f223444f1ba808e60d5fbf35b8/users/50c656fcfc1c4e01a17edb2cea6d694d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.215102 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589968f223444f1ba808e60d5fbf35b8, user_id=50c656fcfc1c4e01a17edb2cea6d694d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.217835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.234602 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4485/8863] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:47:19 2022] PUT /identity/v3/projects/589968f223444f1ba808e60d5fbf35b8/users/50c656fcfc1c4e01a17edb2cea6d694d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:19.237395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.258044 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398503f-2661-4c83-bedd-dc304a16a32b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.319966 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.320782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.321143 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.321494 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.322315 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.323996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d2071-904b-4409-a3e2-df5ef8bfdadd admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.334772 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4379/8864] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:47:19.338965 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:19.349607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00732957-c0f8-41d6-956a-2cf12ebdc9d4 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:19.354424 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:19.355326 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:19.355614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:19.355895 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] PATH_INFO: `/v3/projects/589968f223444f1ba808e60d5fbf35b8/users/50c656fcfc1c4e01a17edb2cea6d694d/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:19.358141 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=589968f223444f1ba808e60d5fbf35b8, user_id=50c656fcfc1c4e01a17edb2cea6d694d, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:19.360841 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21f446-ed24-4b1c-b8b8-01b7e7e0b6bb admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:19.372785 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4486/8865] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:47:19 2022] PUT /identity/v3/projects/589968f223444f1ba808e60d5fbf35b8/users/50c656fcfc1c4e01a17edb2cea6d694d/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:47:23.857056 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:23.857524 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:23.857730 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:23.883110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] MFA Rules not processed for user `50c656fcfc1c4e01a17edb2cea6d694d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:23.884981 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:23.959888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4380/8866] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:23.997773 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed83b3-a5ac-4e8a-a7cf-bb9261515f12 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:23.998394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed83b3-a5ac-4e8a-a7cf-bb9261515f12 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:23.998394 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed83b3-a5ac-4e8a-a7cf-bb9261515f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:24.051809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-43ed83b3-a5ac-4e8a-a7cf-bb9261515f12 None None] MFA Rules not processed for user `a51bfe290bcb46ca8fbecbaed36d2044`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:24.052961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-43ed83b3-a5ac-4e8a-a7cf-bb9261515f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:24.112490 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4487/8867] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Apr 2 21:47:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:24.118630 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:24.128486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31f33-0bd9-4b3a-b005-a4c5a109c91e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:24.132031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:24.132702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:24.132989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:24.133271 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:24.190773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:24.192228 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41e8c8-aeb2-4077-be3f-be60f8efad9a service glance] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:24.201782 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4381/8868] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:47:24.337944 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:24.338236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:24.338525 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:24.395129 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:24.396402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:24.487729 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4488/8869] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:24.547906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e578-04ff-40a0-b20c-a7e3ba9599c4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:24.548202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e578-04ff-40a0-b20c-a7e3ba9599c4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:24.548518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528e578-04ff-40a0-b20c-a7e3ba9599c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:24.601850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4528e578-04ff-40a0-b20c-a7e3ba9599c4 None None] MFA Rules not processed for user `46a7aa639ada47bd8cdf615e9a7a5961`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:24.603098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4528e578-04ff-40a0-b20c-a7e3ba9599c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:24.678883 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4382/8870] 10.222.0.18 () {58 vars in 1039 bytes} [Sat Apr 2 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:24.685269 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:24.698265 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2bb55-445f-4d27-97a8-f7b9f97312e0 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:24.703281 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:24.703947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:24.704292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:24.704610 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:24.714177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:24.715772 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:24.724966 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4489/8871] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:47:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:47:34.172400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffc90-11e1-45cb-8add-55302aec2e30 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:34.173032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffc90-11e1-45cb-8add-55302aec2e30 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:34.173032 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befffc90-11e1-45cb-8add-55302aec2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:34.190384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-befffc90-11e1-45cb-8add-55302aec2e30 None None] MFA Rules not processed for user `724e735d54f244ab9c2fef0c55a185bb`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:34.191608 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-befffc90-11e1-45cb-8add-55302aec2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:34.198623 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4383/8872] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:34.455870 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:34.508481 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c39ed-1593-40d8-a24b-3c082f79e851 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:34.512077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:34.512762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:34.513051 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:34.513333 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:34.515121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:34.527848 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:34.529361 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03479e9-e87f-476f-bd51-f5baad3d327f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:34.539582 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4490/8873] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:35.310525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:35.311084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:35.311084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:35.330148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:35.331412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:35.393617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4384/8874] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Apr 2 21:47:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:35.409045 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3099a-e647-485d-ac08-353cacd496ca None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:35.409344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3099a-e647-485d-ac08-353cacd496ca None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:35.409629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3099a-e647-485d-ac08-353cacd496ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:35.426991 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-29b3099a-e647-485d-ac08-353cacd496ca None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:35.428192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-29b3099a-e647-485d-ac08-353cacd496ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:35.437356 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4491/8875] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 21:47:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:35.444037 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:35.455552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03595d-b35f-4dab-9214-d06af2b717fb None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:35.460934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:35.461594 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:35.461886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:35.462165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:35.470761 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:35.472343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:35.482008 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4385/8876] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:47:36.213306 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:36.213836 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:36.213945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:36.231782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:47:36.233034 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:47:36.240360 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4492/8877] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:47:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:47:36.253872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:36.265499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43896f65-d105-438a-905a-2ac6877d1051 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:36.271164 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:36.271808 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:36.272105 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:36.272364 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:36.280600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:36.282226 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c4e6e-d854-4e5e-8895-29e689892253 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:36.290630 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4386/8878] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:47:59.571472 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:47:59.581242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427cd9-9073-4f1c-952b-ea7ed4858bc6 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:47:59.584849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:47:59.585485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:47:59.585765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:47:59.586039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:47:59.594835 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:47:59.596258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:47:59.605488 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4493/8879] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:47:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:48:12.454750 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:48:12.455370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:48:12.455370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:48:12.473369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:48:12.474577 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:48:12.483254 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4387/8880] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Apr 2 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:48:12.495573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:48:12.507082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951784fa-4a00-4428-ad6b-3a6b7bc5d24f service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:48:12.512159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:48:12.512827 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:48:12.513145 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:48:12.513427 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:48:12.521663 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:48:12.523284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:48:12.532917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4494/8881] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:48:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:48:17.484369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:48:17.485824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:48:17.498707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686b27-d475-4099-bf81-f25a4e0f829c None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:48:17.501485 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:48:17.502131 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:48:17.502417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:48:17.502696 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:48:17.504411 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:48:17.516003 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:48:17.517434 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:48:17.527811 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4388/8882] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:48:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:48:38.502224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:48:38.511489 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6ee3-fafa-4a64-9d56-932e55f4867f service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:48:38.515094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:48:38.515731 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:48:38.516017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:48:38.516297 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:48:38.518614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:48:38.588256 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:48:38.589745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a60f0-7a83-4b0a-9e5d-4b8245202077 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:48:38.603543 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4495/8883] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:13.714569 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:13.722737 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2340-eab3-4171-9116-e36b20d53273 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:13.726613 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:13.727246 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:13.727527 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:13.727803 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:13.729560 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:13.746084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:13.747500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:13.761355 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4389/8884] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:21.781990 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:21.782469 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:21.782582 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:21.800494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:21.801719 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:21.809072 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4496/8885] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 21:49:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:21.848998 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:21.859931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212df5-37da-436b-bd4a-6e885295aa3e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:21.864964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:21.865602 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:21.865885 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:21.866159 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:21.874182 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:21.875736 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:21.884065 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4390/8886] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:49:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 21:49:28.477470 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:28.562505 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f98ea-611f-4acc-bebf-de1e8cd55475 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:28.567714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:28.568629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:28.568916 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:28.569193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] PATH_INFO: `/v3/users/724e735d54f244ab9c2fef0c55a185bb` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:28.570401 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724e735d54f244ab9c2fef0c55a185bb)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:28.572324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:28.616921 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724e735d54f244ab9c2fef0c55a185bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.624190 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724e735d54f244ab9c2fef0c55a185bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.624893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724e735d54f244ab9c2fef0c55a185bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.625522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724e735d54f244ab9c2fef0c55a185bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.632886 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724e735d54f244ab9c2fef0c55a185bb'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.649306 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4497/8887] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:49:28 2022] DELETE /identity/v3/users/724e735d54f244ab9c2fef0c55a185bb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:28.820172 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:28.831754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b725-2d87-405c-9cc7-28e5eb34fe43 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:28.889837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:28.890742 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:28.891026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:28.891327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] PATH_INFO: `/v3/projects/fd583fa9f14e418e850937a746252b93` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:28.892581 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd583fa9f14e418e850937a746252b93)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:28.894500 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:28.942460 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd583fa9f14e418e850937a746252b93', 'request_id': 'req-458daa60-44a0-458b-bd23-e0b80bcec179'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.948385 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd583fa9f14e418e850937a746252b93', 'request_id': 'req-458daa60-44a0-458b-bd23-e0b80bcec179'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.953783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd583fa9f14e418e850937a746252b93', 'request_id': 'req-458daa60-44a0-458b-bd23-e0b80bcec179'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.977508 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] The token cache is being invalidate because project fd583fa9f14e418e850937a746252b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:49:28.977797 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.978424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:28.979952 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4391/8888] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:49:28 2022] DELETE /identity/v3/projects/fd583fa9f14e418e850937a746252b93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:28.983970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:28.985416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:28.999063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e7b6-8de1-4b15-8d68-10d1b491f9a9 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.053621 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.054485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.054765 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.055038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] PATH_INFO: `/v3/users/50c656fcfc1c4e01a17edb2cea6d694d` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.056274 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c656fcfc1c4e01a17edb2cea6d694d)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.058255 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.101811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c656fcfc1c4e01a17edb2cea6d694d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.108645 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c656fcfc1c4e01a17edb2cea6d694d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.109298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c656fcfc1c4e01a17edb2cea6d694d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.109925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c656fcfc1c4e01a17edb2cea6d694d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.117612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-f51fe568-74d1-45fd-8bc4-c4c5430d6f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c656fcfc1c4e01a17edb2cea6d694d'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.133703 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4498/8889] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:49:28 2022] DELETE /identity/v3/users/50c656fcfc1c4e01a17edb2cea6d694d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:29.316616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.318165 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:29.331068 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458daa60-44a0-458b-bd23-e0b80bcec179 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.389444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.390347 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.390838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.391141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] PATH_INFO: `/v3/projects/589968f223444f1ba808e60d5fbf35b8` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.393120 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=589968f223444f1ba808e60d5fbf35b8)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.395538 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.443240 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589968f223444f1ba808e60d5fbf35b8', 'request_id': 'req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.449272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589968f223444f1ba808e60d5fbf35b8', 'request_id': 'req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.454850 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589968f223444f1ba808e60d5fbf35b8', 'request_id': 'req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.467942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] The token cache is being invalidate because project 589968f223444f1ba808e60d5fbf35b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:49:29.468233 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.468874 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-109d78ee-5e59-4bf4-aeea-ecbd64e14d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:49:29.470407 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4392/8890] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:49:29 2022] DELETE /identity/v3/projects/589968f223444f1ba808e60d5fbf35b8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:29.476193 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.476515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.476819 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.494487 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:29.495796 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:29.557022 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4499/8891] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:29.564723 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.565017 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.565297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.588770 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:29.590001 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:29.601649 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4393/8892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:29.605862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.615633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2ac2-32b0-4c88-a853-b558e222adfd None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.620192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.620964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.621277 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.621629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.622380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:49:29.622687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.624287 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.637258 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4500/8893] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:49:29.641612 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.651698 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5b49-8a7d-4277-b096-ea6099c36fe1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.656469 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.657137 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.657422 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.657699 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.658412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.660328 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.689887 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4394/8894] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:49:29 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:49:29.691581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.702077 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734d8f-c7a0-4032-930d-bca0ef09ba06 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.759084 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.759757 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.760042 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.760320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.761029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.762935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.782998 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4501/8895] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:49:29 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:49:29.787112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.797822 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c39a90-898d-4855-b7bf-bbb3ffdc0309 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.802435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.803095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.803381 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.803661 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.804377 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.806008 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.816773 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4395/8896] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:49:29.820379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.830596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528cb42-0964-40cf-87c8-dbda9ecad88e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.835749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.836402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.836721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.836999 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.837710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.839296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe9b2-f5b4-4716-8359-6c900c0c9f24 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.848992 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4502/8897] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:49:29.853197 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:29.863181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7e7e-b132-4476-92e1-64b85ff563c1 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:29.867758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:29.868662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.868944 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.869221 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] PATH_INFO: `/v3/projects/ca394d2c596042ad961fc645ce7b6940/users/6a25135e2c29463999fd4d912d99bf6b/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.883676 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca394d2c596042ad961fc645ce7b6940, user_id=6a25135e2c29463999fd4d912d99bf6b, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:29.886345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:29.901069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4396/8898] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:49:29 2022] PUT /identity/v3/projects/ca394d2c596042ad961fc645ce7b6940/users/6a25135e2c29463999fd4d912d99bf6b/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:49:29.910959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:29.911250 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:29.911549 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:29.938963 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:29.940114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:30.002584 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4503/8899] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:49:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:30.007682 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.065990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466877-bc8d-41bc-a2e6-ba6b2ddeb6f6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.072780 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.073400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.073695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.073977 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.075048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.077329 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.101314 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4397/8900] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:49:30 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:49:30.105370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.116873 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58d4b0-673b-4c08-a998-d9e3afcc421a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.170304 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.170976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.171261 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.171540 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.172225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.174184 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.198290 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4504/8901] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:49:30 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:49:30.199544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.210169 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd9c8b-ec23-46e3-b748-0589bcf78f00 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.214869 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.215523 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.215807 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.216084 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.216891 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.218559 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.228882 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4398/8902] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:49:30.233136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.243493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94feb7-3ea9-405a-b452-89a059b3851b admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.249596 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.250522 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.250805 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.251081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] PATH_INFO: `/v3/projects/5ca1b466668a458b93736f7e6586433e/users/7aceb8d01d1145d6b64de7dffec5ac44/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.268370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1b466668a458b93736f7e6586433e, user_id=7aceb8d01d1145d6b64de7dffec5ac44, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.271041 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.284160 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4505/8903] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:49:30 2022] PUT /identity/v3/projects/5ca1b466668a458b93736f7e6586433e/users/7aceb8d01d1145d6b64de7dffec5ac44/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:30.288773 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.299051 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d20c6a-9166-4dfc-b69a-d92e6d4862af admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.355543 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.356150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.356418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.356733 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.357448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.359048 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679a483-ba5f-49eb-9356-a0b4ff9b277d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.369462 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4399/8904] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:49:30.373624 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.384075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5309a-fbab-4311-be39-cd83b231d563 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.388954 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.389837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.390116 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.390390 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] PATH_INFO: `/v3/projects/5ca1b466668a458b93736f7e6586433e/users/7aceb8d01d1145d6b64de7dffec5ac44/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.392360 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1b466668a458b93736f7e6586433e, user_id=7aceb8d01d1145d6b64de7dffec5ac44, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.395029 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.404982 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4506/8905] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:49:30 2022] PUT /identity/v3/projects/5ca1b466668a458b93736f7e6586433e/users/7aceb8d01d1145d6b64de7dffec5ac44/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:49:30.416320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.416640 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.416923 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.443502 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] MFA Rules not processed for user `7aceb8d01d1145d6b64de7dffec5ac44`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:30.444745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:30.512676 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4400/8906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:49:30.523862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:30.525656 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:30.602956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262a10-743a-4ea2-b3a8-b3b8db71c036 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:30.608706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:30.609314 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:30.609607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:30.609891 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:30.663947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:30.665826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0369d-7b6c-437d-ad36-e4b85e9653e0 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:30.674509 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4507/8907] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:33.939680 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:33.941263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:33.997372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a072a05-8d0f-409e-94a7-b5da5cf10729 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:34.000961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:34.001610 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:34.001894 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:34.002180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:34.011442 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:34.012925 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0539b-981c-4dc7-b572-eaaf3b5e931f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:34.023262 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4401/8908] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:36.818020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac773d-3775-4bdf-bbfa-5a666fb0b944 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:36.818476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac773d-3775-4bdf-bbfa-5a666fb0b944 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:36.818571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac773d-3775-4bdf-bbfa-5a666fb0b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:36.843901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-24ac773d-3775-4bdf-bbfa-5a666fb0b944 None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:36.845189 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-24ac773d-3775-4bdf-bbfa-5a666fb0b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:36.853135 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4508/8909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:49:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:36.887754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203ec2-cb3e-46a7-9b6b-78c5f38db022 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:36.888302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203ec2-cb3e-46a7-9b6b-78c5f38db022 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:36.888302 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203ec2-cb3e-46a7-9b6b-78c5f38db022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:36.925196 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-58203ec2-cb3e-46a7-9b6b-78c5f38db022 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:36.927073 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-58203ec2-cb3e-46a7-9b6b-78c5f38db022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:36.936963 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4402/8910] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 21:49:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:37.620242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:37.620589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:37.620879 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:37.648402 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:37.655934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:37.683858 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4509/8911] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 21:49:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 21:49:39.978069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592eca-4903-4060-9a73-7d586f387aff None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:39.978617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592eca-4903-4060-9a73-7d586f387aff None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:39.978617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592eca-4903-4060-9a73-7d586f387aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:40.019634 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-df592eca-4903-4060-9a73-7d586f387aff None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:40.021499 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-df592eca-4903-4060-9a73-7d586f387aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:40.044635 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4403/8912] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:49:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:40.062124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:40.075485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b17be3-f155-4186-bca8-d9b73b9f4627 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:40.081192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:40.082473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:40.082958 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:40.083309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:40.096881 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:40.099834 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:40.129257 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4510/8913] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:42.685601 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5d7b-8445-41ac-abb9-c19f09802df5 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:42.686141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5d7b-8445-41ac-abb9-c19f09802df5 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:42.686141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5d7b-8445-41ac-abb9-c19f09802df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:42.716318 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-098c5d7b-8445-41ac-abb9-c19f09802df5 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:42.718325 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-098c5d7b-8445-41ac-abb9-c19f09802df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:42.730797 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4404/8914] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:42.741560 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:42.742945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:42.754299 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc3533-4daa-46ec-9868-69f2f0e86e35 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:42.757844 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:42.758476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:42.758759 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:42.759037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:42.769666 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:42.771126 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:42.781937 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4511/8915] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:49:45.934198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1b4e-6e23-44c1-bfb7-32b087e85170 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:45.934766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1b4e-6e23-44c1-bfb7-32b087e85170 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:45.934766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b1b4e-6e23-44c1-bfb7-32b087e85170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:45.955404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-ad3b1b4e-6e23-44c1-bfb7-32b087e85170 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:45.956936 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ad3b1b4e-6e23-44c1-bfb7-32b087e85170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:45.963779 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4405/8916] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Apr 2 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:45.979837 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:45.990301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7971d1-18ba-4e6d-9c66-0b43cc031158 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:45.994122 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:45.994769 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:45.995054 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:45.995349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:46.002449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:46.004917 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:46.012575 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4512/8917] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:49:49.364871 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a521-409a-4f2e-afd8-4f11e5e375b7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:49.365414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a521-409a-4f2e-afd8-4f11e5e375b7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:49.365684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a521-409a-4f2e-afd8-4f11e5e375b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:49.385652 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-e4e4a521-409a-4f2e-afd8-4f11e5e375b7 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:49:49.386967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e4e4a521-409a-4f2e-afd8-4f11e5e375b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:49:49.397348 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4406/8918] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:49:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:49:49.411109 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:49:49.427079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25bc1-d196-4fba-9628-489b4e7d7593 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:49:49.433078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:49:49.433993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:49:49.434273 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:49:49.434762 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:49:49.445646 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:49:49.447252 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a76a90-50aa-4bd6-a3d5-1e1445216762 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:49:49.459516 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4513/8919] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:49:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:50:44.219552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:50:44.220428 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:50:44.220768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:50:44.245274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:50:44.246513 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:50:44.256046 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4407/8920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:50:44.609818 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0883c5-b75d-4004-b6f0-eaf4912b3d7d None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:50:44.610393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0883c5-b75d-4004-b6f0-eaf4912b3d7d None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:50:44.610393 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0883c5-b75d-4004-b6f0-eaf4912b3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:50:44.651961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-eb0883c5-b75d-4004-b6f0-eaf4912b3d7d None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:50:44.653236 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-eb0883c5-b75d-4004-b6f0-eaf4912b3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:50:44.671519 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4514/8921] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:50:44.683961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:50:44.694544 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535ea6d-971a-4615-9ba6-379cdc0a6b4d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:50:44.698398 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:50:44.699055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:50:44.699545 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:50:44.699825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:50:44.708883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:50:44.710598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:50:44.722745 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4408/8922] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:50:52.213936 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede386e9-1ea2-4c61-923d-bda1a5421de3 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:50:52.214492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede386e9-1ea2-4c61-923d-bda1a5421de3 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:50:52.214604 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede386e9-1ea2-4c61-923d-bda1a5421de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:50:52.243998 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-ede386e9-1ea2-4c61-923d-bda1a5421de3 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:50:52.245349 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ede386e9-1ea2-4c61-923d-bda1a5421de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:50:52.256684 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4515/8923] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:50:52.271897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:50:52.285198 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1cd-6c25-4985-bf02-ddf6649189eb service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:50:52.291343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:50:52.291989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:50:52.292272 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:50:52.292584 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:50:52.301964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:50:52.303528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:50:52.313850 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4409/8924] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:50:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:52:29.506962 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da3c-d68f-486b-ab87-4c1c20b4b3b8 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:52:29.507495 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da3c-d68f-486b-ab87-4c1c20b4b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:52:29.507746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335da3c-d68f-486b-ab87-4c1c20b4b3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:52:29.532589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-9335da3c-d68f-486b-ab87-4c1c20b4b3b8 None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:52:29.534316 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9335da3c-d68f-486b-ab87-4c1c20b4b3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:52:29.543177 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4516/8925] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:52:30.278405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:52:30.280691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:52:30.391962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6acb47-b971-4ab7-9f97-e9650a8a1ed9 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:52:30.399238 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:52:30.400838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:52:30.401378 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:52:30.401876 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:52:30.404168 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:52:30.420864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:52:30.422690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:52:30.445077 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4410/8926] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:52:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:52:42.954620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:52:42.955115 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:52:42.955284 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:52:42.984779 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:52:42.986161 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:52:43.017635 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4517/8927] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:52:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:52:43.032518 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:52:43.045284 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c581b-ed2f-4a4c-bd5d-6c52ebe7ac39 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:52:43.051548 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:52:43.052213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:52:43.052525 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:52:43.052810 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:52:43.062862 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:52:43.064448 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6bdd6-0565-4ef7-89cf-4420bdf36d50 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:52:43.075995 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4411/8928] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:52:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:53:12.751985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:12.773176 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db3585-359a-45f4-b4bd-873a89875919 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:12.778294 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:12.778934 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:12.779220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:12.779514 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:12.781334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:12.802114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:12.803689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:12.813710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4518/8929] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:53:16.466668 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-901d-4d9d-86f6-fc55917bc382 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:16.467147 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-901d-4d9d-86f6-fc55917bc382 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:16.467262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-901d-4d9d-86f6-fc55917bc382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:16.503308 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-daecd40a-901d-4d9d-86f6-fc55917bc382 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:53:16.504556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-daecd40a-901d-4d9d-86f6-fc55917bc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:16.513403 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4412/8930] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Apr 2 21:53:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:53:16.520053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:16.530587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2f3f-78e6-4036-8ae9-67ee587f639f service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:16.535975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:16.536636 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:16.536929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:16.537208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:16.538961 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:16.550065 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:16.551635 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:16.561277 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4519/8931] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:53:18.721591 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6241-d664-4108-85ad-dd08fac77c64 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:18.722212 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6241-d664-4108-85ad-dd08fac77c64 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:18.722352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6241-d664-4108-85ad-dd08fac77c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:18.754472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-769d6241-d664-4108-85ad-dd08fac77c64 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:53:18.755719 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-769d6241-d664-4108-85ad-dd08fac77c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:18.762679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4413/8932] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:53:18.776945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:18.790789 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35c208-4231-4576-959b-9c12a01f5a09 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:18.794376 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:18.795019 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:18.795301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:18.795576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:18.803272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:18.804874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e3b2a-3a14-4c18-bb50-886f776f0bbe service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:18.813928 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4520/8933] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:53:18.926242 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47df6-aa0d-4f9a-a3bc-1a075239032a None None] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:18.926554 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47df6-aa0d-4f9a-a3bc-1a075239032a None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:18.926830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47df6-aa0d-4f9a-a3bc-1a075239032a None None] PATH_INFO: `/` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:18.928679 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4414/8934] 10.222.0.18 () {54 vars in 921 bytes} [Sat Apr 2 21:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 02 21:53:18.933337 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:18.933629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:18.933909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:18.951862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] MFA Rules not processed for user `31f96fae657d473483c67fd7175d398f`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:53:18.953707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:18.962248 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4521/8935] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:53:18.982424 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a47df6-aa0d-4f9a-a3bc-1a075239032a None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:18.996174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a47df6-aa0d-4f9a-a3bc-1a075239032a None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:19.001665 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:19.002304 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:19.002585 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:19.002864 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:19.011112 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:19.012721 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:19.022416 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4415/8936] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:53:20.192535 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:20.201746 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743151a2-4868-4f83-861d-a298a83d7327 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:20.206053 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:20.206699 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:20.206988 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:20.207271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:20.209074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:20.224551 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:20.225985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fcbf1-309d-4aca-bf6b-0a716f34b99a service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:20.239221 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4522/8937] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:53:20.298726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:53:20.309097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c25ad7-29f8-4070-a8d8-036bd7b0930b service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:53:20.314678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:53:20.315319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:53:20.315606 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:53:20.315886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:53:20.317663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:53:20.329535 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:53:20.331114 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96e997-13b1-4f77-96b4-f753dc2479bf service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:53:20.340748 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4416/8938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:54:26.728906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:54:26.729820 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:54:26.730382 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:54:26.755374 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:54:26.756658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:54:26.766379 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4523/8939] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:54:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:54:27.097769 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:54:27.098316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:54:27.098316 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:54:27.118094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] MFA Rules not processed for user `f4e42d69072d4f629c21c41a879dc01d`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:54:27.119692 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:54:27.127617 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4417/8940] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:54:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:54:27.139653 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:54:27.152182 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c90bbf-60d2-41b9-bf61-4c49545cfd0f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:54:27.159081 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:54:27.160309 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:54:27.160718 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:54:27.161063 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:54:27.168970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:54:27.170534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:54:27.178574 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4524/8941] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:54:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:54:29.961040 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:54:29.979319 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063f88-79cf-4d92-b009-da266f62c4d7 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:54:29.987410 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:54:29.988393 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:54:29.988896 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:54:29.990941 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:54:30.003417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:54:30.005080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:54:30.015334 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4418/8942] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:54:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:54:37.488802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:54:37.497166 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362892c4-1db9-41cb-9c0a-85c9532e7c1d service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:54:37.501245 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:54:37.501875 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:54:37.502162 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:54:37.502437 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:54:37.524295 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:54:37.525786 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:54:37.535260 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4525/8943] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:54:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:55:13.881429 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:55:13.890586 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b370dc-419e-4363-9ddf-2e17404cc571 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:55:13.894768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:55:13.895444 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:55:13.895731 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:55:13.896009 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:55:13.914937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:55:13.916576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:55:13.927888 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4419/8944] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:55:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:55:15.110104 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:55:15.119417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dbb5a-11c4-4497-8f64-5e435b50cd77 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:55:15.123044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:55:15.123684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:55:15.123968 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:55:15.124248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:55:15.134706 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:55:15.136123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:55:15.146671 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4526/8945] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:55:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:55:24.476996 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:55:24.488889 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b2f4-19e4-4cd5-9e99-8e804c5470f1 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:55:24.492798 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:55:24.493486 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:55:24.493776 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:55:24.494061 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:55:24.501992 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:55:24.503441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57802b37-aaec-467c-a274-4aaf3a4cd721 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:55:24.511636 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4420/8946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:55:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:56:01.067597 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:56:01.079025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57427d93-5a75-4edd-9350-b3e6a85df0ea service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:56:01.085242 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:56:01.085867 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:56:01.086157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:56:01.087298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:56:01.096882 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:56:01.099302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:56:01.110944 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4527/8947] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:56:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:56:13.826873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:56:13.827468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:56:13.827468 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:56:13.858004 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] MFA Rules not processed for user `6a25135e2c29463999fd4d912d99bf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:56:13.858675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:56:13.868909 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4421/8948] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:56:14.267767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:56:14.281576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418c417-4528-467c-bd21-6ae39454ec8d service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:56:14.287809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:56:14.288986 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:56:14.289483 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:56:14.289767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:56:14.310609 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:56:14.312606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:56:14.323710 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4528/8949] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:56:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:56:21.571373 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:56:21.586824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdbbbd-f088-4b7b-a478-4a10f64569ec None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:56:21.593045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:56:21.593712 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:56:21.594345 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:56:21.594825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:56:21.606624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:56:21.608593 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b68699-0945-4ae3-bdfa-9d65152dc0be service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:56:21.621278 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4422/8950] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:56:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 21:57:14.589439 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:14.661451 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c59ff-9c7c-495b-a474-1ecaa94f3cac service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:14.666301 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:14.667205 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:14.667488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:14.667763 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] PATH_INFO: `/v3/users/6a25135e2c29463999fd4d912d99bf6b` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:14.669003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a25135e2c29463999fd4d912d99bf6b)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:14.670950 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:14.718995 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a25135e2c29463999fd4d912d99bf6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:14.727232 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a25135e2c29463999fd4d912d99bf6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:14.727918 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a25135e2c29463999fd4d912d99bf6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:14.728555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a25135e2c29463999fd4d912d99bf6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:14.736148 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a25135e2c29463999fd4d912d99bf6b'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:14.753747 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4529/8951] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:57:14 2022] DELETE /identity/v3/users/6a25135e2c29463999fd4d912d99bf6b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:14.758299 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:14.758782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:14.758883 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:14.790403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:14.791625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:14.849464 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4423/8952] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:14.858993 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:14.860397 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:14.918392 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6ca2-75df-4ea8-aa14-26120f1c943a admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:14.922016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:14.922667 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:14.922953 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:14.923234 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:14.932156 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:14.933628 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:14.942890 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4530/8953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:57:15.107953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:15.109872 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:15.122900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21a912-4d65-497b-ac83-dd4376adf225 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:15.128438 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:15.129496 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.129882 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.130405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] PATH_INFO: `/v3/projects/ca394d2c596042ad961fc645ce7b6940` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.131749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca394d2c596042ad961fc645ce7b6940)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:15.133914 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:15.182045 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca394d2c596042ad961fc645ce7b6940', 'request_id': 'req-8e7605dd-a16e-40d7-9bdb-7ff67652648e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.187897 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca394d2c596042ad961fc645ce7b6940', 'request_id': 'req-8e7605dd-a16e-40d7-9bdb-7ff67652648e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.194039 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca394d2c596042ad961fc645ce7b6940', 'request_id': 'req-8e7605dd-a16e-40d7-9bdb-7ff67652648e'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.206362 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] The token cache is being invalidate because project ca394d2c596042ad961fc645ce7b6940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:57:15.206653 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.207274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.208848 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4424/8954] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:57:15 2022] DELETE /identity/v3/projects/ca394d2c596042ad961fc645ce7b6940 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:15.212892 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:15.222500 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcc320-7a5a-47aa-97bb-d4a5150f074d service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:15.280044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:15.280973 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.281258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.281800 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] PATH_INFO: `/v3/users/7aceb8d01d1145d6b64de7dffec5ac44` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.282997 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aceb8d01d1145d6b64de7dffec5ac44)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:15.284969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:15.331909 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aceb8d01d1145d6b64de7dffec5ac44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.339125 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aceb8d01d1145d6b64de7dffec5ac44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.339747 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aceb8d01d1145d6b64de7dffec5ac44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.340357 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aceb8d01d1145d6b64de7dffec5ac44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.347334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-34e16529-4ce6-477a-9b20-1d072e2457ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aceb8d01d1145d6b64de7dffec5ac44'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.364203 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4531/8955] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 21:57:15 2022] DELETE /identity/v3/users/7aceb8d01d1145d6b64de7dffec5ac44 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:15.635726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:15.637352 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:15.650814 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7605dd-a16e-40d7-9bdb-7ff67652648e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:15.708099 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:15.708915 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.709204 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.709478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] PATH_INFO: `/v3/projects/5ca1b466668a458b93736f7e6586433e` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.710654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca1b466668a458b93736f7e6586433e)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:15.712596 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:15.756855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca1b466668a458b93736f7e6586433e', 'request_id': 'req-262d9a46-4e50-4bbd-84c8-6f907a1a0882'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.762690 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca1b466668a458b93736f7e6586433e', 'request_id': 'req-262d9a46-4e50-4bbd-84c8-6f907a1a0882'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.768311 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca1b466668a458b93736f7e6586433e', 'request_id': 'req-262d9a46-4e50-4bbd-84c8-6f907a1a0882'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.779663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] The token cache is being invalidate because project 5ca1b466668a458b93736f7e6586433e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 21:57:15.779952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.780675 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-262d9a46-4e50-4bbd-84c8-6f907a1a0882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 21:57:15.782517 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4425/8956] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:57:15 2022] DELETE /identity/v3/projects/5ca1b466668a458b93736f7e6586433e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:15.788302 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.788809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.788930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.825575 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:15.827079 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:15.884328 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4532/8957] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:15.893078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.893507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.893860 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.913536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:15.914855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:15.922949 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4426/8958] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:15.927803 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:15.938642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6972-c4e8-45a0-bf04-7046dc72e5c7 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:15.943530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:15.944204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.944521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.944826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.945541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 21:57:15.945850 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:15.947464 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:15.959531 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4533/8959] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 21:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 21:57:15.963906 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:15.974019 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece80bd-f82f-4dc8-8825-c8ed727d2f5d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:15.978649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:15.979296 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:15.979579 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:15.979853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:15.980568 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:15.982458 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.017667 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4427/8960] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:57:15 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:57:16.021923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:16.032083 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adf88-f48e-4716-bbaa-1e057d1f2102 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:16.087174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:16.087839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.088123 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.088400 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.089113 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:16.091046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.110426 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4534/8961] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:57:16 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:57:16.114590 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:16.124948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4ea5-335a-4e8a-a32e-e80d1bad3127 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:16.129604 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:16.130268 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.130566 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.130840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.131561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:16.133650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.147165 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4428/8962] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:57:16.148300 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:16.159457 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb5745-76cb-4ebc-bb6d-7e19bb557a89 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:16.164488 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:16.165159 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.165449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.165734 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.166453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:16.168089 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6efc9-0c7c-478f-8e0a-df4a90a50df5 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.177836 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4535/8963] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:57:16.181853 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:16.192055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee24a6-e9e0-4f64-ae10-232ad924ef05 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:16.196757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:16.197632 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.197917 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.198199 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] PATH_INFO: `/v3/projects/6e33cf82705649d680da9a6bb1ecf1fe/users/d67b2d6324ec46ca91756e3a19dac4dd/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.214292 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e33cf82705649d680da9a6bb1ecf1fe, user_id=d67b2d6324ec46ca91756e3a19dac4dd, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:16.217510 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.231721 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4429/8964] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:57:16 2022] PUT /identity/v3/projects/6e33cf82705649d680da9a6bb1ecf1fe/users/d67b2d6324ec46ca91756e3a19dac4dd/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:16.236802 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccc7e-1bb5-41c6-b09a-2a92842a9841 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.237095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccc7e-1bb5-41c6-b09a-2a92842a9841 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.237369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ccc7e-1bb5-41c6-b09a-2a92842a9841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.258417 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-815ccc7e-1bb5-41c6-b09a-2a92842a9841 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:16.259847 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-815ccc7e-1bb5-41c6-b09a-2a92842a9841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:16.319639 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4536/8965] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:16.329269 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:16.331455 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:16.386459 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dae0-1e76-4010-90be-36e2ac06bb65 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:16.390174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:16.390820 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:16.391116 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:16.391400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:16.401765 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:16.403195 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:16.413592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4430/8966] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:57:20.475960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.476562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.476562 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.506249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] MFA Rules not processed for user `d67b2d6324ec46ca91756e3a19dac4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:20.507708 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:20.573305 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4537/8967] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:20.577824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.588174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3211ad5-e762-421c-af33-b2397faac0d6 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.592880 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.593541 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.593830 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.594113 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.594806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.596795 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.627962 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4431/8968] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 21:57:20 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 21:57:20.628721 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.640749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a176bb-63c9-4d9f-b1e9-1dfdff5b4e68 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.699413 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.700092 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.700380 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.700807 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.701853 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.703845 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.723917 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4538/8969] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 21:57:20 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 21:57:20.728035 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.740055 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217bc7-84e4-4a57-bdde-c5f7934b66f8 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.745173 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.745837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.746126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.746408 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.747127 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.748804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.762175 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4432/8970] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 21:57:20.766334 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.776368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b73fcb-1658-4237-8016-0fdb3cf173d7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.781766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.782657 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.782970 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.783253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] PATH_INFO: `/v3/projects/606664aa1d6141f4ab9f26dfffc69a12/users/d3f3559ec34e47d4a52c98abd6940c8e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.798364 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=606664aa1d6141f4ab9f26dfffc69a12, user_id=d3f3559ec34e47d4a52c98abd6940c8e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.801654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.813896 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4539/8971] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:57:20 2022] PUT /identity/v3/projects/606664aa1d6141f4ab9f26dfffc69a12/users/d3f3559ec34e47d4a52c98abd6940c8e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 21:57:20.818563 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.828806 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35810792-fb6a-4dc0-a677-6d7f8726af69 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.884335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.885343 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.885635 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.885918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.886633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.888223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a973-c479-47c2-ac00-135dcb90e7ef admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.897864 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4433/8972] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 21:57:20.902052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:20.913075 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e84b-e2e8-48f0-9964-445ebc32c27e admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:20.917727 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:20.918607 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:20.918893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:20.919174 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] PATH_INFO: `/v3/projects/606664aa1d6141f4ab9f26dfffc69a12/users/d3f3559ec34e47d4a52c98abd6940c8e/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:20.921192 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606664aa1d6141f4ab9f26dfffc69a12, user_id=d3f3559ec34e47d4a52c98abd6940c8e, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:20.924355 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:20.934371 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4540/8973] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 21:57:20 2022] PUT /identity/v3/projects/606664aa1d6141f4ab9f26dfffc69a12/users/d3f3559ec34e47d4a52c98abd6940c8e/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 21:57:25.809070 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cc3e-fb2b-438b-b07d-8357e907b393 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:25.809655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cc3e-fb2b-438b-b07d-8357e907b393 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:25.809655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cc3e-fb2b-438b-b07d-8357e907b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:25.839552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-4292cc3e-fb2b-438b-b07d-8357e907b393 None None] MFA Rules not processed for user `d3f3559ec34e47d4a52c98abd6940c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:25.840824 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4292cc3e-fb2b-438b-b07d-8357e907b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:25.935808 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4434/8974] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:25.954128 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:25.955947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:26.045681 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30b26d-9b2c-4c86-b809-60ab488eab14 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:26.052180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:26.052877 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:26.053169 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:26.053449 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:26.107475 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:26.109121 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:26.118715 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4541/8975] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:57:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:57:27.272249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:27.272804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:27.272903 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:27.291031 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] MFA Rules not processed for user `d67b2d6324ec46ca91756e3a19dac4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:57:27.292245 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:57:27.299251 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4435/8976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 21:57:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:57:37.736976 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:57:37.790555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3418e1-23b5-4ba1-ac76-1dbe267a78a8 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:57:37.794195 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:57:37.794839 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:57:37.795143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:57:37.795425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:57:37.804861 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:57:37.806283 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:57:37.815507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4542/8977] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:58:16.783412 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:58:16.784837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:58:16.864072 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c185-60db-4ca5-aef0-379b4ce2fab1 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:58:16.869189 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:58:16.869840 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:58:16.870129 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:58:16.870413 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:58:16.872157 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:58:16.883558 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:58:16.885170 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65f135-a617-4afc-87ac-c4cd1254ec63 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:58:16.895349 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4436/8978] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:58:22.462106 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:58:22.463545 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:58:22.478339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce12987-7740-443a-80ea-51c079c0f7c9 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:58:22.483371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:58:22.484016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:58:22.484305 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:58:22.484617 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:58:22.486930 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:58:22.498007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:58:22.499584 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:58:22.509411 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4543/8979] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 21:58:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 21:59:50.336983 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:59:50.337886 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:59:50.338237 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:59:50.391478 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 21:59:50.393327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:59:50.466362 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4437/8980] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 21:59:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 21:59:50.520157 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 21:59:50.521742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 21:59:50.620589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ba4c6-40ab-45a8-b16d-fb6710b369a8 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 21:59:50.625684 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 21:59:50.626907 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 21:59:50.627210 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 21:59:50.627541 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 21:59:50.635696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 21:59:50.637323 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56d75-0e5c-4eb5-bf99-1ae86ac0f354 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 21:59:50.645553 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4544/8981] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 21:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:00:02.545213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:02.554900 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a1b93-cbc5-4b5d-b9c3-371ea19a467d None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:02.558451 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:02.559087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:02.559369 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:02.559649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:02.561405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:02.571142 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:02.572624 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a0f34-2633-49fa-8587-c6e3d9176521 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:02.580797 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4438/8982] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:02.676658 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:02.677224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:02.677224 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:02.740863 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:00:02.742340 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:02.753520 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4545/8983] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:00:02.765617 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:02.766002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:02.766380 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:02.816955 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] MFA Rules not processed for user `a51bfe290bcb46ca8fbecbaed36d2044`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:00:02.818179 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:02.878890 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4439/8984] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Apr 2 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 02 22:00:02.885023 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:02.894587 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafac558-cd2c-4ab1-94a9-7ffcd963dc1a None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:02.898144 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a51bfe290bcb46ca8fbecbaed36d2044', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:02.898776 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:02.899059 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:02.899336 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:02.909443 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:02.910858 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33a38-a6c0-44db-a9b6-85a4a3eafdbe service glance] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:02.921253 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4546/8985] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:02.983123 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:02.992220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cdc38-e59d-4a20-bec8-f2fc7017eaa4 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:02.995804 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:02.996441 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:02.996749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:02.997023 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:02.998758 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:03.008672 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:03.010025 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:03.018358 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4440/8986] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:03.090484 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:03.090809 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:03.091094 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:03.110046 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] MFA Rules not processed for user `46f6dffd311b4df69ae3c89ab41e8738`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:00:03.111249 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:03.120662 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4547/8987] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Apr 2 22:00:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:00:03.130984 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:03.132350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:03.143220 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085ac65-4527-4130-ac3d-d45ad4c2362e service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:03.146960 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:03.147599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:03.147887 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:03.148174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:03.158519 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:03.159940 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5585d0-2ae4-413a-b8fc-d9093ccbe97e service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:03.170621 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4441/8988] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:03.238614 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:03.249707 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f571f3-b154-4a37-bfa2-bbde9e824f06 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:03.255271 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:03.255906 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:03.256191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:03.256480 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:03.258238 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:03.269325 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:03.270842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:03.280634 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4548/8989] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:05.100110 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:05.100615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:05.100838 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:05.119961 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:00:05.121119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:05.129072 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4442/8990] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 22:00:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:00:05.141085 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:05.152766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663302-5f51-4b76-adde-85473fdcd062 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:05.158044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:05.158846 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:05.159135 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:05.159416 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:05.167758 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:05.169370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:05.177884 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4549/8991] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:00:14.642555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:14.652121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187902-45e9-4ccb-a8d9-5d7c084fb028 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:14.656167 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:14.656861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:14.657144 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:14.657418 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:14.659208 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:14.672599 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:14.674556 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062002a-33b3-4632-be56-9b5abea12d3f service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:14.685089 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4443/8992] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:15.866975 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:15.876044 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca08b-5fe3-4044-a6fb-e943ece52a7b service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:15.880216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:15.880884 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:15.881177 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:15.881482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:15.883208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:15.897007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:15.898434 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:15.909636 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4550/8993] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:00:16.147857 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:16.148320 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:16.148421 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:16.166214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:00:16.167470 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:16.175321 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4444/8994] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 22:00:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:00:16.188200 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:16.201543 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50c5f-a9fb-49be-9e04-eeae5b00665d service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:16.207385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:16.208183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:16.208501 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:16.208787 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:16.219767 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:16.221429 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:16.231716 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4551/8995] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:00:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:00:28.471756 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:00:28.481026 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b43c2-27c7-4dd5-b0f5-d530d2a04827 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:00:28.484663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:00:28.485303 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:00:28.485588 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:00:28.485963 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:00:28.488370 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:00:28.498650 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:00:28.500149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c44f43-d4b9-408a-b7d2-461804c01f62 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:00:28.509871 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4445/8996] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:00:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:01:33.574074 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:01:33.586899 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ede1-803b-4129-972a-d148a059d605 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:01:33.592422 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:01:33.593165 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:01:33.593515 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:01:33.593860 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:01:33.596485 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:33.609060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:01:33.610639 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:01:33.621113 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4552/8997] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:01:38.664705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:01:38.665201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:01:38.665289 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:01:38.683417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] MFA Rules not processed for user `d67b2d6324ec46ca91756e3a19dac4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:01:38.684648 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:38.691800 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4446/8998] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:01:41.938095 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:01:41.951150 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034cf5b-6800-4b7d-a207-e637b52c676a service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:01:41.956225 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:01:41.957455 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:01:41.957742 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:01:41.958022 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:01:41.959876 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:41.972035 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:01:41.974288 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:01:41.984347 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4553/8999] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:01:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:01:51.027205 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:01:51.028778 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:51.045615 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f05f83-b046-4d54-999e-0d3b34c0f238 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:01:51.051681 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:01:51.052331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:01:51.052655 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:01:51.052937 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:01:51.054702 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:51.067357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:01:51.068965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:01:51.079332 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4447/9000] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:01:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:01:54.493534 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:01:54.505862 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b243c-6b39-41fd-9922-a79aa46fb0fe service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:01:54.511568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:01:54.512218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:01:54.512538 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:01:54.512823 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:01:54.514629 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:01:54.527932 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:01:54.529573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:01:54.540733 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4554/9001] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:03:20.774263 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:03:20.812759 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88226d-8c91-4c3d-86a8-bc625d5f063a service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:03:20.817873 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:03:20.818515 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:03:20.818799 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:03:20.819106 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:03:20.827540 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:03:20.829181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:03:20.838784 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4448/9002] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:03:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:03:29.437103 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:03:29.458368 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf88c-2196-45fb-8be9-2c5a14716b91 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:03:29.463385 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:03:29.464031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:03:29.464319 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:03:29.464631 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:03:29.473625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:03:29.475204 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:03:29.484924 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4555/9003] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:04:01.693614 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:04:01.715210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009132a9-dbc7-44dd-b321-31345650a932 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:04:01.720657 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:04:01.721295 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:04:01.721582 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:04:01.721861 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:04:01.729484 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:04:01.731686 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:04:01.740327 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4449/9004] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:04:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:05:33.463043 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:05:33.481517 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af4c1-35d4-4519-81d3-8e6a2dee8dc9 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:05:33.485790 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:05:33.486468 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:05:33.486760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:05:33.487039 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:05:33.494149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:05:33.495571 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:05:33.504013 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4556/9005] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:05:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:07.119783 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:07.131576 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4aa4e6-6c3a-444b-9848-e035c28eebe6 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:07.139327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:07.139327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:07.139327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:07.139327 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:07.172203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:07.173751 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:07.186678 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4450/9006] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:08.373760 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:08.382601 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed052-4dcc-41fe-bc4c-0ebe11c5867d service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:08.386263 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:08.386894 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:08.387183 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:08.387458 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:08.398248 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:08.399668 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:08.411047 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4557/9007] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:10.973691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:10.982152 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64540c-0004-497e-97e5-c4cf3a5e2d51 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:10.985918 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:10.986553 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:10.986837 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:10.987115 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:11.055021 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:11.056372 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:11.066473 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4451/9008] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:17.381956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:17.393324 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06c42c-7029-4ccb-8d4e-1842b26d67e0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:17.399630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:17.400566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:17.400854 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:17.401155 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] PATH_INFO: `/v3/users/d67b2d6324ec46ca91756e3a19dac4dd` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:17.402371 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67b2d6324ec46ca91756e3a19dac4dd)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:17.404625 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:17.451320 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67b2d6324ec46ca91756e3a19dac4dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.459266 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67b2d6324ec46ca91756e3a19dac4dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.459937 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67b2d6324ec46ca91756e3a19dac4dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.460641 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67b2d6324ec46ca91756e3a19dac4dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.467637 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67b2d6324ec46ca91756e3a19dac4dd'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.484875 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4558/9009] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 22:06:17 2022] DELETE /identity/v3/users/d67b2d6324ec46ca91756e3a19dac4dd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 22:06:17.652392 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:17.665969 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d38f-ef59-4c74-8ec3-cd66adf1be21 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:17.722707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:17.723561 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:17.723845 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:17.724118 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] PATH_INFO: `/v3/projects/6e33cf82705649d680da9a6bb1ecf1fe` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:17.725321 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e33cf82705649d680da9a6bb1ecf1fe)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:17.727200 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:17.771331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e33cf82705649d680da9a6bb1ecf1fe', 'request_id': 'req-433c4a4f-0f33-401f-a202-946c5f49c3cb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.777141 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e33cf82705649d680da9a6bb1ecf1fe', 'request_id': 'req-433c4a4f-0f33-401f-a202-946c5f49c3cb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.782749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e33cf82705649d680da9a6bb1ecf1fe', 'request_id': 'req-433c4a4f-0f33-401f-a202-946c5f49c3cb'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.805831 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] The token cache is being invalidate because project 6e33cf82705649d680da9a6bb1ecf1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 22:06:17.806124 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.806754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.808273 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4452/9010] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 22:06:17 2022] DELETE /identity/v3/projects/6e33cf82705649d680da9a6bb1ecf1fe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:06:17.812272 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:17.814286 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:17.836888 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296de1-f314-4dbb-806b-1aa3d4f6376d admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:17.895328 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:17.896208 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:17.896521 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:17.896812 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] PATH_INFO: `/v3/users/d3f3559ec34e47d4a52c98abd6940c8e` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:17.898016 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f3559ec34e47d4a52c98abd6940c8e)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:17.899945 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:17.943810 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f3559ec34e47d4a52c98abd6940c8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.950258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f3559ec34e47d4a52c98abd6940c8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.950874 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f3559ec34e47d4a52c98abd6940c8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.951524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f3559ec34e47d4a52c98abd6940c8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.958923 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-7fe3e2b5-3df2-4a24-b987-0c7e3a398cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f3559ec34e47d4a52c98abd6940c8e'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:17.974941 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4559/9011] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 22:06:17 2022] DELETE /identity/v3/users/d3f3559ec34e47d4a52c98abd6940c8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:06:18.140982 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.142435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:18.155150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c4a4f-0f33-401f-a202-946c5f49c3cb admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.213856 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.214833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.215331 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.215711 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] PATH_INFO: `/v3/projects/606664aa1d6141f4ab9f26dfffc69a12` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.217050 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606664aa1d6141f4ab9f26dfffc69a12)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.219090 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.279654 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606664aa1d6141f4ab9f26dfffc69a12', 'request_id': 'req-3339b6f7-8636-4fd8-be01-13b8a886c299'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:18.285942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606664aa1d6141f4ab9f26dfffc69a12', 'request_id': 'req-3339b6f7-8636-4fd8-be01-13b8a886c299'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:18.291278 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606664aa1d6141f4ab9f26dfffc69a12', 'request_id': 'req-3339b6f7-8636-4fd8-be01-13b8a886c299'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:18.304058 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] The token cache is being invalidate because project 606664aa1d6141f4ab9f26dfffc69a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 22:06:18.304338 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:18.304999 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-3339b6f7-8636-4fd8-be01-13b8a886c299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:06:18.306558 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4453/9012] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 22:06:18 2022] DELETE /identity/v3/projects/606664aa1d6141f4ab9f26dfffc69a12 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:06:18.311565 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.311859 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.312207 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.335828 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:18.337561 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:18.397504 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4560/9013] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:06:18.405768 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.406002 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.406283 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.425419 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:18.426600 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:18.434463 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4454/9014] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:06:18.439339 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.449028 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75deb5-8372-4d80-9e0e-5ada9b590749 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.454173 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.454736 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.455020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.455298 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.456253 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97317) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 02 22:06:18.456344 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.457935 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.471503 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4561/9015] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Apr 2 22:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 02 22:06:18.475276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.485472 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cd54f-2e69-49b6-9813-664f9309d1c9 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.490433 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.491080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.491405 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.491664 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.492335 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.494257 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.521027 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4455/9016] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 22:06:18 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 22:06:18.525227 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.543366 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd5a86-75e5-4ec5-a331-dfc329464ef7 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.597661 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.598404 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.598687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.598959 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.599638 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.601568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.621545 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4562/9017] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 22:06:18 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 22:06:18.625739 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.636121 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6178fc-9e35-4e4d-9d29-f3a4cb448b96 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.640825 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.641481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.641764 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.642041 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.642757 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.644357 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.656427 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4456/9018] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 22:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 22:06:18.661037 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.671130 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6fb4e-d9fb-43a4-a15f-39ccd73398f0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.676423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.677114 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.677408 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.677687 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.678436 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.680038 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195dd36-9599-4620-b107-fc71298ef3c0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.689826 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4563/9019] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 22:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 22:06:18.694077 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.703921 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9b811-9256-4e77-ac47-59ae85619e9e admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.708520 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.709389 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.709671 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.709948 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] PATH_INFO: `/v3/projects/4b882d9c90ca4758aab82bb7f2db9dc6/users/57d4061c7eef439ba5fd20abb4c4c447/roles/7fae3e7cc044438ea145a155975c346d` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.724148 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b882d9c90ca4758aab82bb7f2db9dc6, user_id=57d4061c7eef439ba5fd20abb4c4c447, role_id=7fae3e7cc044438ea145a155975c346d)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.726833 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.740338 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4457/9020] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 22:06:18 2022] PUT /identity/v3/projects/4b882d9c90ca4758aab82bb7f2db9dc6/users/57d4061c7eef439ba5fd20abb4c4c447/roles/7fae3e7cc044438ea145a155975c346d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 22:06:18.745447 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a88b-8e8f-490a-9d99-032490dcb4cf None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.745799 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a88b-8e8f-490a-9d99-032490dcb4cf None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.746082 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a88b-8e8f-490a-9d99-032490dcb4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.763530 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-48d3a88b-8e8f-490a-9d99-032490dcb4cf None None] MFA Rules not processed for user `f64244c630f04a95910fd2ccfc3fa177`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:18.764781 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-48d3a88b-8e8f-490a-9d99-032490dcb4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:18.821554 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4564/9021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:06:18.831132 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:18.833011 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:18.899990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178b3c1-c934-4fff-8842-12ea959351b6 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:18.903942 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:18.904636 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:18.904928 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:18.905210 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:18.914705 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:18.916078 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:18.925857 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4458/9022] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:23.102745 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.103280 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.103533 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.139072 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] MFA Rules not processed for user `57d4061c7eef439ba5fd20abb4c4c447`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:23.140568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:23.209135 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4565/9023] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 22:06:23.213987 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.224085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3afd-d564-4ef2-b214-e08b31d0ee82 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.236645 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.237641 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.238097 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.238379 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.239095 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.241279 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.273710 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4459/9024] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Apr 2 22:06:23 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 02 22:06:23.275078 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.286566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da068-a8b9-4d32-81d9-467e2eaa867f None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.344589 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.345282 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.345570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.345872 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] PATH_INFO: `/v3/users` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.346566 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.348555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.374243 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4566/9025] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Apr 2 22:06:23 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 02 22:06:23.376314 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.394241 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fa01a-e429-4164-b69f-c4383ee07b7d admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.399384 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.400161 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.400477 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.400766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.401507 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.403403 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.414814 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4460/9026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 02 22:06:23.419213 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.430047 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d7e7-769d-4c13-b1b7-e7f89682adc0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.434913 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.435811 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.436118 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.436370 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] PATH_INFO: `/v3/projects/8caba273da6341909bf5c5cabbb24e56/users/c8d6e2be269f4b6a877e4aa3a150cc11/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.456180 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caba273da6341909bf5c5cabbb24e56, user_id=c8d6e2be269f4b6a877e4aa3a150cc11, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.458816 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.473956 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4567/9027] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 22:06:23 2022] PUT /identity/v3/projects/8caba273da6341909bf5c5cabbb24e56/users/c8d6e2be269f4b6a877e4aa3a150cc11/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 22:06:23.478181 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.489621 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677e63-4b41-424a-87db-115205db0d93 admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.556663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.557350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.557643 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.557929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.558662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.560286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a58da-54c7-4610-abf9-0a60a520d4f5 admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.571501 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4461/9028] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 02 22:06:23.575766 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:23.587066 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7e93-7d79-4dcc-a638-b8224499d02f admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:23.592025 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:23.592883 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] REQUEST_METHOD: `PUT` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:23.593172 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:23.593471 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] PATH_INFO: `/v3/projects/8caba273da6341909bf5c5cabbb24e56/users/c8d6e2be269f4b6a877e4aa3a150cc11/roles/42bee24e8b3d4569a87041c383fcd39f` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:23.595701 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caba273da6341909bf5c5cabbb24e56, user_id=c8d6e2be269f4b6a877e4aa3a150cc11, role_id=42bee24e8b3d4569a87041c383fcd39f)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:23.598570 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:23.612381 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4568/9029] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Apr 2 22:06:23 2022] PUT /identity/v3/projects/8caba273da6341909bf5c5cabbb24e56/users/c8d6e2be269f4b6a877e4aa3a150cc11/roles/42bee24e8b3d4569a87041c383fcd39f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:06:28.394232 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcac-d25e-4fdf-a10a-66a78ce36d90 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:28.394707 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcac-d25e-4fdf-a10a-66a78ce36d90 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:28.394805 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610dcac-d25e-4fdf-a10a-66a78ce36d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:28.429649 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-7610dcac-d25e-4fdf-a10a-66a78ce36d90 None None] MFA Rules not processed for user `c8d6e2be269f4b6a877e4aa3a150cc11`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:28.430426 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7610dcac-d25e-4fdf-a10a-66a78ce36d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:28.528616 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4462/9030] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:06:28.539723 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:28.543511 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:28.634068 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa661b-3bf8-4dad-a84d-cd417c43d499 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:28.640212 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:28.641524 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:28.641678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:28.642003 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:28.718369 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:28.725386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:28.739050 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4569/9031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:30.112740 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:30.113223 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:30.113322 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:30.131678 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] MFA Rules not processed for user `57d4061c7eef439ba5fd20abb4c4c447`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:06:30.133149 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:30.140626 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4463/9032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:06:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 02 22:06:30.475175 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:30.476642 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:30.539285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b1341-5e9a-43a9-ab99-8a886a196fe2 service nova] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:30.543608 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:30.544289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:30.544619 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:30.544898 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:30.546689 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:30.556492 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:30.557977 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:30.566668 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4570/9033] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:33.424498 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:33.427753 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:33.460855 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428ed46-7c1c-4c9b-9cc6-0b3c5663458e None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:33.467087 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:33.468174 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:33.468663 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:33.469222 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:33.471213 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:06:33.488395 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:33.490701 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:33.506691 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4464/9034] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:06:40.512504 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:06:40.520919 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acd02f-6055-4e53-b127-5440a7f8f485 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:06:40.524494 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:06:40.525133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:06:40.525418 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:06:40.525696 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:06:40.535386 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:06:40.536842 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:06:40.547780 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4571/9035] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:08:22.756203 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:22.757625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:22.835633 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b671cb6-f4ed-419e-a367-931e443ec0b5 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:22.840745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:22.841397 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:22.841683 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:22.841962 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:22.843725 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:22.854947 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:22.856552 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3984bf8-9544-44a6-90bf-78251874aca4 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:22.866783 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4465/9036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:08:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:08:34.411982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:34.413482 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:34.428140 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f06c3-1de1-4b32-8e79-828bc0e17df4 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:34.433069 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:34.433702 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:34.433985 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:34.434260 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:34.435964 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:34.447230 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:34.448849 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:34.458802 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4572/9037] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:08:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:08:43.928244 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:43.928726 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:43.928839 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:43.957273 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:08:43.958417 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:44.018437 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4466/9038] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:08:44.064749 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:44.066710 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:44.132573 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427bf62-5a30-4db3-8dc4-70a90cc05433 service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:44.137633 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:44.138289 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:44.138581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:44.138865 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:44.147659 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:44.149292 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f73175-5af8-4715-99dd-02ac387cc49b service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:44.157639 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4573/9039] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:08:44.913180 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:44.929454 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9ddb9-400a-46ad-8197-715aa76906a3 None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:44.937625 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:44.938684 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:44.939069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:44.939482 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:44.942094 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:44.956926 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:44.959929 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:44.972252 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4467/9040] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:08:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:08:53.387448 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2a83-69d2-469a-a295-fba4d07b7cb0 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:53.387925 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2a83-69d2-469a-a295-fba4d07b7cb0 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:53.388017 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d2a83-69d2-469a-a295-fba4d07b7cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:53.407630 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-b36d2a83-69d2-469a-a295-fba4d07b7cb0 None None] MFA Rules not processed for user `57d4061c7eef439ba5fd20abb4c4c447`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:08:53.408929 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-b36d2a83-69d2-469a-a295-fba4d07b7cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:53.416932 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4574/9041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Apr 2 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:08:54.039691 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:54.051817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159e5e7-30d3-4ae3-b1e9-3288aee713d1 service nova] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:54.056990 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:54.057646 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:54.057934 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:54.058214 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:54.059965 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:54.072276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:54.073888 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:54.086824 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4468/9042] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:08:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:08:55.372683 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:55.373203 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:55.373296 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:55.391133 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:08:55.392318 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:08:55.400062 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4575/9043] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 22:08:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:08:55.412225 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:08:55.423262 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492dda-e76b-4506-b23c-8d231fce3eac service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:08:55.428537 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:08:55.429193 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:08:55.429481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:08:55.429964 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:08:55.438973 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:08:55.440598 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:08:55.461592 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4469/9044] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:08:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:09:12.547620 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:09:12.561654 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e213b-e359-41e7-a6cf-ef85e2ff9987 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:09:12.567856 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f6dffd311b4df69ae3c89ab41e8738', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:09:12.568544 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:09:12.568830 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:09:12.569105 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:09:12.570833 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:09:12.583568 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:09:12.585217 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296754a5-ed72-4292-aff3-a334ecee6d61 service nova] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:09:12.595946 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4576/9045] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:09:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:10:39.482766 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:10:39.492069 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d254eb-4707-4eb1-bd83-46d31ecbe248 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:10:39.496217 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:10:39.496913 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:10:39.497202 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:10:39.497481 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:10:39.499207 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:10:39.508931 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:10:39.510340 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:10:39.518183 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4470/9046] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:10:55.071969 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9bead-de09-467a-b015-699a20528631 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:10:55.072476 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9bead-de09-467a-b015-699a20528631 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:10:55.072576 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9bead-de09-467a-b015-699a20528631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:10:55.119678 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-84a9bead-de09-467a-b015-699a20528631 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:10:55.120893 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-84a9bead-de09-467a-b015-699a20528631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:10:55.136742 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4577/9047] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Apr 2 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:10:55.181575 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:10:55.203658 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fa2f-bf7d-41f1-9f8e-84ae7373dee0 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:10:55.208785 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:10:55.209440 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:10:55.209727 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:10:55.210010 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:10:55.219365 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:10:55.221286 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:10:55.231025 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4471/9048] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:11:04.371520 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] REQUEST_METHOD: `POST` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:04.372052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:04.372149 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:04.389866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.auth.core [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97317) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:11:04.391060 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:04.398214 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4578/9049] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:11:04.411085 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:04.422126 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dab5a5-8b73-4c26-9cb7-8a16d5bd01e1 service swift] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:04.427098 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:04.427935 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:04.428224 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:04.428536 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:04.436350 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:04.437967 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b9da-282c-4108-bdee-23f64377c1b7 service swift] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:04.446069 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4472/9050] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:11:07.417826 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:07.427124 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78fdb-28af-4be7-98ce-9a1d3fc55920 None None] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:07.431347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:07.431996 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:07.432285 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:07.432603 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:07.434375 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:07.462735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:07.464194 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:07.475827 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4579/9051] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:11:09.793249 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] REQUEST_METHOD: `POST` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:09.793693 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:09.793802 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:09.812400 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.auth.core [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] MFA Rules not processed for user `eebea99569544b07bb780c71b41de686`. Rule list: `[]` (Enabled: `True`). {{(pid=97316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 02 22:11:09.813626 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:09.820980 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4473/9052] 10.222.0.18 () {58 vars in 967 bytes} [Sat Apr 2 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 02 22:11:09.833547 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:09.845218 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded60788-8e87-49c5-9e83-0b7dbb71011f service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:09.850258 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46a7aa639ada47bd8cdf615e9a7a5961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:09.850901 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:09.851191 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:09.851473 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:09.860020 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:09.861627 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:09.869866 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4580/9053] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Apr 2 22:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 02 22:11:11.327306 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:11.339297 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544ef8-f8dc-497e-b8c9-20bfd56f195f None None] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:11.343414 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:11.344294 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:11.344616 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:11.344895 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:11.349274 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:11.363975 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:11.365528 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:11.379618 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4474/9054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:11:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:11:18.873581 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:18.885960 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde34ce0-44ff-47ab-9ebf-e18d11a85740 service swift] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:18.890331 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e42d69072d4f629c21c41a879dc01d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:18.891153 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:18.891555 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:18.891933 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:18.958831 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:18.960346 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:18.986972 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4581/9055] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 02 22:11:22.825492 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:22.836605 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686437-f176-43d8-93d2-5b467561c1a9 service neutron] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:22.842555 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636462d-141c-400c-8233-b5368223311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:22.843436 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636462d-141c-400c-8233-b5368223311b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:22.843749 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636462d-141c-400c-8233-b5368223311b admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:22.844076 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636462d-141c-400c-8233-b5368223311b admin admin] PATH_INFO: `/v3/users/57d4061c7eef439ba5fd20abb4c4c447` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:22.845435 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636462d-141c-400c-8233-b5368223311b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d4061c7eef439ba5fd20abb4c4c447)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:22.847989 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636462d-141c-400c-8233-b5368223311b admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:22.896178 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d4061c7eef439ba5fd20abb4c4c447'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:22.908191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d4061c7eef439ba5fd20abb4c4c447'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:22.909005 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d4061c7eef439ba5fd20abb4c4c447'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:22.917404 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d4061c7eef439ba5fd20abb4c4c447'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:22.924276 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d4061c7eef439ba5fd20abb4c4c447'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:22.930066 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4475/9056] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 22:11:22 2022] DELETE /identity/v3/users/57d4061c7eef439ba5fd20abb4c4c447 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:11:23.099031 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:23.109994 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548c6b-42d4-4370-bc84-3c169648fcf0 service neutron] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:23.164315 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:23.165216 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:23.165502 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:23.165782 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] PATH_INFO: `/v3/projects/4b882d9c90ca4758aab82bb7f2db9dc6` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:23.167527 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b882d9c90ca4758aab82bb7f2db9dc6)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:23.169474 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:23.214711 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b882d9c90ca4758aab82bb7f2db9dc6', 'request_id': 'req-90ed5504-30d9-4874-8ce7-7b68fa15eca0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.220486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b882d9c90ca4758aab82bb7f2db9dc6', 'request_id': 'req-90ed5504-30d9-4874-8ce7-7b68fa15eca0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.227694 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b882d9c90ca4758aab82bb7f2db9dc6', 'request_id': 'req-90ed5504-30d9-4874-8ce7-7b68fa15eca0'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.237949 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] The token cache is being invalidate because project 4b882d9c90ca4758aab82bb7f2db9dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 22:11:23.238244 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.238982 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.240732 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4582/9057] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 22:11:23 2022] DELETE /identity/v3/projects/4b882d9c90ca4758aab82bb7f2db9dc6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:11:23.245734 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:23.247185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:23.262504 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636462d-141c-400c-8233-b5368223311b admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:23.321080 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:23.321854 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:23.322138 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:23.322997 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] PATH_INFO: `/v3/users/c8d6e2be269f4b6a877e4aa3a150cc11` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:23.324201 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d6e2be269f4b6a877e4aa3a150cc11)` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:23.326150 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:23.370618 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d6e2be269f4b6a877e4aa3a150cc11'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.382288 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d6e2be269f4b6a877e4aa3a150cc11'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.382952 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d6e2be269f4b6a877e4aa3a150cc11'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.390489 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d6e2be269f4b6a877e4aa3a150cc11'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.397175 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.notifications [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d6e2be269f4b6a877e4aa3a150cc11'} {{(pid=97316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.403726 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4476/9058] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 22:11:23 2022] DELETE /identity/v3/users/c8d6e2be269f4b6a877e4aa3a150cc11 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 02 22:11:23.571240 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:11:23.573219 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:11:23.589866 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5504-30d9-4874-8ce7-7b68fa15eca0 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:11:23.795956 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f64244c630f04a95910fd2ccfc3fa177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa034640396047d6b05aa8a8842d2e67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:11:23.796855 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:11:23.797143 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:11:23.797425 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] PATH_INFO: `/v3/projects/8caba273da6341909bf5c5cabbb24e56` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:11:23.798612 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caba273da6341909bf5c5cabbb24e56)` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:11:23.800539 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:11:23.843493 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caba273da6341909bf5c5cabbb24e56', 'request_id': 'req-1a24f01f-4c99-420d-8419-4def784af150'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.849347 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caba273da6341909bf5c5cabbb24e56', 'request_id': 'req-1a24f01f-4c99-420d-8419-4def784af150'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.856947 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caba273da6341909bf5c5cabbb24e56', 'request_id': 'req-1a24f01f-4c99-420d-8419-4def784af150'} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.866974 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] The token cache is being invalidate because project 8caba273da6341909bf5c5cabbb24e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97317) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 02 22:11:23.867279 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.867900 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.notifications [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97317) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 02 22:11:23.869462 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4583/9059] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 22:11:23 2022] DELETE /identity/v3/projects/8caba273da6341909bf5c5cabbb24e56 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 02 22:13:28.758670 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:13:28.760119 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:13:28.846307 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5946-4fe6-44fd-9677-6c69aa8378ba admin admin] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:13:28.906953 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:13:28.907622 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:13:28.907907 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:13:28.908185 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:13:28.910695 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:13:28.924662 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:13:28.928754 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:13:28.942964 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4477/9060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:13:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:13:38.430052 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:13:38.432071 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:13:38.456379 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f01f-4c99-420d-8419-4def784af150 admin admin] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:13:38.461486 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:13:38.462136 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:13:38.462423 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:13:38.462726 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:13:38.464507 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.fernet_utils [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97317) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:13:38.475590 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:13:38.477220 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:13:38.487507 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4584/9061] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:18:34.713259 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] Authenticating user token {{(pid=97316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:18:34.714817 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.fernet_utils [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 02 22:18:34.787125 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972cf0-f771-4c8d-8f21-a39110c54b20 service placement] Validating token access rules against request {{(pid=97316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:18:34.792782 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:18:34.793457 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] REQUEST_METHOD: `GET` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:18:34.793745 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] SCRIPT_NAME: `/identity` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:18:34.794029 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:18:34.804191 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:18:34.805858 ncdv-master-1 devstack@keystone.service[97316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a5ad6-6fab-45b4-8c4e-7216e9615c30 service placement] RBAC: Authorization granted {{(pid=97316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:18:34.816915 ncdv-master-1 devstack@keystone.service[97316]: [pid: 97316|app: 0|req: 4478/9062] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:18:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 02 22:18:41.409714 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] Authenticating user token {{(pid=97317) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 02 22:18:41.439737 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6a1c7-3a7d-4052-aef0-83a42d9e4e8c service placement] Validating token access rules against request {{(pid=97317) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 02 22:18:41.444815 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f96fae657d473483c67fd7175d398f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97317) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 02 22:18:41.445453 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] REQUEST_METHOD: `GET` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 02 22:18:41.445735 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] SCRIPT_NAME: `/identity` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 02 22:18:41.446007 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97317) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 02 22:18:41.454606 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 02 22:18:41.456160 ncdv-master-1 devstack@keystone.service[97317]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0ef7a-e030-4876-8222-cf17951cf7b4 service placement] RBAC: Authorization granted {{(pid=97317) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 02 22:18:41.466243 ncdv-master-1 devstack@keystone.service[97317]: [pid: 97317|app: 0|req: 4585/9063] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Apr 2 22:18:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)